[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:39:47 dist-test-slave-6nmv krb5kdc[9034](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:39:47 dist-test-slave-6nmv krb5kdc[9034](info): set up 2 sockets
Aug 07 08:39:47 dist-test-slave-6nmv krb5kdc[9034](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260807 08:39:48.306802 9027 mini_kdc.cc:121] Time spent starting KDC: real 1.001s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:39:48 dist-test-slave-6nmv krb5kdc[9034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091988, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:39:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:39:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:39:48.420511 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:45727
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:44623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:45727
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:39:48.522729 9048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:39:48.522951 9048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:39:48.522989 9048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:39:48.526571 9048 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:39:48.526615 9048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:39:48.526633 9048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:39:48.526647 9048 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:39:48.526661 9048 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:39:48.531239 9048 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:44623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:45727
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:45727
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9048
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:39:48.532133 9048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:39:48.533056 9048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 08:39:48.540933 9048 server_base.cc:1034] running on GCE node
W20260807 08:39:48.540869 9055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:48.540858 9057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:48.540850 9054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:39:48.541599 9048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:39:48.542582 9048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:39:48.543745 9048 hybrid_clock.cc:648] HybridClock initialized: now 1786091988543693 us; error 64 us; skew 500 ppm
Aug 07 08:39:48 dist-test-slave-6nmv krb5kdc[9034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091988, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:39:48.546367 9048 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:39:48.547155 9048 webserver.cc:460] Webserver started at http://127.8.208.254:32859/ using document root <none> and password file <none>
I20260807 08:39:48.547618 9048 fs_manager.cc:359] Metadata directory not provided
I20260807 08:39:48.547672 9048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:39:48.547894 9048 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:39:48.549654 9048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "340cbf088855402392f0de7316e1d681"
format_stamp: "Formatted at 2026-08-07 08:39:48 on dist-test-slave-6nmv"
server_key: "a0058488b8aa626f3f48f97067e3016e"
server_key_iv: "72f607a597a1fb9733cc8ed59bd08664"
server_key_version: "encryptionkey@0"
I20260807 08:39:48.550205 9048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "340cbf088855402392f0de7316e1d681"
format_stamp: "Formatted at 2026-08-07 08:39:48 on dist-test-slave-6nmv"
server_key: "a0058488b8aa626f3f48f97067e3016e"
server_key_iv: "72f607a597a1fb9733cc8ed59bd08664"
server_key_version: "encryptionkey@0"
I20260807 08:39:48.553488 9048 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 08:39:48.555722 9065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:48.556792 9048 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:39:48.556921 9048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "340cbf088855402392f0de7316e1d681"
format_stamp: "Formatted at 2026-08-07 08:39:48 on dist-test-slave-6nmv"
server_key: "a0058488b8aa626f3f48f97067e3016e"
server_key_iv: "72f607a597a1fb9733cc8ed59bd08664"
server_key_version: "encryptionkey@0"
I20260807 08:39:48.557008 9048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:39:48.573992 9048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:39:48.576551 9048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:39:48.576728 9048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:39:48.583299 9048 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:45727
I20260807 08:39:48.583314 9122 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:45727 every 8 connection(s)
I20260807 08:39:48.584183 9048 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:39:48.585659 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 9048
I20260807 08:39:48.585835 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:39:48.587230 9123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:48.587391 9027 external_mini_cluster.cc:1428] Setting key 8a2faea2928048451562d35a4dc92b44
I20260807 08:39:48.592828 9123 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 340cbf088855402392f0de7316e1d681: Bootstrap starting.
I20260807 08:39:48.595038 9123 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 340cbf088855402392f0de7316e1d681: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:48.595827 9123 log.cc:824] T 00000000000000000000000000000000 P 340cbf088855402392f0de7316e1d681: Log is configured to *not* fsync() on all Append() calls
I20260807 08:39:48.597505 9123 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 340cbf088855402392f0de7316e1d681: No bootstrap required, opened a new log
I20260807 08:39:48.602155 9123 raft_consensus.cc:348] T 00000000000000000000000000000000 P 340cbf088855402392f0de7316e1d681 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "340cbf088855402392f0de7316e1d681" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45727 } }
I20260807 08:39:48.602406 9123 raft_consensus.cc:374] T 00000000000000000000000000000000 P 340cbf088855402392f0de7316e1d681 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:48.602466 9123 raft_consensus.cc:729] T 00000000000000000000000000000000 P 340cbf088855402392f0de7316e1d681 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 340cbf088855402392f0de7316e1d681, State: Initialized, Role: FOLLOWER
I20260807 08:39:48.603035 9123 consensus_queue.cc:260] T 00000000000000000000000000000000 P 340cbf088855402392f0de7316e1d681 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "340cbf088855402392f0de7316e1d681" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45727 } }
I20260807 08:39:48.603225 9123 raft_consensus.cc:388] T 00000000000000000000000000000000 P 340cbf088855402392f0de7316e1d681 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:39:48.603300 9123 raft_consensus.cc:482] T 00000000000000000000000000000000 P 340cbf088855402392f0de7316e1d681 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:39:48.603410 9123 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 340cbf088855402392f0de7316e1d681 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:48.604658 9123 raft_consensus.cc:504] T 00000000000000000000000000000000 P 340cbf088855402392f0de7316e1d681 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "340cbf088855402392f0de7316e1d681" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45727 } }
I20260807 08:39:48.605010 9123 leader_election.cc:302] T 00000000000000000000000000000000 P 340cbf088855402392f0de7316e1d681 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 340cbf088855402392f0de7316e1d681; no voters:
I20260807 08:39:48.605379 9123 leader_election.cc:288] T 00000000000000000000000000000000 P 340cbf088855402392f0de7316e1d681 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:39:48.605758 9129 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 340cbf088855402392f0de7316e1d681 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:39:48.606043 9129 raft_consensus.cc:686] T 00000000000000000000000000000000 P 340cbf088855402392f0de7316e1d681 [term 1 LEADER]: Becoming Leader. State: Replica: 340cbf088855402392f0de7316e1d681, State: Running, Role: LEADER
Aug 07 08:39:48 dist-test-slave-6nmv krb5kdc[9034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091988, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:39:48.606405 9129 consensus_queue.cc:237] T 00000000000000000000000000000000 P 340cbf088855402392f0de7316e1d681 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "340cbf088855402392f0de7316e1d681" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45727 } }
I20260807 08:39:48.606632 9123 sys_catalog.cc:564] T 00000000000000000000000000000000 P 340cbf088855402392f0de7316e1d681 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:39:48.607518 9129 sys_catalog.cc:455] T 00000000000000000000000000000000 P 340cbf088855402392f0de7316e1d681 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 340cbf088855402392f0de7316e1d681. Latest consensus state: current_term: 1 leader_uuid: "340cbf088855402392f0de7316e1d681" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "340cbf088855402392f0de7316e1d681" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45727 } } }
I20260807 08:39:48.607633 9129 sys_catalog.cc:458] T 00000000000000000000000000000000 P 340cbf088855402392f0de7316e1d681 [sys.catalog]: This master's current role is: LEADER
I20260807 08:39:48.608212 9137 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:39:48.608458 9128 sys_catalog.cc:455] T 00000000000000000000000000000000 P 340cbf088855402392f0de7316e1d681 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "340cbf088855402392f0de7316e1d681" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "340cbf088855402392f0de7316e1d681" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45727 } } }
I20260807 08:39:48.608603 9128 sys_catalog.cc:458] T 00000000000000000000000000000000 P 340cbf088855402392f0de7316e1d681 [sys.catalog]: This master's current role is: LEADER
I20260807 08:39:48.611662 9137 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:39:48.614715 9125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:48.590508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58906 (local address 127.8.208.254:45727)
0807 08:39:48.590902 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:48.590930 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:48.591881 (+ 951us) server_negotiation.cc:407] Connection header received
0807 08:39:48.595286 (+ 3405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:48.595308 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:48.595646 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:48.595943 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:48.598079 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:48.599586 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:48.601217 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:48.601924 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:48.602095 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:48.607212 (+ 5117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:48.607218 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:48.607231 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:48.607258 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:48.610425 (+ 3167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:48.611077 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:48.611082 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:48.611086 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:48.611203 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:48.611622 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:48.611624 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:48.611626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:48.612074 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:48.612315 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:48.613765 (+ 1450us) server_negotiation.cc:299] Negotiation successful
0807 08:39:48.614055 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":116,"threads_started":1}
I20260807 08:39:48.616968 9137 catalog_manager.cc:1347] Generated new cluster ID: 038c72789e584649aa1e9a2c0f1ff26c
I20260807 08:39:48.617025 9137 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:39:48.641019 9137 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:39:48.642139 9137 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:39:48.647853 9137 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 340cbf088855402392f0de7316e1d681: Generated new TSK 0
I20260807 08:39:48.648458 9137 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.208.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
I20260807 08:39:48.679865 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:45727
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:44623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:39:48.783316 9152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:39:48.783520 9152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:39:48.783560 9152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:39:48.787068 9152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:39:48.787110 9152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:39:48.787158 9152 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:39:48.791694 9152 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:44623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:45727
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:39:48.792471 9152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:39:48.793361 9152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 08:39:48.801537 9152 server_base.cc:1034] running on GCE node
W20260807 08:39:48.801481 9159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:48.801472 9161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:48.801570 9157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:39:48.802048 9152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:39:48.802574 9152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:39:48.803753 9152 hybrid_clock.cc:648] HybridClock initialized: now 1786091988803734 us; error 34 us; skew 500 ppm
Aug 07 08:39:48 dist-test-slave-6nmv krb5kdc[9034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091988, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:39:48.806429 9152 init.cc:377] Logged in from keytab as kudu/127.8.208.193@KRBTEST.COM (short username kudu)
I20260807 08:39:48.807416 9152 webserver.cc:460] Webserver started at http://127.8.208.193:41493/ using document root <none> and password file <none>
I20260807 08:39:48.808073 9152 fs_manager.cc:359] Metadata directory not provided
I20260807 08:39:48.808152 9152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:39:48.808360 9152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:39:48.811029 9152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "5bca98fd8e7a41a19dcb93ff51fbe79b"
format_stamp: "Formatted at 2026-08-07 08:39:48 on dist-test-slave-6nmv"
server_key: "1ddf51e20ea3dc1a08b72980bc3d83c9"
server_key_iv: "7ab2ae95159239123cb14b3f5876b9e0"
server_key_version: "encryptionkey@0"
I20260807 08:39:48.811794 9152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "5bca98fd8e7a41a19dcb93ff51fbe79b"
format_stamp: "Formatted at 2026-08-07 08:39:48 on dist-test-slave-6nmv"
server_key: "1ddf51e20ea3dc1a08b72980bc3d83c9"
server_key_iv: "7ab2ae95159239123cb14b3f5876b9e0"
server_key_version: "encryptionkey@0"
I20260807 08:39:48.816702 9152 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 08:39:48.819903 9168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:48.821377 9152 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 08:39:48.821480 9152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "5bca98fd8e7a41a19dcb93ff51fbe79b"
format_stamp: "Formatted at 2026-08-07 08:39:48 on dist-test-slave-6nmv"
server_key: "1ddf51e20ea3dc1a08b72980bc3d83c9"
server_key_iv: "7ab2ae95159239123cb14b3f5876b9e0"
server_key_version: "encryptionkey@0"
I20260807 08:39:48.821609 9152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:39:48.834326 9152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:39:48.837970 9152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:39:48.838164 9152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:39:48.838876 9152 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:39:48.839798 9152 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:39:48.839844 9152 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:48.839883 9152 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:39:48.839939 9152 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:48.851500 9152 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:39627
I20260807 08:39:48.851528 9294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:39627 every 8 connection(s)
I20260807 08:39:48.852439 9152 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:39:48.855161 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 9152
I20260807 08:39:48.855280 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
I20260807 08:39:48.855583 9027 external_mini_cluster.cc:1428] Setting key 37f57bc82489f630229d03aa9617a9e3
Aug 07 08:39:48 dist-test-slave-6nmv krb5kdc[9034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091988, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.208.194@KRBTEST.COM; defaulting to no policy
I20260807 08:39:48.867806 9125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:48.854629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:51641 (local address 127.8.208.254:45727)
0807 08:39:48.854793 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:48.854799 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:48.855813 (+ 1014us) server_negotiation.cc:407] Connection header received
0807 08:39:48.857875 (+ 2062us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:48.857880 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:48.857950 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:48.858027 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:48.859491 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:48.860104 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:48.861264 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:48.861488 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:48.861589 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:48.864125 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:48.864129 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:48.864131 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:48.864155 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:48.865575 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:48.866190 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:48.866193 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:48.866195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:48.866295 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:48.866692 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:48.866696 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:48.866698 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:48.866878 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:48.866999 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:48.867459 (+ 460us) server_negotiation.cc:299] Negotiation successful
0807 08:39:48.867587 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.194@KRBTEST.COM" created.
I20260807 08:39:48.868544 9298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:48.855031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:45727 (local address 127.8.208.193:51641)
0807 08:39:48.855654 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:48.855709 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:48.857589 (+ 1880us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:48.858315 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:48.858324 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:48.858762 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:39:48.859371 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:48.859388 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:48.860215 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:48.860218 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:48.861157 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:48.861167 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:48.861626 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:48.861629 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:48.861792 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:48.862379 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:39:48.862393 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:39:48.863981 (+ 1588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:39:48.865710 (+ 1729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:48.865715 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:48.865739 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:48.866087 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:48.866402 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:48.866405 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:48.866407 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:48.866602 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:48.867010 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:39:48.867018 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:39:48.867236 (+ 218us) client_negotiation.cc:769] Sending connection context
0807 08:39:48.867422 (+ 186us) client_negotiation.cc:240] Negotiation successful
0807 08:39:48.867712 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":154,"threads_started":1}
I20260807 08:39:48.869670 9296 heartbeater.cc:347] Connected to a master server at 127.8.208.254:45727
I20260807 08:39:48.869946 9296 heartbeater.cc:464] Registering TS with master...
I20260807 08:39:48.870431 9296 heartbeater.cc:511] Master 127.8.208.254:45727 requested a full tablet report, sending...
I20260807 08:39:48.871920 9083 ts_manager.cc:194] Registered new tserver with Master: 5bca98fd8e7a41a19dcb93ff51fbe79b (127.8.208.193:39627)
I20260807 08:39:48.873456 9083 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.193@KRBTEST.COM'} at 127.8.208.193:51641
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
I20260807 08:39:48.882990 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:45727
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:44623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:39:48.985801 9303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:39:48.986068 9303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:39:48.986142 9303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:39:48.989785 9303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:39:48.989897 9303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:39:48.989985 9303 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:39:48.994822 9303 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:44623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:45727
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9303
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:39:48.995731 9303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:39:48.996701 9303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:39:49.006062 9311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:49.006068 9313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:49.006161 9310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:39:49.006264 9303 server_base.cc:1034] running on GCE node
I20260807 08:39:49.006639 9303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:39:49.007242 9303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:39:49.008409 9303 hybrid_clock.cc:648] HybridClock initialized: now 1786091989008405 us; error 59 us; skew 500 ppm
Aug 07 08:39:49 dist-test-slave-6nmv krb5kdc[9034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091989, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:39:49.011040 9303 init.cc:377] Logged in from keytab as kudu/127.8.208.194@KRBTEST.COM (short username kudu)
I20260807 08:39:49.011755 9303 webserver.cc:460] Webserver started at http://127.8.208.194:42605/ using document root <none> and password file <none>
I20260807 08:39:49.012234 9303 fs_manager.cc:359] Metadata directory not provided
I20260807 08:39:49.012316 9303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:39:49.012526 9303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:39:49.014457 9303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "c93201aee18346d19a45ca55a0881247"
format_stamp: "Formatted at 2026-08-07 08:39:49 on dist-test-slave-6nmv"
server_key: "ae00b01c161cbcbb111cec6736e724bc"
server_key_iv: "96acfb0bf5f83fa5c50d6e08184dc380"
server_key_version: "encryptionkey@0"
I20260807 08:39:49.014936 9303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "c93201aee18346d19a45ca55a0881247"
format_stamp: "Formatted at 2026-08-07 08:39:49 on dist-test-slave-6nmv"
server_key: "ae00b01c161cbcbb111cec6736e724bc"
server_key_iv: "96acfb0bf5f83fa5c50d6e08184dc380"
server_key_version: "encryptionkey@0"
I20260807 08:39:49.018247 9303 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 08:39:49.020480 9321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:49.021492 9303 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:39:49.021606 9303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "c93201aee18346d19a45ca55a0881247"
format_stamp: "Formatted at 2026-08-07 08:39:49 on dist-test-slave-6nmv"
server_key: "ae00b01c161cbcbb111cec6736e724bc"
server_key_iv: "96acfb0bf5f83fa5c50d6e08184dc380"
server_key_version: "encryptionkey@0"
I20260807 08:39:49.021703 9303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:39:49.035616 9303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:39:49.038050 9303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:39:49.038205 9303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:39:49.038671 9303 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:39:49.039351 9303 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:39:49.039400 9303 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:49.039465 9303 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:39:49.039497 9303 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:49.047318 9303 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:46049
I20260807 08:39:49.047343 9443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:46049 every 8 connection(s)
I20260807 08:39:49.048033 9303 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
Aug 07 08:39:49 dist-test-slave-6nmv krb5kdc[9034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091989, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:39:49.058223 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 9303
I20260807 08:39:49.058341 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:39:49.058616 9027 external_mini_cluster.cc:1428] Setting key 842a9a363c3696913b36c64d1ccd0e96
I20260807 08:39:49.060236 9125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:49.049618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:48139 (local address 127.8.208.254:45727)
0807 08:39:49.049780 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:49.049785 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:49.050558 (+ 773us) server_negotiation.cc:407] Connection header received
0807 08:39:49.051700 (+ 1142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:49.051703 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:49.051747 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:49.051809 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:49.052833 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:49.053338 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:49.054435 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:49.054629 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:49.054704 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:49.056718 (+ 2014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:49.056720 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:49.056722 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:49.056743 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:49.058233 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:49.058794 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:49.058796 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:49.058797 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:49.058865 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:49.059213 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:49.059215 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:49.059216 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:49.059366 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:49.059442 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:49.059986 (+ 544us) server_negotiation.cc:299] Negotiation successful
0807 08:39:49.060117 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 08:39:49.061128 9446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:49.050003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:45727 (local address 127.8.208.194:48139)
0807 08:39:49.050400 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:49.050441 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:49.051494 (+ 1053us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:49.051981 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:49.051986 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:49.052279 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:39:49.052686 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:49.052697 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:49.053438 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:49.053440 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:49.054341 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:49.054349 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:49.054755 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:49.054757 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:49.054875 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:49.055358 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:39:49.055371 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:39:49.056570 (+ 1199us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:39:49.058364 (+ 1794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:49.058371 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:49.058383 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:49.058705 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:49.058969 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:49.058971 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:49.058973 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:49.059108 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:49.059471 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:39:49.059476 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:39:49.059744 (+ 268us) client_negotiation.cc:769] Sending connection context
0807 08:39:49.059926 (+ 182us) client_negotiation.cc:240] Negotiation successful
0807 08:39:49.060221 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":109,"threads_started":1}
I20260807 08:39:49.062116 9444 heartbeater.cc:347] Connected to a master server at 127.8.208.254:45727
I20260807 08:39:49.062323 9444 heartbeater.cc:464] Registering TS with master...
I20260807 08:39:49.062817 9444 heartbeater.cc:511] Master 127.8.208.254:45727 requested a full tablet report, sending...
I20260807 08:39:49.063835 9083 ts_manager.cc:194] Registered new tserver with Master: c93201aee18346d19a45ca55a0881247 (127.8.208.194:46049)
I20260807 08:39:49.064354 9083 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.194@KRBTEST.COM'} at 127.8.208.194:48139
WARNING: no policy specified for kudu/127.8.208.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
I20260807 08:39:49.085340 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:45727
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:44623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:39:49.185460 9449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:39:49.185696 9449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:39:49.185771 9449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:39:49.189093 9449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:39:49.189167 9449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:39:49.189244 9449 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:39:49.193967 9449 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:44623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:45727
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9449
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:39:49.194766 9449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:39:49.195581 9449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 08:39:49.204180 9449 server_base.cc:1034] running on GCE node
W20260807 08:39:49.204149 9457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:49.204169 9458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:49.204150 9461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:39:49.204686 9449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:39:49.205221 9449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:39:49.206390 9449 hybrid_clock.cc:648] HybridClock initialized: now 1786091989206377 us; error 33 us; skew 500 ppm
Aug 07 08:39:49 dist-test-slave-6nmv krb5kdc[9034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091989, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:39:49.208882 9449 init.cc:377] Logged in from keytab as kudu/127.8.208.195@KRBTEST.COM (short username kudu)
I20260807 08:39:49.209707 9449 webserver.cc:460] Webserver started at http://127.8.208.195:45423/ using document root <none> and password file <none>
I20260807 08:39:49.210233 9449 fs_manager.cc:359] Metadata directory not provided
I20260807 08:39:49.210294 9449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:39:49.210517 9449 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:39:49.212422 9449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "ffedfd882ec0477fb6260e260eb4936a"
format_stamp: "Formatted at 2026-08-07 08:39:49 on dist-test-slave-6nmv"
server_key: "eb7d07d541eda12f4fb3a068b9f2b8db"
server_key_iv: "f1eb25e31239f6022d02e3c9e931aaa4"
server_key_version: "encryptionkey@0"
I20260807 08:39:49.212966 9449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "ffedfd882ec0477fb6260e260eb4936a"
format_stamp: "Formatted at 2026-08-07 08:39:49 on dist-test-slave-6nmv"
server_key: "eb7d07d541eda12f4fb3a068b9f2b8db"
server_key_iv: "f1eb25e31239f6022d02e3c9e931aaa4"
server_key_version: "encryptionkey@0"
I20260807 08:39:49.216265 9449 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260807 08:39:49.218514 9470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:49.219624 9449 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:39:49.219729 9449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "ffedfd882ec0477fb6260e260eb4936a"
format_stamp: "Formatted at 2026-08-07 08:39:49 on dist-test-slave-6nmv"
server_key: "eb7d07d541eda12f4fb3a068b9f2b8db"
server_key_iv: "f1eb25e31239f6022d02e3c9e931aaa4"
server_key_version: "encryptionkey@0"
I20260807 08:39:49.219820 9449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:39:49.279882 9449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:39:49.282503 9449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:39:49.282691 9449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:39:49.283339 9449 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:39:49.284233 9449 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:39:49.284301 9449 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:49.284390 9449 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:39:49.284435 9449 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:49.292616 9449 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:40111
I20260807 08:39:49.292660 9592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:40111 every 8 connection(s)
I20260807 08:39:49.293478 9449 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:39:49.301318 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 9449
I20260807 08:39:49.301462 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:39:49.301721 9027 external_mini_cluster.cc:1428] Setting key c1572dff6bc78b0565998a4293d892f1
Aug 07 08:39:49 dist-test-slave-6nmv krb5kdc[9034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091989, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:39:49.306311 9125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:49.295286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:40075 (local address 127.8.208.254:45727)
0807 08:39:49.295426 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:49.295430 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:49.296147 (+ 717us) server_negotiation.cc:407] Connection header received
0807 08:39:49.297390 (+ 1243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:49.297393 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:49.297455 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:49.297529 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:49.298567 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:49.299119 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:49.300118 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:49.300330 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:49.300445 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:49.302726 (+ 2281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:49.302729 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:49.302731 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:49.302779 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:49.304345 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:49.304848 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:49.304851 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:49.304853 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:49.304935 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:49.305261 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:49.305265 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:49.305266 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:49.305439 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:49.305540 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:49.306058 (+ 518us) server_negotiation.cc:299] Negotiation successful
0807 08:39:49.306163 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 08:39:49.307184 9595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:49.295582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:45727 (local address 127.8.208.195:40075)
0807 08:39:49.295997 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:49.296035 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:49.297195 (+ 1160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:49.297694 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:49.297700 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:49.298026 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:39:49.298426 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:49.298438 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:49.299238 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:49.299241 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:49.299997 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:49.300005 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:49.300479 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:49.300482 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:49.300630 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:49.301049 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:39:49.301062 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:39:49.302557 (+ 1495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:39:49.304467 (+ 1910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:49.304472 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:49.304485 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:49.304738 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:49.305018 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:49.305021 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:49.305023 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:49.305169 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:49.305537 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:39:49.305542 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:39:49.305758 (+ 216us) client_negotiation.cc:769] Sending connection context
0807 08:39:49.305987 (+ 229us) client_negotiation.cc:240] Negotiation successful
0807 08:39:49.306262 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":99,"threads_started":1}
I20260807 08:39:49.308296 9593 heartbeater.cc:347] Connected to a master server at 127.8.208.254:45727
I20260807 08:39:49.308526 9593 heartbeater.cc:464] Registering TS with master...
I20260807 08:39:49.308964 9593 heartbeater.cc:511] Master 127.8.208.254:45727 requested a full tablet report, sending...
I20260807 08:39:49.309932 9083 ts_manager.cc:194] Registered new tserver with Master: ffedfd882ec0477fb6260e260eb4936a (127.8.208.195:40111)
I20260807 08:39:49.310442 9083 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.195@KRBTEST.COM'} at 127.8.208.195:40075
I20260807 08:39:49.315702 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 08:39:49 dist-test-slave-6nmv krb5kdc[9034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091989, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 08:39:49 dist-test-slave-6nmv krb5kdc[9034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091989, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.208.193@KRBTEST.COM
I20260807 08:39:49.340070 9601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:49.331869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38842 (local address 127.8.208.193:39627)
0807 08:39:49.332229 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:49.332241 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:49.332262 (+ 21us) server_negotiation.cc:407] Connection header received
0807 08:39:49.332319 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:49.332323 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:49.332473 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:49.332574 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:49.333205 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:49.334048 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:49.334793 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:49.335125 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:49.335204 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:49.337158 (+ 1954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:49.337166 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:49.337174 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:49.337195 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:49.338719 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:49.339053 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:49.339057 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:49.339058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:49.339127 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:49.339321 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:49.339322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:49.339323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:49.339505 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:49.339653 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:49.339760 (+ 107us) server_negotiation.cc:299] Negotiation successful
0807 08:39:49.339894 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":122,"threads_started":1}
W20260807 08:39:49.340863 9201 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38842
Aug 07 08:39:49 dist-test-slave-6nmv krb5kdc[9034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 08:39:49 dist-test-slave-6nmv krb5kdc[9034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.193@KRBTEST.COM
I20260807 08:39:49.363438 9601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:49.355770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38852 (local address 127.8.208.193:39627)
0807 08:39:49.355919 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:49.355939 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:49.356071 (+ 132us) server_negotiation.cc:407] Connection header received
0807 08:39:49.356213 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:49.356216 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:49.356260 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:49.356337 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:49.356946 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:49.357380 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:49.358203 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:49.358408 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:49.358508 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:49.360675 (+ 2167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:49.360679 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:49.360681 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:49.360703 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:49.362118 (+ 1415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:49.362462 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:49.362464 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:49.362466 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:49.362537 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:49.362794 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:49.362796 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:49.362798 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:49.362974 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:49.363095 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:49.363238 (+ 143us) server_negotiation.cc:299] Negotiation successful
0807 08:39:49.363328 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 08:39:49.364461 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 9152
I20260807 08:39:49.371735 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 9303
I20260807 08:39:49.379189 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 9449
I20260807 08:39:49.385550 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 9048
2026-08-07T08:39:49Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2111 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:39:49 dist-test-slave-6nmv krb5kdc[9613](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:39:49 dist-test-slave-6nmv krb5kdc[9613](info): set up 2 sockets
Aug 07 08:39:49 dist-test-slave-6nmv krb5kdc[9613](info): commencing operation
krb5kdc: starting...
W20260807 08:39:50.388015 9027 mini_kdc.cc:121] Time spent starting KDC: real 0.980s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:39:50 dist-test-slave-6nmv krb5kdc[9613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091990, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:39:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:39:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:39:50.496660 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:37269
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:44073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:37269
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:39:50.599269 9628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:39:50.599540 9628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:39:50.599606 9628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:39:50.605692 9628 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:39:50.605798 9628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:39:50.605871 9628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:39:50.605921 9628 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:39:50.605963 9628 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:39:50.612651 9628 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:44073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:37269
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:37269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9628
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:39:50.614125 9628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:39:50.615053 9628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:39:50.623008 9634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:50.623064 9633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:50.622996 9636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:39:50.623044 9628 server_base.cc:1034] running on GCE node
I20260807 08:39:50.623744 9628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:39:50.624735 9628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:39:50.625885 9628 hybrid_clock.cc:648] HybridClock initialized: now 1786091990625854 us; error 39 us; skew 500 ppm
Aug 07 08:39:50 dist-test-slave-6nmv krb5kdc[9613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091990, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:39:50.628325 9628 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:39:50.629019 9628 webserver.cc:460] Webserver started at http://127.8.208.254:36311/ using document root <none> and password file <none>
I20260807 08:39:50.629462 9628 fs_manager.cc:359] Metadata directory not provided
I20260807 08:39:50.629515 9628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:39:50.629654 9628 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:39:50.631480 9628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "3a75b12d218d49d38bfd22ef42f8ea77"
format_stamp: "Formatted at 2026-08-07 08:39:50 on dist-test-slave-6nmv"
server_key: "f7cd9a1696b480fa7337cc7aa4bf14b5"
server_key_iv: "c9a50a61222f6f1329c65ed44e05785e"
server_key_version: "encryptionkey@0"
I20260807 08:39:50.631994 9628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "3a75b12d218d49d38bfd22ef42f8ea77"
format_stamp: "Formatted at 2026-08-07 08:39:50 on dist-test-slave-6nmv"
server_key: "f7cd9a1696b480fa7337cc7aa4bf14b5"
server_key_iv: "c9a50a61222f6f1329c65ed44e05785e"
server_key_version: "encryptionkey@0"
I20260807 08:39:50.635448 9628 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260807 08:39:50.637506 9643 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:50.638597 9628 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 08:39:50.638685 9628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "3a75b12d218d49d38bfd22ef42f8ea77"
format_stamp: "Formatted at 2026-08-07 08:39:50 on dist-test-slave-6nmv"
server_key: "f7cd9a1696b480fa7337cc7aa4bf14b5"
server_key_iv: "c9a50a61222f6f1329c65ed44e05785e"
server_key_version: "encryptionkey@0"
I20260807 08:39:50.638759 9628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:39:50.667431 9628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:39:50.669917 9628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:39:50.670089 9628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:39:50.676635 9628 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:37269
I20260807 08:39:50.676704 9699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:37269 every 8 connection(s)
I20260807 08:39:50.677533 9628 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:39:50.680284 9701 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:50.682301 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 9628
I20260807 08:39:50.682389 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:39:50.682647 9027 external_mini_cluster.cc:1428] Setting key dde7b03cbc9eaad0591de6508e953e9f
I20260807 08:39:50.685876 9701 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a75b12d218d49d38bfd22ef42f8ea77: Bootstrap starting.
I20260807 08:39:50.687906 9701 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a75b12d218d49d38bfd22ef42f8ea77: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:50.688584 9701 log.cc:824] T 00000000000000000000000000000000 P 3a75b12d218d49d38bfd22ef42f8ea77: Log is configured to *not* fsync() on all Append() calls
I20260807 08:39:50.690688 9701 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a75b12d218d49d38bfd22ef42f8ea77: No bootstrap required, opened a new log
Aug 07 08:39:50 dist-test-slave-6nmv krb5kdc[9613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091990, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:39:50.695039 9701 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a75b12d218d49d38bfd22ef42f8ea77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a75b12d218d49d38bfd22ef42f8ea77" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 37269 } }
I20260807 08:39:50.695276 9701 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a75b12d218d49d38bfd22ef42f8ea77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:50.695325 9701 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a75b12d218d49d38bfd22ef42f8ea77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a75b12d218d49d38bfd22ef42f8ea77, State: Initialized, Role: FOLLOWER
I20260807 08:39:50.695713 9701 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a75b12d218d49d38bfd22ef42f8ea77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a75b12d218d49d38bfd22ef42f8ea77" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 37269 } }
I20260807 08:39:50.695845 9701 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a75b12d218d49d38bfd22ef42f8ea77 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:39:50.695901 9701 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a75b12d218d49d38bfd22ef42f8ea77 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:39:50.695979 9701 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a75b12d218d49d38bfd22ef42f8ea77 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:50.696079 9704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:50.684001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48156 (local address 127.8.208.254:37269)
0807 08:39:50.684432 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:50.684446 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:50.684478 (+ 32us) server_negotiation.cc:407] Connection header received
0807 08:39:50.685069 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:50.685083 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:50.685367 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:50.685679 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:50.686461 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:50.687331 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:50.688174 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:50.688603 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:50.688755 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:50.691309 (+ 2554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:50.691314 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:50.691327 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:50.691353 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:50.693303 (+ 1950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:50.693718 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:50.693724 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:50.693730 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:50.693894 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:50.694184 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:50.694187 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:50.694188 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:50.694615 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:50.694804 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:50.695008 (+ 204us) server_negotiation.cc:299] Negotiation successful
0807 08:39:50.695269 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":134,"threads_started":1}
I20260807 08:39:50.696813 9701 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a75b12d218d49d38bfd22ef42f8ea77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a75b12d218d49d38bfd22ef42f8ea77" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 37269 } }
I20260807 08:39:50.697158 9701 leader_election.cc:302] T 00000000000000000000000000000000 P 3a75b12d218d49d38bfd22ef42f8ea77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a75b12d218d49d38bfd22ef42f8ea77; no voters:
I20260807 08:39:50.697499 9701 leader_election.cc:288] T 00000000000000000000000000000000 P 3a75b12d218d49d38bfd22ef42f8ea77 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:39:50.697602 9706 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a75b12d218d49d38bfd22ef42f8ea77 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:39:50.697829 9706 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a75b12d218d49d38bfd22ef42f8ea77 [term 1 LEADER]: Becoming Leader. State: Replica: 3a75b12d218d49d38bfd22ef42f8ea77, State: Running, Role: LEADER
I20260807 08:39:50.698179 9706 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a75b12d218d49d38bfd22ef42f8ea77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a75b12d218d49d38bfd22ef42f8ea77" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 37269 } }
I20260807 08:39:50.698686 9701 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a75b12d218d49d38bfd22ef42f8ea77 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:39:50.699909 9708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a75b12d218d49d38bfd22ef42f8ea77 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a75b12d218d49d38bfd22ef42f8ea77. Latest consensus state: current_term: 1 leader_uuid: "3a75b12d218d49d38bfd22ef42f8ea77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a75b12d218d49d38bfd22ef42f8ea77" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 37269 } } }
I20260807 08:39:50.699921 9707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a75b12d218d49d38bfd22ef42f8ea77 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a75b12d218d49d38bfd22ef42f8ea77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a75b12d218d49d38bfd22ef42f8ea77" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 37269 } } }
I20260807 08:39:50.700054 9708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a75b12d218d49d38bfd22ef42f8ea77 [sys.catalog]: This master's current role is: LEADER
I20260807 08:39:50.700063 9707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a75b12d218d49d38bfd22ef42f8ea77 [sys.catalog]: This master's current role is: LEADER
I20260807 08:39:50.700448 9715 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:39:50.703115 9715 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:39:50.708462 9715 catalog_manager.cc:1347] Generated new cluster ID: d02e478672444ed2a0554bdfc6912f6e
I20260807 08:39:50.708524 9715 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:39:50.726601 9715 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:39:50.727777 9715 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:39:50.734266 9715 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a75b12d218d49d38bfd22ef42f8ea77: Generated new TSK 0
I20260807 08:39:50.734895 9715 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.208.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
I20260807 08:39:50.762758 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:37269
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:44073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:39:50.868921 9728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:39:50.869127 9728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:39:50.869185 9728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:39:50.873060 9728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:39:50.873111 9728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:39:50.873202 9728 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:39:50.878072 9728 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:44073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:37269
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9728
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:39:50.878975 9728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:39:50.879894 9728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:39:50.888810 9733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:50.888821 9736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:39:50.889003 9728 server_base.cc:1034] running on GCE node
W20260807 08:39:50.888849 9734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:39:50.889531 9728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:39:50.890108 9728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:39:50.891280 9728 hybrid_clock.cc:648] HybridClock initialized: now 1786091990891257 us; error 36 us; skew 500 ppm
Aug 07 08:39:50 dist-test-slave-6nmv krb5kdc[9613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091990, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:39:50.893895 9728 init.cc:377] Logged in from keytab as kudu/127.8.208.193@KRBTEST.COM (short username kudu)
I20260807 08:39:50.894642 9728 webserver.cc:460] Webserver started at http://127.8.208.193:46299/ using document root <none> and password file <none>
I20260807 08:39:50.895109 9728 fs_manager.cc:359] Metadata directory not provided
I20260807 08:39:50.895164 9728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:39:50.895318 9728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:39:50.896998 9728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "11bfb1e4801d4a8f849854a0d4fd8cd6"
format_stamp: "Formatted at 2026-08-07 08:39:50 on dist-test-slave-6nmv"
server_key: "d74b1bfc7d664c18076d7ae0484b263e"
server_key_iv: "aad5f0db25fe8677d4e1bee6217d2a72"
server_key_version: "encryptionkey@0"
I20260807 08:39:50.897439 9728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "11bfb1e4801d4a8f849854a0d4fd8cd6"
format_stamp: "Formatted at 2026-08-07 08:39:50 on dist-test-slave-6nmv"
server_key: "d74b1bfc7d664c18076d7ae0484b263e"
server_key_iv: "aad5f0db25fe8677d4e1bee6217d2a72"
server_key_version: "encryptionkey@0"
I20260807 08:39:50.901012 9728 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 08:39:50.903347 9743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:50.904500 9728 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260807 08:39:50.904595 9728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "11bfb1e4801d4a8f849854a0d4fd8cd6"
format_stamp: "Formatted at 2026-08-07 08:39:50 on dist-test-slave-6nmv"
server_key: "d74b1bfc7d664c18076d7ae0484b263e"
server_key_iv: "aad5f0db25fe8677d4e1bee6217d2a72"
server_key_version: "encryptionkey@0"
I20260807 08:39:50.904670 9728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:39:50.916074 9728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:39:50.919348 9728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:39:50.919488 9728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:39:50.919981 9728 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:39:50.920691 9728 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:39:50.920743 9728 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:50.920780 9728 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:39:50.920800 9728 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:50.929443 9728 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:45769
I20260807 08:39:50.929474 9871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:45769 every 8 connection(s)
I20260807 08:39:50.930321 9728 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:39:50.938318 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 9728
I20260807 08:39:50.938454 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
I20260807 08:39:50.938714 9027 external_mini_cluster.cc:1428] Setting key fd6131d6574c66322d4750ca62610c14
Aug 07 08:39:50 dist-test-slave-6nmv krb5kdc[9613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091990, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:39:50.943312 9704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:50.932055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:52999 (local address 127.8.208.254:37269)
0807 08:39:50.932215 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:50.932220 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:50.932998 (+ 778us) server_negotiation.cc:407] Connection header received
0807 08:39:50.934324 (+ 1326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:50.934327 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:50.934375 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:50.934448 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:50.935484 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:50.935988 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:50.936954 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:50.937155 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:50.937223 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:50.939560 (+ 2337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:50.939563 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:50.939565 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:50.939587 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:50.941112 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:50.941684 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:50.941689 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:50.941691 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:50.941775 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:50.942183 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:50.942187 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:50.942188 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:50.942413 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:50.942520 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:50.943020 (+ 500us) server_negotiation.cc:299] Negotiation successful
0807 08:39:50.943145 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 08:39:50.944078 9874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:50.932438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:37269 (local address 127.8.208.193:52999)
0807 08:39:50.932852 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:50.932893 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:50.934137 (+ 1244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:50.934618 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:50.934625 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:50.934940 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:39:50.935363 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:50.935375 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:50.936084 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:50.936086 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:50.936851 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:50.936859 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:50.937269 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:50.937271 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:50.937393 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:50.937929 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:39:50.937943 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:39:50.939411 (+ 1468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:39:50.941236 (+ 1825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:50.941241 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:50.941253 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:50.941586 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:50.941905 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:50.941908 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:50.941910 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:50.942073 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:50.942523 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:39:50.942531 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:39:50.942768 (+ 237us) client_negotiation.cc:769] Sending connection context
0807 08:39:50.942967 (+ 199us) client_negotiation.cc:240] Negotiation successful
0807 08:39:50.943265 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":110,"threads_started":1}
I20260807 08:39:50.945212 9872 heartbeater.cc:347] Connected to a master server at 127.8.208.254:37269
I20260807 08:39:50.945441 9872 heartbeater.cc:464] Registering TS with master...
I20260807 08:39:50.945953 9872 heartbeater.cc:511] Master 127.8.208.254:37269 requested a full tablet report, sending...
I20260807 08:39:50.947537 9660 ts_manager.cc:194] Registered new tserver with Master: 11bfb1e4801d4a8f849854a0d4fd8cd6 (127.8.208.193:45769)
WARNING: no policy specified for kudu/127.8.208.194@KRBTEST.COM; defaulting to no policy
I20260807 08:39:50.948982 9660 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.193@KRBTEST.COM'} at 127.8.208.193:52999
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
I20260807 08:39:50.964517 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:37269
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:44073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:39:51.070437 9877 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:39:51.070652 9877 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:39:51.070690 9877 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:39:51.074527 9877 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:39:51.074577 9877 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:39:51.074633 9877 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:39:51.079377 9877 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:44073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:37269
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9877
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:39:51.080201 9877 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:39:51.081058 9877 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:39:51.089730 9883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:51.089738 9885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:51.089745 9882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:39:51.089835 9877 server_base.cc:1034] running on GCE node
I20260807 08:39:51.090396 9877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:39:51.090883 9877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:39:51.092064 9877 hybrid_clock.cc:648] HybridClock initialized: now 1786091991092053 us; error 23 us; skew 500 ppm
Aug 07 08:39:51 dist-test-slave-6nmv krb5kdc[9613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091991, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:39:51.094753 9877 init.cc:377] Logged in from keytab as kudu/127.8.208.194@KRBTEST.COM (short username kudu)
I20260807 08:39:51.095544 9877 webserver.cc:460] Webserver started at http://127.8.208.194:45997/ using document root <none> and password file <none>
I20260807 08:39:51.096081 9877 fs_manager.cc:359] Metadata directory not provided
I20260807 08:39:51.096170 9877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:39:51.096387 9877 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:39:51.098351 9877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "fa7ccdc7e1524e6ba45e849d58c7c60f"
format_stamp: "Formatted at 2026-08-07 08:39:51 on dist-test-slave-6nmv"
server_key: "443aa14d2e6633c1312e781c57eb8e28"
server_key_iv: "3db151d57f3bc131df13e3ad73b563a4"
server_key_version: "encryptionkey@0"
I20260807 08:39:51.098918 9877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "fa7ccdc7e1524e6ba45e849d58c7c60f"
format_stamp: "Formatted at 2026-08-07 08:39:51 on dist-test-slave-6nmv"
server_key: "443aa14d2e6633c1312e781c57eb8e28"
server_key_iv: "3db151d57f3bc131df13e3ad73b563a4"
server_key_version: "encryptionkey@0"
I20260807 08:39:51.102509 9877 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 08:39:51.104737 9893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:51.105894 9877 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:39:51.106012 9877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "fa7ccdc7e1524e6ba45e849d58c7c60f"
format_stamp: "Formatted at 2026-08-07 08:39:51 on dist-test-slave-6nmv"
server_key: "443aa14d2e6633c1312e781c57eb8e28"
server_key_iv: "3db151d57f3bc131df13e3ad73b563a4"
server_key_version: "encryptionkey@0"
I20260807 08:39:51.106112 9877 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:39:51.129767 9877 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:39:51.132664 9877 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:39:51.132810 9877 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:39:51.133309 9877 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:39:51.134078 9877 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:39:51.134132 9877 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:51.134166 9877 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:39:51.134181 9877 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:51.142503 9877 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:39925
I20260807 08:39:51.142621 10017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:39925 every 8 connection(s)
I20260807 08:39:51.143350 9877 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:39:51.150277 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 9877
I20260807 08:39:51.150447 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:39:51.150745 9027 external_mini_cluster.cc:1428] Setting key 6e108b67044c19eb1b0452367dc1a402
Aug 07 08:39:51 dist-test-slave-6nmv krb5kdc[9613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091991, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:39:51.156644 9704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:51.145038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:40737 (local address 127.8.208.254:37269)
0807 08:39:51.145156 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:51.145159 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:51.146025 (+ 866us) server_negotiation.cc:407] Connection header received
0807 08:39:51.146792 (+ 767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:51.146794 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:51.146856 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:51.146929 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:51.148123 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.148587 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.149552 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.149728 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.149794 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:51.152656 (+ 2862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:51.152661 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:51.152666 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:51.152694 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:51.154424 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:51.155118 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:51.155121 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:51.155122 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:51.155201 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:51.155606 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:51.155608 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:51.155609 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:51.155769 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:51.155842 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:51.156423 (+ 581us) server_negotiation.cc:299] Negotiation successful
0807 08:39:51.156519 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 08:39:51.157758 10021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:51.145280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:37269 (local address 127.8.208.194:40737)
0807 08:39:51.145894 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:51.145932 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:51.146626 (+ 694us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:51.147193 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:51.147199 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:51.147557 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:39:51.147991 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:51.148010 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.148686 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.148689 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:51.149456 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:51.149464 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.149927 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.149931 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:51.150085 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:51.150709 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:39:51.150725 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:39:51.152497 (+ 1772us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:39:51.154555 (+ 2058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:51.154562 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:51.154576 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:51.155007 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:51.155297 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:51.155301 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:51.155305 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:51.155504 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:51.155872 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:39:51.155880 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:39:51.156180 (+ 300us) client_negotiation.cc:769] Sending connection context
0807 08:39:51.156390 (+ 210us) client_negotiation.cc:240] Negotiation successful
0807 08:39:51.156718 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":98,"threads_started":1}
I20260807 08:39:51.158895 10019 heartbeater.cc:347] Connected to a master server at 127.8.208.254:37269
I20260807 08:39:51.159130 10019 heartbeater.cc:464] Registering TS with master...
I20260807 08:39:51.159658 10019 heartbeater.cc:511] Master 127.8.208.254:37269 requested a full tablet report, sending...
I20260807 08:39:51.160671 9660 ts_manager.cc:194] Registered new tserver with Master: fa7ccdc7e1524e6ba45e849d58c7c60f (127.8.208.194:39925)
I20260807 08:39:51.161209 9660 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.194@KRBTEST.COM'} at 127.8.208.194:40737
WARNING: no policy specified for kudu/127.8.208.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
I20260807 08:39:51.178741 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:37269
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:44073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:39:51.279148 10024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:39:51.279377 10024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:39:51.279464 10024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:39:51.283032 10024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:39:51.283107 10024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:39:51.283195 10024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:39:51.287786 10024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:44073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:37269
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:39:51.288631 10024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:39:51.289444 10024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:39:51.297891 10032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:51.297911 10030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:51.297972 10029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:39:51.298071 10024 server_base.cc:1034] running on GCE node
I20260807 08:39:51.298487 10024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:39:51.298996 10024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:39:51.300197 10024 hybrid_clock.cc:648] HybridClock initialized: now 1786091991300186 us; error 30 us; skew 500 ppm
Aug 07 08:39:51 dist-test-slave-6nmv krb5kdc[9613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091991, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:39:51.302531 10024 init.cc:377] Logged in from keytab as kudu/127.8.208.195@KRBTEST.COM (short username kudu)
I20260807 08:39:51.303315 10024 webserver.cc:460] Webserver started at http://127.8.208.195:40133/ using document root <none> and password file <none>
I20260807 08:39:51.303815 10024 fs_manager.cc:359] Metadata directory not provided
I20260807 08:39:51.303910 10024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:39:51.304126 10024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:39:51.305850 10024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "806cafca6a16420dbbe49e68a2d4eb8c"
format_stamp: "Formatted at 2026-08-07 08:39:51 on dist-test-slave-6nmv"
server_key: "6594d3ccebfcc9f925f1279cec78d568"
server_key_iv: "e592830db4f0329251240f94d1d3dce4"
server_key_version: "encryptionkey@0"
I20260807 08:39:51.306394 10024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "806cafca6a16420dbbe49e68a2d4eb8c"
format_stamp: "Formatted at 2026-08-07 08:39:51 on dist-test-slave-6nmv"
server_key: "6594d3ccebfcc9f925f1279cec78d568"
server_key_iv: "e592830db4f0329251240f94d1d3dce4"
server_key_version: "encryptionkey@0"
I20260807 08:39:51.309739 10024 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 08:39:51.311756 10039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:51.312861 10024 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:39:51.313002 10024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "806cafca6a16420dbbe49e68a2d4eb8c"
format_stamp: "Formatted at 2026-08-07 08:39:51 on dist-test-slave-6nmv"
server_key: "6594d3ccebfcc9f925f1279cec78d568"
server_key_iv: "e592830db4f0329251240f94d1d3dce4"
server_key_version: "encryptionkey@0"
I20260807 08:39:51.313103 10024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:39:51.333498 10024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:39:51.336056 10024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:39:51.336227 10024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:39:51.336818 10024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:39:51.337509 10024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:39:51.337574 10024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:51.337641 10024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:39:51.337667 10024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:51.346345 10024 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:46673
I20260807 08:39:51.346413 10162 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:46673 every 8 connection(s)
I20260807 08:39:51.347154 10024 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:39:51.353962 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 10024
I20260807 08:39:51.354091 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:39:51.354353 9027 external_mini_cluster.cc:1428] Setting key 4fbef9e6c1d6e3d30fdb0db6c652ff42
Aug 07 08:39:51 dist-test-slave-6nmv krb5kdc[9613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091991, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:39:51.358955 9704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:51.348732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:46111 (local address 127.8.208.254:37269)
0807 08:39:51.348852 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:51.348856 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:51.349474 (+ 618us) server_negotiation.cc:407] Connection header received
0807 08:39:51.350313 (+ 839us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:51.350316 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:51.350374 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:51.350465 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:51.351445 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.352000 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.353075 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.353311 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.353421 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:51.355955 (+ 2534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:51.355958 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:51.355960 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:51.355985 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:51.357284 (+ 1299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:51.357709 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:51.357711 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:51.357712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:51.357775 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:51.358141 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:51.358143 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:51.358144 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:51.358285 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:51.358353 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:51.358758 (+ 405us) server_negotiation.cc:299] Negotiation successful
0807 08:39:51.358838 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 08:39:51.359656 10165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:51.348961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:37269 (local address 127.8.208.195:46111)
0807 08:39:51.349328 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:51.349363 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:51.350129 (+ 766us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:51.350613 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:51.350619 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:51.350917 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:39:51.351308 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:51.351320 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.352125 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.352133 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:51.352929 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:51.352955 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.353473 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.353478 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:51.353629 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:51.354242 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:39:51.354256 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:39:51.355799 (+ 1543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:39:51.357384 (+ 1585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:51.357389 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:51.357397 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:51.357623 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:51.357926 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:51.357928 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:51.357929 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:51.358059 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:51.358387 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:39:51.358391 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:39:51.358574 (+ 183us) client_negotiation.cc:769] Sending connection context
0807 08:39:51.358718 (+ 144us) client_negotiation.cc:240] Negotiation successful
0807 08:39:51.358942 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":93,"threads_started":1}
I20260807 08:39:51.360694 10163 heartbeater.cc:347] Connected to a master server at 127.8.208.254:37269
I20260807 08:39:51.360909 10163 heartbeater.cc:464] Registering TS with master...
I20260807 08:39:51.361294 10163 heartbeater.cc:511] Master 127.8.208.254:37269 requested a full tablet report, sending...
I20260807 08:39:51.362308 9660 ts_manager.cc:194] Registered new tserver with Master: 806cafca6a16420dbbe49e68a2d4eb8c (127.8.208.195:46673)
I20260807 08:39:51.362897 9660 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.195@KRBTEST.COM'} at 127.8.208.195:46111
I20260807 08:39:51.368381 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 08:39:51.377910 9704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:51.371352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48172 (local address 127.8.208.254:37269)
0807 08:39:51.371512 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:51.371514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:51.371622 (+ 108us) server_negotiation.cc:407] Connection header received
0807 08:39:51.371711 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:51.371713 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:51.371746 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:51.371806 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:51.372413 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.372875 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.373621 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.373862 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.373941 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:51.375071 (+ 1130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:51.375073 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:51.375075 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:51.375094 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:51.376448 (+ 1354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:51.376813 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:51.376815 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:51.376816 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:51.376884 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:51.377104 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:51.377106 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:51.377107 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:51.377283 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:51.377409 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:51.377613 (+ 204us) server_negotiation.cc:299] Negotiation successful
0807 08:39:51.377690 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260807 08:39:51.381624 9660 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48172:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 08:39:51.384400 9660 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:39:51.397611 10178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:51.392580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48556 (local address 127.8.208.193:45769)
0807 08:39:51.393167 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:51.393180 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:51.393201 (+ 21us) server_negotiation.cc:407] Connection header received
0807 08:39:51.393275 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:51.393283 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:51.393485 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:51.393715 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:39:51.393923 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.394996 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.396264 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.396971 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.397177 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:51.397290 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:51.397382 (+ 92us) server_negotiation.cc:299] Negotiation successful
0807 08:39:51.397447 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":479,"thread_start_us":95,"threads_started":1}
I20260807 08:39:51.397614 10177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:51.392076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:45769 (local address 127.0.0.1:48556)
0807 08:39:51.392782 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:51.392795 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:51.392897 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:51.393710 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:51.393712 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:51.393731 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:39:51.393830 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:51.393837 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.395141 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.395144 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:51.396144 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:51.396152 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.397091 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.397094 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:51.397210 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:51.397242 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 08:39:51.397364 (+ 122us) client_negotiation.cc:240] Negotiation successful
0807 08:39:51.397476 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":654,"mutex_wait_us":15,"thread_start_us":107,"threads_started":1}
I20260807 08:39:51.397718 10175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:51.392495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:46673 (local address 127.0.0.1:51976)
0807 08:39:51.393110 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:51.393123 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:51.393212 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:51.393909 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:51.393912 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:51.393932 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:39:51.394018 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:51.394024 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.395363 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.395367 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:51.396329 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:51.396343 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.397078 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.397081 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:51.397420 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:51.397439 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 08:39:51.397507 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 08:39:51.397559 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":557,"mutex_wait_us":217,"thread_start_us":91,"threads_started":1}
I20260807 08:39:51.397863 10179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:51.392636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51976 (local address 127.8.208.195:46673)
0807 08:39:51.393431 (+ 795us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:51.393442 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:51.393461 (+ 19us) server_negotiation.cc:407] Connection header received
0807 08:39:51.393520 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:51.393525 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:51.393720 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:51.394206 (+ 486us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:39:51.394327 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.395251 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.396451 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.396937 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.397183 (+ 246us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:51.397325 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:51.397558 (+ 233us) server_negotiation.cc:299] Negotiation successful
0807 08:39:51.397677 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":709,"thread_start_us":138,"threads_started":1}
I20260807 08:39:51.398306 10174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:51.391870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:39925 (local address 127.0.0.1:34100)
0807 08:39:51.392382 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:51.392423 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:51.392555 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:51.393379 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:51.393398 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:51.393424 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:39:51.393540 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:51.393548 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.394819 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.394824 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:51.395992 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:51.396002 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.397055 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.397061 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:51.397978 (+ 917us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:51.398027 (+ 49us) client_negotiation.cc:769] Sending connection context
0807 08:39:51.398101 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 08:39:51.398168 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371,"mutex_wait_us":19,"thread_start_us":64,"threads_started":1}
I20260807 08:39:51.398370 10176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:51.392061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34100 (local address 127.8.208.194:39925)
0807 08:39:51.392856 (+ 795us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:51.392867 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:51.392890 (+ 23us) server_negotiation.cc:407] Connection header received
0807 08:39:51.393006 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:51.393013 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:51.393208 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:51.393717 (+ 509us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:39:51.393900 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.394674 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.396140 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.396917 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.397033 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:51.397180 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:51.398139 (+ 959us) server_negotiation.cc:299] Negotiation successful
0807 08:39:51.398236 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":693,"thread_start_us":125,"threads_started":1}
I20260807 08:39:51.400524 9799 tablet_service.cc:1467] Processing CreateTablet for tablet 7a75683deb154445a4a45938cf46f6d9 (DEFAULT_TABLE table=test-table [id=f6e3a2229f6e45c190511738a86acbbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:39:51.400583 10090 tablet_service.cc:1467] Processing CreateTablet for tablet 7a75683deb154445a4a45938cf46f6d9 (DEFAULT_TABLE table=test-table [id=f6e3a2229f6e45c190511738a86acbbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:39:51.400619 9947 tablet_service.cc:1467] Processing CreateTablet for tablet 7a75683deb154445a4a45938cf46f6d9 (DEFAULT_TABLE table=test-table [id=f6e3a2229f6e45c190511738a86acbbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:39:51.401459 9799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a75683deb154445a4a45938cf46f6d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:51.401556 10090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a75683deb154445a4a45938cf46f6d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:51.401556 9947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a75683deb154445a4a45938cf46f6d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:51.407771 10180 tablet_bootstrap.cc:492] T 7a75683deb154445a4a45938cf46f6d9 P 11bfb1e4801d4a8f849854a0d4fd8cd6: Bootstrap starting.
I20260807 08:39:51.408321 10181 tablet_bootstrap.cc:492] T 7a75683deb154445a4a45938cf46f6d9 P 806cafca6a16420dbbe49e68a2d4eb8c: Bootstrap starting.
I20260807 08:39:51.409032 10182 tablet_bootstrap.cc:492] T 7a75683deb154445a4a45938cf46f6d9 P fa7ccdc7e1524e6ba45e849d58c7c60f: Bootstrap starting.
I20260807 08:39:51.410245 10180 tablet_bootstrap.cc:654] T 7a75683deb154445a4a45938cf46f6d9 P 11bfb1e4801d4a8f849854a0d4fd8cd6: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:51.411474 10181 tablet_bootstrap.cc:654] T 7a75683deb154445a4a45938cf46f6d9 P 806cafca6a16420dbbe49e68a2d4eb8c: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:51.411470 10182 tablet_bootstrap.cc:654] T 7a75683deb154445a4a45938cf46f6d9 P fa7ccdc7e1524e6ba45e849d58c7c60f: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:51.411501 10180 log.cc:824] T 7a75683deb154445a4a45938cf46f6d9 P 11bfb1e4801d4a8f849854a0d4fd8cd6: Log is configured to *not* fsync() on all Append() calls
I20260807 08:39:51.412266 10181 log.cc:824] T 7a75683deb154445a4a45938cf46f6d9 P 806cafca6a16420dbbe49e68a2d4eb8c: Log is configured to *not* fsync() on all Append() calls
I20260807 08:39:51.412273 10182 log.cc:824] T 7a75683deb154445a4a45938cf46f6d9 P fa7ccdc7e1524e6ba45e849d58c7c60f: Log is configured to *not* fsync() on all Append() calls
I20260807 08:39:51.413633 10180 tablet_bootstrap.cc:492] T 7a75683deb154445a4a45938cf46f6d9 P 11bfb1e4801d4a8f849854a0d4fd8cd6: No bootstrap required, opened a new log
I20260807 08:39:51.413851 10180 ts_tablet_manager.cc:1397] T 7a75683deb154445a4a45938cf46f6d9 P 11bfb1e4801d4a8f849854a0d4fd8cd6: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260807 08:39:51.414152 10182 tablet_bootstrap.cc:492] T 7a75683deb154445a4a45938cf46f6d9 P fa7ccdc7e1524e6ba45e849d58c7c60f: No bootstrap required, opened a new log
I20260807 08:39:51.414270 10181 tablet_bootstrap.cc:492] T 7a75683deb154445a4a45938cf46f6d9 P 806cafca6a16420dbbe49e68a2d4eb8c: No bootstrap required, opened a new log
I20260807 08:39:51.414322 10182 ts_tablet_manager.cc:1397] T 7a75683deb154445a4a45938cf46f6d9 P fa7ccdc7e1524e6ba45e849d58c7c60f: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.004s
I20260807 08:39:51.414461 10181 ts_tablet_manager.cc:1397] T 7a75683deb154445a4a45938cf46f6d9 P 806cafca6a16420dbbe49e68a2d4eb8c: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 08:39:51.417526 10181 raft_consensus.cc:348] T 7a75683deb154445a4a45938cf46f6d9 P 806cafca6a16420dbbe49e68a2d4eb8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa7ccdc7e1524e6ba45e849d58c7c60f" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39925 } } peers { permanent_uuid: "11bfb1e4801d4a8f849854a0d4fd8cd6" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45769 } } peers { permanent_uuid: "806cafca6a16420dbbe49e68a2d4eb8c" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 46673 } }
I20260807 08:39:51.417721 10181 raft_consensus.cc:374] T 7a75683deb154445a4a45938cf46f6d9 P 806cafca6a16420dbbe49e68a2d4eb8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:51.417754 10181 raft_consensus.cc:729] T 7a75683deb154445a4a45938cf46f6d9 P 806cafca6a16420dbbe49e68a2d4eb8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 806cafca6a16420dbbe49e68a2d4eb8c, State: Initialized, Role: FOLLOWER
I20260807 08:39:51.417641 10180 raft_consensus.cc:348] T 7a75683deb154445a4a45938cf46f6d9 P 11bfb1e4801d4a8f849854a0d4fd8cd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa7ccdc7e1524e6ba45e849d58c7c60f" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39925 } } peers { permanent_uuid: "11bfb1e4801d4a8f849854a0d4fd8cd6" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45769 } } peers { permanent_uuid: "806cafca6a16420dbbe49e68a2d4eb8c" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 46673 } }
I20260807 08:39:51.417893 10180 raft_consensus.cc:374] T 7a75683deb154445a4a45938cf46f6d9 P 11bfb1e4801d4a8f849854a0d4fd8cd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:51.417948 10180 raft_consensus.cc:729] T 7a75683deb154445a4a45938cf46f6d9 P 11bfb1e4801d4a8f849854a0d4fd8cd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11bfb1e4801d4a8f849854a0d4fd8cd6, State: Initialized, Role: FOLLOWER
I20260807 08:39:51.417959 10182 raft_consensus.cc:348] T 7a75683deb154445a4a45938cf46f6d9 P fa7ccdc7e1524e6ba45e849d58c7c60f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa7ccdc7e1524e6ba45e849d58c7c60f" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39925 } } peers { permanent_uuid: "11bfb1e4801d4a8f849854a0d4fd8cd6" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45769 } } peers { permanent_uuid: "806cafca6a16420dbbe49e68a2d4eb8c" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 46673 } }
I20260807 08:39:51.418181 10182 raft_consensus.cc:374] T 7a75683deb154445a4a45938cf46f6d9 P fa7ccdc7e1524e6ba45e849d58c7c60f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:51.418247 10182 raft_consensus.cc:729] T 7a75683deb154445a4a45938cf46f6d9 P fa7ccdc7e1524e6ba45e849d58c7c60f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa7ccdc7e1524e6ba45e849d58c7c60f, State: Initialized, Role: FOLLOWER
I20260807 08:39:51.418267 10181 consensus_queue.cc:260] T 7a75683deb154445a4a45938cf46f6d9 P 806cafca6a16420dbbe49e68a2d4eb8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa7ccdc7e1524e6ba45e849d58c7c60f" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39925 } } peers { permanent_uuid: "11bfb1e4801d4a8f849854a0d4fd8cd6" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45769 } } peers { permanent_uuid: "806cafca6a16420dbbe49e68a2d4eb8c" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 46673 } }
I20260807 08:39:51.418354 10180 consensus_queue.cc:260] T 7a75683deb154445a4a45938cf46f6d9 P 11bfb1e4801d4a8f849854a0d4fd8cd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa7ccdc7e1524e6ba45e849d58c7c60f" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39925 } } peers { permanent_uuid: "11bfb1e4801d4a8f849854a0d4fd8cd6" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45769 } } peers { permanent_uuid: "806cafca6a16420dbbe49e68a2d4eb8c" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 46673 } }
I20260807 08:39:51.418581 10182 consensus_queue.cc:260] T 7a75683deb154445a4a45938cf46f6d9 P fa7ccdc7e1524e6ba45e849d58c7c60f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa7ccdc7e1524e6ba45e849d58c7c60f" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39925 } } peers { permanent_uuid: "11bfb1e4801d4a8f849854a0d4fd8cd6" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45769 } } peers { permanent_uuid: "806cafca6a16420dbbe49e68a2d4eb8c" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 46673 } }
I20260807 08:39:51.418851 10163 heartbeater.cc:503] Master 127.8.208.254:37269 was elected leader, sending a full tablet report...
I20260807 08:39:51.419196 10181 ts_tablet_manager.cc:1428] T 7a75683deb154445a4a45938cf46f6d9 P 806cafca6a16420dbbe49e68a2d4eb8c: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 08:39:51.419214 10180 ts_tablet_manager.cc:1428] T 7a75683deb154445a4a45938cf46f6d9 P 11bfb1e4801d4a8f849854a0d4fd8cd6: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 08:39:51.419317 10182 ts_tablet_manager.cc:1428] T 7a75683deb154445a4a45938cf46f6d9 P fa7ccdc7e1524e6ba45e849d58c7c60f: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260807 08:39:51.419513 9872 heartbeater.cc:503] Master 127.8.208.254:37269 was elected leader, sending a full tablet report...
I20260807 08:39:51.420327 10019 heartbeater.cc:503] Master 127.8.208.254:37269 was elected leader, sending a full tablet report...
W20260807 08:39:51.431366 9873 tablet.cc:2369] T 7a75683deb154445a4a45938cf46f6d9 P 11bfb1e4801d4a8f849854a0d4fd8cd6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 08:39:51.501013 10187 raft_consensus.cc:482] T 7a75683deb154445a4a45938cf46f6d9 P 11bfb1e4801d4a8f849854a0d4fd8cd6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:39:51.501197 10187 raft_consensus.cc:504] T 7a75683deb154445a4a45938cf46f6d9 P 11bfb1e4801d4a8f849854a0d4fd8cd6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa7ccdc7e1524e6ba45e849d58c7c60f" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39925 } } peers { permanent_uuid: "11bfb1e4801d4a8f849854a0d4fd8cd6" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45769 } } peers { permanent_uuid: "806cafca6a16420dbbe49e68a2d4eb8c" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 46673 } }
I20260807 08:39:51.502413 10187 leader_election.cc:288] T 7a75683deb154445a4a45938cf46f6d9 P 11bfb1e4801d4a8f849854a0d4fd8cd6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa7ccdc7e1524e6ba45e849d58c7c60f (127.8.208.194:39925), 806cafca6a16420dbbe49e68a2d4eb8c (127.8.208.195:46673)
I20260807 08:39:51.507809 10176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:51.502729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:53579 (local address 127.8.208.194:39925)
0807 08:39:51.502853 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:51.502859 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:51.503077 (+ 218us) server_negotiation.cc:407] Connection header received
0807 08:39:51.503222 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:51.503225 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:51.503279 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:51.503367 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:39:51.503744 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.504525 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.506458 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.507073 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.507190 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:51.507239 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:51.507598 (+ 359us) server_negotiation.cc:299] Negotiation successful
0807 08:39:51.507673 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 08:39:51.507808 10179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:51.502804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:51757 (local address 127.8.208.195:46673)
0807 08:39:51.502946 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:51.502951 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:51.503147 (+ 196us) server_negotiation.cc:407] Connection header received
0807 08:39:51.503221 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:51.503224 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:51.503276 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:51.503367 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:39:51.503744 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.504532 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.506458 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.507073 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.507190 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:51.507239 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:51.507598 (+ 359us) server_negotiation.cc:299] Negotiation successful
0807 08:39:51.507673 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 08:39:51.507844 10189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:51.502679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:46673 (local address 127.8.208.193:51757)
0807 08:39:51.503055 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:51.503068 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:51.503145 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:51.503392 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:51.503395 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:51.503450 (+ 55us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:39:51.503627 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:51.503634 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.504655 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.504658 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:51.506330 (+ 1672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:51.506341 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.507191 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.507194 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:51.507365 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:51.507436 (+ 71us) client_negotiation.cc:769] Sending connection context
0807 08:39:51.507535 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 08:39:51.507655 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"mutex_wait_us":289,"spinlock_wait_cycles":50688,"thread_start_us":122,"threads_started":1}
I20260807 08:39:51.507848 10190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:51.502598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:39925 (local address 127.8.208.193:53579)
0807 08:39:51.502959 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:51.502973 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:51.503110 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:51.503392 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:51.503395 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:51.503449 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:39:51.503629 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:51.503634 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.504655 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.504658 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:51.506330 (+ 1672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:51.506341 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.507191 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.507194 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:51.507368 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:51.507443 (+ 75us) client_negotiation.cc:769] Sending connection context
0807 08:39:51.507535 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 08:39:51.507655 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"mutex_wait_us":343,"spinlock_wait_cycles":4352,"thread_start_us":94,"threads_started":1}
I20260807 08:39:51.508512 10113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a75683deb154445a4a45938cf46f6d9" candidate_uuid: "11bfb1e4801d4a8f849854a0d4fd8cd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "806cafca6a16420dbbe49e68a2d4eb8c" is_pre_election: true
I20260807 08:39:51.508744 9970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a75683deb154445a4a45938cf46f6d9" candidate_uuid: "11bfb1e4801d4a8f849854a0d4fd8cd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa7ccdc7e1524e6ba45e849d58c7c60f" is_pre_election: true
I20260807 08:39:51.508862 10113 raft_consensus.cc:2454] T 7a75683deb154445a4a45938cf46f6d9 P 806cafca6a16420dbbe49e68a2d4eb8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11bfb1e4801d4a8f849854a0d4fd8cd6 in term 0.
I20260807 08:39:51.509033 9970 raft_consensus.cc:2454] T 7a75683deb154445a4a45938cf46f6d9 P fa7ccdc7e1524e6ba45e849d58c7c60f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11bfb1e4801d4a8f849854a0d4fd8cd6 in term 0.
I20260807 08:39:51.509305 9744 leader_election.cc:302] T 7a75683deb154445a4a45938cf46f6d9 P 11bfb1e4801d4a8f849854a0d4fd8cd6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11bfb1e4801d4a8f849854a0d4fd8cd6, 806cafca6a16420dbbe49e68a2d4eb8c; no voters:
I20260807 08:39:51.509605 10187 raft_consensus.cc:2781] T 7a75683deb154445a4a45938cf46f6d9 P 11bfb1e4801d4a8f849854a0d4fd8cd6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:39:51.509703 10187 raft_consensus.cc:482] T 7a75683deb154445a4a45938cf46f6d9 P 11bfb1e4801d4a8f849854a0d4fd8cd6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:39:51.509745 10187 raft_consensus.cc:3037] T 7a75683deb154445a4a45938cf46f6d9 P 11bfb1e4801d4a8f849854a0d4fd8cd6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:51.510769 10187 raft_consensus.cc:504] T 7a75683deb154445a4a45938cf46f6d9 P 11bfb1e4801d4a8f849854a0d4fd8cd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa7ccdc7e1524e6ba45e849d58c7c60f" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39925 } } peers { permanent_uuid: "11bfb1e4801d4a8f849854a0d4fd8cd6" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45769 } } peers { permanent_uuid: "806cafca6a16420dbbe49e68a2d4eb8c" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 46673 } }
I20260807 08:39:51.511060 10187 leader_election.cc:288] T 7a75683deb154445a4a45938cf46f6d9 P 11bfb1e4801d4a8f849854a0d4fd8cd6 [CANDIDATE]: Term 1 election: Requested vote from peers fa7ccdc7e1524e6ba45e849d58c7c60f (127.8.208.194:39925), 806cafca6a16420dbbe49e68a2d4eb8c (127.8.208.195:46673)
I20260807 08:39:51.511350 10113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a75683deb154445a4a45938cf46f6d9" candidate_uuid: "11bfb1e4801d4a8f849854a0d4fd8cd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "806cafca6a16420dbbe49e68a2d4eb8c"
I20260807 08:39:51.511350 9970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a75683deb154445a4a45938cf46f6d9" candidate_uuid: "11bfb1e4801d4a8f849854a0d4fd8cd6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa7ccdc7e1524e6ba45e849d58c7c60f"
I20260807 08:39:51.511467 9970 raft_consensus.cc:3037] T 7a75683deb154445a4a45938cf46f6d9 P fa7ccdc7e1524e6ba45e849d58c7c60f [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:51.511469 10113 raft_consensus.cc:3037] T 7a75683deb154445a4a45938cf46f6d9 P 806cafca6a16420dbbe49e68a2d4eb8c [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:51.512718 10113 raft_consensus.cc:2454] T 7a75683deb154445a4a45938cf46f6d9 P 806cafca6a16420dbbe49e68a2d4eb8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11bfb1e4801d4a8f849854a0d4fd8cd6 in term 1.
I20260807 08:39:51.512718 9970 raft_consensus.cc:2454] T 7a75683deb154445a4a45938cf46f6d9 P fa7ccdc7e1524e6ba45e849d58c7c60f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11bfb1e4801d4a8f849854a0d4fd8cd6 in term 1.
I20260807 08:39:51.512992 9744 leader_election.cc:302] T 7a75683deb154445a4a45938cf46f6d9 P 11bfb1e4801d4a8f849854a0d4fd8cd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11bfb1e4801d4a8f849854a0d4fd8cd6, 806cafca6a16420dbbe49e68a2d4eb8c; no voters:
I20260807 08:39:51.513130 10187 raft_consensus.cc:2781] T 7a75683deb154445a4a45938cf46f6d9 P 11bfb1e4801d4a8f849854a0d4fd8cd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:39:51.513342 10187 raft_consensus.cc:686] T 7a75683deb154445a4a45938cf46f6d9 P 11bfb1e4801d4a8f849854a0d4fd8cd6 [term 1 LEADER]: Becoming Leader. State: Replica: 11bfb1e4801d4a8f849854a0d4fd8cd6, State: Running, Role: LEADER
I20260807 08:39:51.513652 10187 consensus_queue.cc:237] T 7a75683deb154445a4a45938cf46f6d9 P 11bfb1e4801d4a8f849854a0d4fd8cd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa7ccdc7e1524e6ba45e849d58c7c60f" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39925 } } peers { permanent_uuid: "11bfb1e4801d4a8f849854a0d4fd8cd6" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45769 } } peers { permanent_uuid: "806cafca6a16420dbbe49e68a2d4eb8c" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 46673 } }
I20260807 08:39:51.516644 9659 catalog_manager.cc:5495] T 7a75683deb154445a4a45938cf46f6d9 P 11bfb1e4801d4a8f849854a0d4fd8cd6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11bfb1e4801d4a8f849854a0d4fd8cd6 (127.8.208.193). New cstate: current_term: 1 leader_uuid: "11bfb1e4801d4a8f849854a0d4fd8cd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa7ccdc7e1524e6ba45e849d58c7c60f" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11bfb1e4801d4a8f849854a0d4fd8cd6" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "806cafca6a16420dbbe49e68a2d4eb8c" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 46673 } health_report { overall_health: UNKNOWN } } }
Aug 07 08:39:51 dist-test-slave-6nmv krb5kdc[9613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091990, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.193@KRBTEST.COM
I20260807 08:39:51.547698 10178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:51.539897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48572 (local address 127.8.208.193:45769)
0807 08:39:51.540028 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:51.540032 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:51.540182 (+ 150us) server_negotiation.cc:407] Connection header received
0807 08:39:51.540266 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:51.540268 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:51.540303 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:51.540363 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:51.540993 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.541420 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.542252 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.542434 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.542504 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:51.544792 (+ 2288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:51.544801 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:51.544812 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:51.544832 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:51.546244 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:51.546603 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:51.546606 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:51.546607 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:51.546703 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:51.546948 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:51.546950 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:51.546951 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:51.547151 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:51.547290 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:51.547408 (+ 118us) server_negotiation.cc:299] Negotiation successful
0807 08:39:51.547505 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Aug 07 08:39:51 dist-test-slave-6nmv krb5kdc[9613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091991, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 08:39:51 dist-test-slave-6nmv krb5kdc[9613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091991, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.208.193@KRBTEST.COM
I20260807 08:39:51.572948 10178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:51.564765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48580 (local address 127.8.208.193:45769)
0807 08:39:51.564897 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:51.564901 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:51.565185 (+ 284us) server_negotiation.cc:407] Connection header received
0807 08:39:51.565335 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:51.565338 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:51.565391 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:51.565480 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:51.566254 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.566742 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.567611 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.567827 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.567945 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:51.570300 (+ 2355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:51.570302 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:51.570304 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:51.570324 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:51.571519 (+ 1195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:51.571914 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:51.571916 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:51.571917 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:51.571996 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:51.572228 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:51.572230 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:51.572231 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:51.572402 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:51.572525 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:51.572743 (+ 218us) server_negotiation.cc:299] Negotiation successful
0807 08:39:51.572834 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Aug 07 08:39:51 dist-test-slave-6nmv krb5kdc[9613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091991, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 08:39:51 dist-test-slave-6nmv krb5kdc[9613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091991, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.193@KRBTEST.COM
I20260807 08:39:51.596177 10178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:51.588759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48592 (local address 127.8.208.193:45769)
0807 08:39:51.588879 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:51.588884 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:51.589027 (+ 143us) server_negotiation.cc:407] Connection header received
0807 08:39:51.589142 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:51.589148 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:51.589196 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:51.589272 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:51.589897 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.590296 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.591039 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:51.591264 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:51.591370 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:51.593502 (+ 2132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:51.593505 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:51.593507 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:51.593527 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:51.594730 (+ 1203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:51.595117 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:51.595120 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:51.595122 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:51.595195 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:51.595452 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:51.595455 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:51.595457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:51.595596 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:51.595734 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:51.595932 (+ 198us) server_negotiation.cc:299] Negotiation successful
0807 08:39:51.596030 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260807 08:39:51.597561 9775 tablet_service.cc:2908] Rejecting scan request for tablet 7a75683deb154445a4a45938cf46f6d9: Uninitialized: clean time has not yet been initialized
W20260807 08:39:51.598009 10164 tablet.cc:2369] T 7a75683deb154445a4a45938cf46f6d9 P 806cafca6a16420dbbe49e68a2d4eb8c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 08:39:51.599381 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 9728
I20260807 08:39:51.606797 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 9877
I20260807 08:39:51.615541 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 10024
I20260807 08:39:51.622169 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 9628
2026-08-07T08:39:51Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2236 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:39:51 dist-test-slave-6nmv krb5kdc[10207](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:39:51 dist-test-slave-6nmv krb5kdc[10207](info): set up 2 sockets
Aug 07 08:39:51 dist-test-slave-6nmv krb5kdc[10207](info): commencing operation
krb5kdc: starting...
W20260807 08:39:52.627880 9027 mini_kdc.cc:121] Time spent starting KDC: real 0.983s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:39:52 dist-test-slave-6nmv krb5kdc[10207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091992, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:39:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:39:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:39:52.743984 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:46883
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:39579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:46883
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:39:52.845678 10222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:39:52.845947 10222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:39:52.845983 10222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:39:52.850955 10222 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:39:52.851022 10222 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 08:39:52.851039 10222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:39:52.851058 10222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:39:52.851105 10222 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:39:52.851145 10222 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:39:52.856297 10222 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:39579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:46883
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:46883
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10222
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:39:52.857173 10222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:39:52.858132 10222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:39:52.865635 10228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:52.865629 10231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:52.865628 10227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:39:52.865861 10222 server_base.cc:1034] running on GCE node
I20260807 08:39:52.866391 10222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:39:52.867416 10222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:39:52.868597 10222 hybrid_clock.cc:648] HybridClock initialized: now 1786091992868585 us; error 30 us; skew 500 ppm
Aug 07 08:39:52 dist-test-slave-6nmv krb5kdc[10207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091992, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:39:52.871069 10222 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:39:52.871915 10222 webserver.cc:460] Webserver started at http://127.8.208.254:45105/ using document root <none> and password file <none>
I20260807 08:39:52.872457 10222 fs_manager.cc:359] Metadata directory not provided
I20260807 08:39:52.872546 10222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:39:52.872768 10222 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:39:52.874784 10222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "ee32f0a4eae74a0a88225ad3d7be8f4a"
format_stamp: "Formatted at 2026-08-07 08:39:52 on dist-test-slave-6nmv"
server_key: "a56cd9e560215eabb8a01ab1ad7b0433"
server_key_iv: "4f433e8e7782d8633e4ff52704afce91"
server_key_version: "encryptionkey@0"
I20260807 08:39:52.875407 10222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "ee32f0a4eae74a0a88225ad3d7be8f4a"
format_stamp: "Formatted at 2026-08-07 08:39:52 on dist-test-slave-6nmv"
server_key: "a56cd9e560215eabb8a01ab1ad7b0433"
server_key_iv: "4f433e8e7782d8633e4ff52704afce91"
server_key_version: "encryptionkey@0"
I20260807 08:39:52.878813 10222 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260807 08:39:52.880872 10238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:52.882263 10222 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:39:52.882417 10222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "ee32f0a4eae74a0a88225ad3d7be8f4a"
format_stamp: "Formatted at 2026-08-07 08:39:52 on dist-test-slave-6nmv"
server_key: "a56cd9e560215eabb8a01ab1ad7b0433"
server_key_iv: "4f433e8e7782d8633e4ff52704afce91"
server_key_version: "encryptionkey@0"
I20260807 08:39:52.882529 10222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:39:52.892895 10222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:39:52.895716 10222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:39:52.895905 10222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:39:52.903592 10222 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:46883
I20260807 08:39:52.903610 10308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:46883 every 8 connection(s)
I20260807 08:39:52.904418 10222 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:39:52.906898 10310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:52.909057 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 10222
I20260807 08:39:52.909142 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:39:52.909405 9027 external_mini_cluster.cc:1428] Setting key 8f46f3cf4a0b7481928a309b87512e19
I20260807 08:39:52.912528 10310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee32f0a4eae74a0a88225ad3d7be8f4a: Bootstrap starting.
I20260807 08:39:52.915030 10310 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee32f0a4eae74a0a88225ad3d7be8f4a: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:52.915731 10310 log.cc:824] T 00000000000000000000000000000000 P ee32f0a4eae74a0a88225ad3d7be8f4a: Log is configured to *not* fsync() on all Append() calls
I20260807 08:39:52.917416 10310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee32f0a4eae74a0a88225ad3d7be8f4a: No bootstrap required, opened a new log
Aug 07 08:39:52 dist-test-slave-6nmv krb5kdc[10207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091992, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:39:52.920881 10310 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee32f0a4eae74a0a88225ad3d7be8f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee32f0a4eae74a0a88225ad3d7be8f4a" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 46883 } }
I20260807 08:39:52.921103 10310 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee32f0a4eae74a0a88225ad3d7be8f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:52.921203 10310 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee32f0a4eae74a0a88225ad3d7be8f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee32f0a4eae74a0a88225ad3d7be8f4a, State: Initialized, Role: FOLLOWER
I20260807 08:39:52.921667 10310 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee32f0a4eae74a0a88225ad3d7be8f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee32f0a4eae74a0a88225ad3d7be8f4a" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 46883 } }
I20260807 08:39:52.921860 10310 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee32f0a4eae74a0a88225ad3d7be8f4a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:39:52.921936 10310 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee32f0a4eae74a0a88225ad3d7be8f4a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:39:52.922032 10310 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee32f0a4eae74a0a88225ad3d7be8f4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:52.922973 10310 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee32f0a4eae74a0a88225ad3d7be8f4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee32f0a4eae74a0a88225ad3d7be8f4a" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 46883 } }
I20260807 08:39:52.923310 10310 leader_election.cc:302] T 00000000000000000000000000000000 P ee32f0a4eae74a0a88225ad3d7be8f4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee32f0a4eae74a0a88225ad3d7be8f4a; no voters:
I20260807 08:39:52.923406 10313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:52.910725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48830 (local address 127.8.208.254:46883)
0807 08:39:52.911106 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:52.911122 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:52.911161 (+ 39us) server_negotiation.cc:407] Connection header received
0807 08:39:52.911904 (+ 743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:52.911924 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:52.912292 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:52.912638 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:52.913311 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:52.914772 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:52.915621 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:52.916241 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:52.916441 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:52.918835 (+ 2394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:52.918840 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:52.918850 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:52.918873 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:52.920452 (+ 1579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:52.920870 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:52.920875 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:52.920879 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:52.920994 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:52.921276 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:52.921280 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:52.921282 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:52.921740 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:52.922001 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:52.922238 (+ 237us) server_negotiation.cc:299] Negotiation successful
0807 08:39:52.922499 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":95,"threads_started":1}
I20260807 08:39:52.923647 10310 leader_election.cc:288] T 00000000000000000000000000000000 P ee32f0a4eae74a0a88225ad3d7be8f4a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:39:52.923743 10316 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee32f0a4eae74a0a88225ad3d7be8f4a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:39:52.923974 10316 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee32f0a4eae74a0a88225ad3d7be8f4a [term 1 LEADER]: Becoming Leader. State: Replica: ee32f0a4eae74a0a88225ad3d7be8f4a, State: Running, Role: LEADER
I20260807 08:39:52.924327 10316 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee32f0a4eae74a0a88225ad3d7be8f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee32f0a4eae74a0a88225ad3d7be8f4a" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 46883 } }
I20260807 08:39:52.924826 10310 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee32f0a4eae74a0a88225ad3d7be8f4a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:39:52.925261 10316 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee32f0a4eae74a0a88225ad3d7be8f4a [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee32f0a4eae74a0a88225ad3d7be8f4a. Latest consensus state: current_term: 1 leader_uuid: "ee32f0a4eae74a0a88225ad3d7be8f4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee32f0a4eae74a0a88225ad3d7be8f4a" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 46883 } } }
I20260807 08:39:52.925390 10316 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee32f0a4eae74a0a88225ad3d7be8f4a [sys.catalog]: This master's current role is: LEADER
I20260807 08:39:52.925664 10318 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee32f0a4eae74a0a88225ad3d7be8f4a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee32f0a4eae74a0a88225ad3d7be8f4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee32f0a4eae74a0a88225ad3d7be8f4a" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 46883 } } }
I20260807 08:39:52.925832 10318 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee32f0a4eae74a0a88225ad3d7be8f4a [sys.catalog]: This master's current role is: LEADER
I20260807 08:39:52.925753 10324 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:39:52.928960 10324 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:39:52.934373 10324 catalog_manager.cc:1347] Generated new cluster ID: 185a7eca0e5049b58355459ed42af87a
I20260807 08:39:52.934437 10324 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:39:52.947115 10324 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:39:52.948105 10324 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:39:52.956125 10324 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee32f0a4eae74a0a88225ad3d7be8f4a: Generated new TSK 0
I20260807 08:39:52.956683 10324 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.208.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
I20260807 08:39:52.990782 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:46883
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:39579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:39:53.123147 10341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:39:53.123356 10341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:39:53.123431 10341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:39:53.127615 10341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:39:53.127717 10341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:39:53.127775 10341 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 08:39:53.127846 10341 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:39:53.132831 10341 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:39579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.208.254:46883
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10341
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:39:53.133725 10341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:39:53.134660 10341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 08:39:53.143366 10341 server_base.cc:1034] running on GCE node
W20260807 08:39:53.143332 10347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:53.143358 10346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:53.143324 10349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:39:53.143884 10341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:39:53.144523 10341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:39:53.145709 10341 hybrid_clock.cc:648] HybridClock initialized: now 1786091993145686 us; error 33 us; skew 500 ppm
Aug 07 08:39:53 dist-test-slave-6nmv krb5kdc[10207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091993, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:39:53.148648 10341 init.cc:377] Logged in from keytab as kudu/127.8.208.193@KRBTEST.COM (short username kudu)
I20260807 08:39:53.149367 10341 webserver.cc:460] Webserver started at http://127.8.208.193:41241/ using document root <none> and password file <none>
I20260807 08:39:53.149797 10341 fs_manager.cc:359] Metadata directory not provided
I20260807 08:39:53.149912 10341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:39:53.150084 10341 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:39:53.151906 10341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "8129cd08812d441caeb89b1ea8e458c2"
format_stamp: "Formatted at 2026-08-07 08:39:53 on dist-test-slave-6nmv"
server_key: "2fd005035a2d1952e2544f64fecf7496"
server_key_iv: "6bd6a599893026167dd7faeef06ec7b0"
server_key_version: "encryptionkey@0"
I20260807 08:39:53.152395 10341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "8129cd08812d441caeb89b1ea8e458c2"
format_stamp: "Formatted at 2026-08-07 08:39:53 on dist-test-slave-6nmv"
server_key: "2fd005035a2d1952e2544f64fecf7496"
server_key_iv: "6bd6a599893026167dd7faeef06ec7b0"
server_key_version: "encryptionkey@0"
I20260807 08:39:53.155829 10341 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260807 08:39:53.157989 10356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:53.159126 10341 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 08:39:53.159235 10341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "8129cd08812d441caeb89b1ea8e458c2"
format_stamp: "Formatted at 2026-08-07 08:39:53 on dist-test-slave-6nmv"
server_key: "2fd005035a2d1952e2544f64fecf7496"
server_key_iv: "6bd6a599893026167dd7faeef06ec7b0"
server_key_version: "encryptionkey@0"
I20260807 08:39:53.159327 10341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:39:53.172559 10341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:39:53.175251 10341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:39:53.175470 10341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:39:53.176828 10341 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:39:53.176873 10341 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:53.176954 10341 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:39:53.176985 10341 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 08:39:53 dist-test-slave-6nmv krb5kdc[10207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091993, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:39:53.188203 10341 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:43317
I20260807 08:39:53.188277 10482 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:43317 every 8 connection(s)
I20260807 08:39:53.189081 10341 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:39:53.191037 10313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.177707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:48607 (local address 127.8.208.254:46883)
0807 08:39:53.177866 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:53.177871 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:53.178882 (+ 1011us) server_negotiation.cc:407] Connection header received
0807 08:39:53.180002 (+ 1120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:53.180006 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:53.180066 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:53.180112 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:53.181586 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.182340 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.183597 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.183839 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.183948 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.187319 (+ 3371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:53.187322 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:53.187325 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:53.187349 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:53.188914 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:53.189446 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:53.189449 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:53.189451 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:53.189544 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:53.190055 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:53.190058 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:53.190059 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:53.190234 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:53.190337 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:53.190769 (+ 432us) server_negotiation.cc:299] Negotiation successful
0807 08:39:53.190881 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 08:39:53.191720 10365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.178244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:46883 (local address 127.8.208.193:48607)
0807 08:39:53.178729 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:53.178768 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:53.179716 (+ 948us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:53.180388 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:53.180418 (+ 30us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:53.180815 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:39:53.181416 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.181437 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.182491 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.182494 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.183467 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.183476 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.184004 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.184009 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.184170 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.184755 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:39:53.184772 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:39:53.187149 (+ 2377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:39:53.189032 (+ 1883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:53.189037 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:53.189049 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:53.189345 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:53.189767 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:53.189770 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:53.189772 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:53.189964 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:53.190335 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:39:53.190341 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:39:53.190557 (+ 216us) client_negotiation.cc:769] Sending connection context
0807 08:39:53.190713 (+ 156us) client_negotiation.cc:240] Negotiation successful
0807 08:39:53.190984 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":159,"threads_started":1}
I20260807 08:39:53.192857 10483 heartbeater.cc:347] Connected to a master server at 127.8.208.254:46883
I20260807 08:39:53.193034 10483 heartbeater.cc:464] Registering TS with master...
I20260807 08:39:53.193501 10483 heartbeater.cc:511] Master 127.8.208.254:46883 requested a full tablet report, sending...
I20260807 08:39:53.195204 10257 ts_manager.cc:194] Registered new tserver with Master: 8129cd08812d441caeb89b1ea8e458c2 (127.8.208.193:43317)
I20260807 08:39:53.196213 10257 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.193@KRBTEST.COM'} at 127.8.208.193:48607
I20260807 08:39:53.197247 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 10341
I20260807 08:39:53.197373 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
I20260807 08:39:53.197654 9027 external_mini_cluster.cc:1428] Setting key 05fa2f2970073378c87e654ed4e55ebc
I20260807 08:39:53.201414 10490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.194887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:46883 (local address 127.8.208.193:42925)
0807 08:39:53.195218 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:53.195228 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:53.195323 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:53.195552 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:53.195554 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:53.195723 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:39:53.195806 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.195810 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.196522 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.196527 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.197134 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.197146 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.197672 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.197676 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.197765 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.198241 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:39:53.198254 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:39:53.198550 (+ 296us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:39:53.200059 (+ 1509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:53.200064 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:53.200068 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:53.200301 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:53.200539 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:53.200544 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:53.200547 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:53.200643 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:53.201069 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:39:53.201070 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:39:53.201135 (+ 65us) client_negotiation.cc:769] Sending connection context
0807 08:39:53.201209 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 08:39:53.201297 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":100,"threads_started":1}
I20260807 08:39:53.201610 10313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.195010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:42925 (local address 127.8.208.254:46883)
0807 08:39:53.195128 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:53.195132 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:53.195292 (+ 160us) server_negotiation.cc:407] Connection header received
0807 08:39:53.195414 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:53.195417 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:53.195460 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:53.195537 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:53.195918 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.196405 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.197252 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.197549 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.197648 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.198665 (+ 1017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:53.198668 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:53.198671 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:53.198693 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:53.199959 (+ 1266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:53.200390 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:53.200392 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:53.200392 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:53.200460 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:53.200747 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:53.200751 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:53.200754 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:53.200976 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:53.201075 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:53.201287 (+ 212us) server_negotiation.cc:299] Negotiation successful
0807 08:39:53.201416 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
WARNING: no policy specified for kudu/127.8.208.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
I20260807 08:39:53.224797 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:46883
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:39579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:39:53.326015 10493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:39:53.326283 10493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:39:53.326378 10493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:39:53.330111 10493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:39:53.330155 10493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:39:53.330214 10493 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 08:39:53.330283 10493 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:39:53.334971 10493 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:39579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.208.254:46883
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10493
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:39:53.335788 10493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:39:53.336639 10493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:39:53.345278 10499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:53.345264 10498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:39:53.345460 10493 server_base.cc:1034] running on GCE node
W20260807 08:39:53.345266 10501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:39:53.345944 10493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:39:53.346513 10493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:39:53.347697 10493 hybrid_clock.cc:648] HybridClock initialized: now 1786091993347686 us; error 22 us; skew 500 ppm
Aug 07 08:39:53 dist-test-slave-6nmv krb5kdc[10207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091993, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:39:53.350150 10493 init.cc:377] Logged in from keytab as kudu/127.8.208.194@KRBTEST.COM (short username kudu)
I20260807 08:39:53.350924 10493 webserver.cc:460] Webserver started at http://127.8.208.194:43325/ using document root <none> and password file <none>
I20260807 08:39:53.351397 10493 fs_manager.cc:359] Metadata directory not provided
I20260807 08:39:53.351459 10493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:39:53.351672 10493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:39:53.353551 10493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "f43089391d264e1cb5c9e19bc98f8747"
format_stamp: "Formatted at 2026-08-07 08:39:53 on dist-test-slave-6nmv"
server_key: "a0f77d3394e21071b1d1c3261ced0881"
server_key_iv: "67e1b844b93ee1d9aab3318332221626"
server_key_version: "encryptionkey@0"
I20260807 08:39:53.354108 10493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "f43089391d264e1cb5c9e19bc98f8747"
format_stamp: "Formatted at 2026-08-07 08:39:53 on dist-test-slave-6nmv"
server_key: "a0f77d3394e21071b1d1c3261ced0881"
server_key_iv: "67e1b844b93ee1d9aab3318332221626"
server_key_version: "encryptionkey@0"
I20260807 08:39:53.357497 10493 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 08:39:53.359730 10509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:53.360781 10493 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:39:53.360908 10493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "f43089391d264e1cb5c9e19bc98f8747"
format_stamp: "Formatted at 2026-08-07 08:39:53 on dist-test-slave-6nmv"
server_key: "a0f77d3394e21071b1d1c3261ced0881"
server_key_iv: "67e1b844b93ee1d9aab3318332221626"
server_key_version: "encryptionkey@0"
I20260807 08:39:53.361008 10493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:39:53.390045 10493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:39:53.392618 10493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:39:53.392804 10493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:39:53.394356 10493 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:39:53.394441 10493 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:53.394502 10493 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:39:53.394532 10493 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 08:39:53 dist-test-slave-6nmv krb5kdc[10207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091993, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:39:53.404073 10493 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:39047
I20260807 08:39:53.404167 10638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:39047 every 8 connection(s)
I20260807 08:39:53.404983 10493 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:39:53.406673 10313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.394978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:51107 (local address 127.8.208.254:46883)
0807 08:39:53.395151 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:53.395157 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:53.396303 (+ 1146us) server_negotiation.cc:407] Connection header received
0807 08:39:53.397497 (+ 1194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:53.397501 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:53.397556 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:53.397618 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:53.399076 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.399603 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.400690 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.400898 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.401005 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.403376 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:53.403384 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:53.403392 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:53.403415 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:53.404831 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:53.405374 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:53.405377 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:53.405379 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:53.405473 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:53.405856 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:53.405859 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:53.405860 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:53.406030 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:53.406106 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:53.406481 (+ 375us) server_negotiation.cc:299] Negotiation successful
0807 08:39:53.406570 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 08:39:53.407287 10518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.395718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:46883 (local address 127.8.208.194:51107)
0807 08:39:53.396143 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:53.396200 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:53.397235 (+ 1035us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:53.397835 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:53.397846 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:53.398307 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:39:53.398912 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.398943 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.399720 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.399723 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.400577 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.400586 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.401048 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.401052 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.401215 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.401731 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:39:53.401744 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:39:53.403216 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:39:53.404948 (+ 1732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:53.404953 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:53.404963 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:53.405270 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:53.405569 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:53.405571 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:53.405572 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:53.405707 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:53.406118 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:39:53.406121 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:39:53.406291 (+ 170us) client_negotiation.cc:769] Sending connection context
0807 08:39:53.406425 (+ 134us) client_negotiation.cc:240] Negotiation successful
0807 08:39:53.406616 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":88,"threads_started":1}
I20260807 08:39:53.408411 10639 heartbeater.cc:347] Connected to a master server at 127.8.208.254:46883
I20260807 08:39:53.408550 10639 heartbeater.cc:464] Registering TS with master...
I20260807 08:39:53.409025 10639 heartbeater.cc:511] Master 127.8.208.254:46883 requested a full tablet report, sending...
I20260807 08:39:53.409986 10257 ts_manager.cc:194] Registered new tserver with Master: f43089391d264e1cb5c9e19bc98f8747 (127.8.208.194:39047)
I20260807 08:39:53.410652 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 10493
I20260807 08:39:53.410708 10257 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.194@KRBTEST.COM'} at 127.8.208.194:51107
I20260807 08:39:53.410776 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:39:53.411131 9027 external_mini_cluster.cc:1428] Setting key 8add5719bec83a5b9bfbe90c36c722ab
I20260807 08:39:53.417515 10645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.410201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:46883 (local address 127.8.208.194:45371)
0807 08:39:53.410469 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:53.410482 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:53.410551 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:53.411277 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:53.411280 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:53.411460 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:39:53.411591 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.411596 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.412575 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.412578 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.413102 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.413109 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.413585 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.413589 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.413677 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.414150 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:39:53.414160 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:39:53.414452 (+ 292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:39:53.416031 (+ 1579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:53.416034 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:53.416035 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:53.416204 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:53.416485 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:53.416491 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:53.416494 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:53.416595 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:53.417110 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:39:53.417112 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:39:53.417207 (+ 95us) client_negotiation.cc:769] Sending connection context
0807 08:39:53.417306 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 08:39:53.417398 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":7,"thread_start_us":89,"threads_started":1}
I20260807 08:39:53.417668 10313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.410305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:45371 (local address 127.8.208.254:46883)
0807 08:39:53.411020 (+ 715us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:53.411023 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:53.411052 (+ 29us) server_negotiation.cc:407] Connection header received
0807 08:39:53.411084 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:53.411086 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:53.411119 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:53.411199 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:53.411736 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.412423 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.413256 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.413477 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.413581 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.414572 (+ 991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:53.414575 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:53.414577 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:53.414598 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:53.415929 (+ 1331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:53.416295 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:53.416300 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:53.416305 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:53.416388 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:53.416694 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:53.416699 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:53.416703 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:53.417018 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:53.417118 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:53.417392 (+ 274us) server_negotiation.cc:299] Negotiation successful
0807 08:39:53.417509 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":650}
WARNING: no policy specified for kudu/127.8.208.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
I20260807 08:39:53.438707 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:46883
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:39579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:39:53.548588 10648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:39:53.548815 10648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:39:53.548914 10648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:39:53.552788 10648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:39:53.552870 10648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:39:53.552907 10648 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 08:39:53.552996 10648 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:39:53.557920 10648 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:39579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.208.254:46883
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10648
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:39:53.558818 10648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:39:53.559736 10648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 08:39:53.569052 10648 server_base.cc:1034] running on GCE node
W20260807 08:39:53.569020 10654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:53.569033 10656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:53.569015 10653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:39:53.569643 10648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:39:53.570212 10648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:39:53.571360 10648 hybrid_clock.cc:648] HybridClock initialized: now 1786091993571344 us; error 27 us; skew 500 ppm
Aug 07 08:39:53 dist-test-slave-6nmv krb5kdc[10207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091993, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:39:53.574101 10648 init.cc:377] Logged in from keytab as kudu/127.8.208.195@KRBTEST.COM (short username kudu)
I20260807 08:39:53.574874 10648 webserver.cc:460] Webserver started at http://127.8.208.195:39567/ using document root <none> and password file <none>
I20260807 08:39:53.575359 10648 fs_manager.cc:359] Metadata directory not provided
I20260807 08:39:53.575416 10648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:39:53.575635 10648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:39:53.577420 10648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "c1f06a2bafbd4671a278a40cbdd9786f"
format_stamp: "Formatted at 2026-08-07 08:39:53 on dist-test-slave-6nmv"
server_key: "9d9674bfa551666d09fb7d39550da18b"
server_key_iv: "72d665d48785627fce6fb35c46dec784"
server_key_version: "encryptionkey@0"
I20260807 08:39:53.578001 10648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "c1f06a2bafbd4671a278a40cbdd9786f"
format_stamp: "Formatted at 2026-08-07 08:39:53 on dist-test-slave-6nmv"
server_key: "9d9674bfa551666d09fb7d39550da18b"
server_key_iv: "72d665d48785627fce6fb35c46dec784"
server_key_version: "encryptionkey@0"
I20260807 08:39:53.581208 10648 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 08:39:53.583395 10663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:53.584504 10648 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260807 08:39:53.584638 10648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "c1f06a2bafbd4671a278a40cbdd9786f"
format_stamp: "Formatted at 2026-08-07 08:39:53 on dist-test-slave-6nmv"
server_key: "9d9674bfa551666d09fb7d39550da18b"
server_key_iv: "72d665d48785627fce6fb35c46dec784"
server_key_version: "encryptionkey@0"
I20260807 08:39:53.584735 10648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:39:53.597123 10648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:39:53.600128 10648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:39:53.600307 10648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:39:53.601635 10648 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:39:53.601722 10648 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:53.601811 10648 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:39:53.601877 10648 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
Aug 07 08:39:53 dist-test-slave-6nmv krb5kdc[10207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091993, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:39:53.613219 10648 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:34239
I20260807 08:39:53.613296 10791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:34239 every 8 connection(s)
I20260807 08:39:53.614321 10648 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:39:53.614631 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 10648
I20260807 08:39:53.614763 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:39:53.615093 9027 external_mini_cluster.cc:1428] Setting key b7bc5e958f7b4c4723d157137f278ba1
I20260807 08:39:53.616353 10313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.602339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:56073 (local address 127.8.208.254:46883)
0807 08:39:53.602526 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:53.602534 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:53.603897 (+ 1363us) server_negotiation.cc:407] Connection header received
0807 08:39:53.605188 (+ 1291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:53.605191 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:53.605269 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:53.605392 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:53.606778 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.607303 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.608586 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.608844 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.608961 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.612012 (+ 3051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:53.612016 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:53.612018 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:53.612048 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:53.613932 (+ 1884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:53.614499 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:53.614503 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:53.614505 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:53.614607 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:53.615076 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:53.615080 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:53.615081 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:53.615316 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:53.615434 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:53.616025 (+ 591us) server_negotiation.cc:299] Negotiation successful
0807 08:39:53.616170 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 08:39:53.617060 10672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.603201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:46883 (local address 127.8.208.195:56073)
0807 08:39:53.603701 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:53.603764 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:53.604978 (+ 1214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:53.605618 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:53.605625 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:53.606158 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:39:53.606640 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.606652 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.607431 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.607435 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.608439 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.608452 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.609009 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.609013 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.609167 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.609742 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:39:53.609757 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:39:53.611849 (+ 2092us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:39:53.614051 (+ 2202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:53.614055 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:53.614065 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:53.614327 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:53.614728 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:53.614731 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:53.614734 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:53.614938 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:53.615457 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:39:53.615463 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:39:53.615742 (+ 279us) client_negotiation.cc:769] Sending connection context
0807 08:39:53.615962 (+ 220us) client_negotiation.cc:240] Negotiation successful
0807 08:39:53.616286 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":123,"threads_started":1}
I20260807 08:39:53.618337 10792 heartbeater.cc:347] Connected to a master server at 127.8.208.254:46883
I20260807 08:39:53.618463 10792 heartbeater.cc:464] Registering TS with master...
I20260807 08:39:53.618924 10792 heartbeater.cc:511] Master 127.8.208.254:46883 requested a full tablet report, sending...
I20260807 08:39:53.619925 10258 ts_manager.cc:194] Registered new tserver with Master: c1f06a2bafbd4671a278a40cbdd9786f (127.8.208.195:34239)
I20260807 08:39:53.620620 10258 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.195@KRBTEST.COM'} at 127.8.208.195:56073
I20260807 08:39:53.626327 10798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.620120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:46883 (local address 127.8.208.195:60429)
0807 08:39:53.620391 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:53.620403 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:53.620483 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:53.620665 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:53.620668 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:53.620845 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:39:53.620937 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.620941 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.621650 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.621653 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.622345 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.622353 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.622723 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.622725 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.622783 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.623249 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:39:53.623259 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:39:53.623545 (+ 286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:39:53.625123 (+ 1578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:53.625126 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:53.625127 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:53.625286 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:53.625537 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:53.625538 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:53.625539 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:53.625606 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:53.625995 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:39:53.625996 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:39:53.626058 (+ 62us) client_negotiation.cc:769] Sending connection context
0807 08:39:53.626131 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 08:39:53.626213 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":99,"threads_started":1}
I20260807 08:39:53.626389 10313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.620185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:60429 (local address 127.8.208.254:46883)
0807 08:39:53.620303 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:53.620306 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:53.620475 (+ 169us) server_negotiation.cc:407] Connection header received
0807 08:39:53.620547 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:53.620549 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:53.620579 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:53.620635 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:53.621016 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.621511 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.622444 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.622637 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.622711 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.623667 (+ 956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:53.623671 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:53.623672 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:53.623694 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:53.625037 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:53.625360 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:53.625362 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:53.625363 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:53.625463 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:53.625677 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:53.625679 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:53.625680 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:53.625917 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:53.625990 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:53.626198 (+ 208us) server_negotiation.cc:299] Negotiation successful
0807 08:39:53.626278 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 08:39:53.629119 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 08:39:53 dist-test-slave-6nmv krb5kdc[10207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091993, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 08:39:53 dist-test-slave-6nmv krb5kdc[10207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091993, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:39:53.653434 10313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.646103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48840 (local address 127.8.208.254:46883)
0807 08:39:53.646259 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:53.646263 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:53.646276 (+ 13us) server_negotiation.cc:407] Connection header received
0807 08:39:53.646306 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:53.646308 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:53.646335 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:53.646431 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:53.647032 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.647482 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.648266 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.648457 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.648554 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.650689 (+ 2135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:53.650693 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:53.650695 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:53.650721 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:53.651824 (+ 1103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:53.652238 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:53.652242 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:53.652243 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:53.652319 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:53.652607 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:53.652611 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:53.652612 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:53.652770 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:53.652916 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:53.653178 (+ 262us) server_negotiation.cc:299] Negotiation successful
0807 08:39:53.653275 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 08:39:53.656299 10258 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48840:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 08:39:53.659117 10258 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:39:53.672353 10809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.666932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:34239 (local address 127.0.0.1:36100)
0807 08:39:53.667640 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:53.667685 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:53.667809 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:53.668343 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:53.668349 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:53.668372 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:39:53.668503 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.668509 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.669777 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.669780 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.670914 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.670922 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.671795 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.671798 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.671923 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.671970 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 08:39:53.672110 (+ 140us) client_negotiation.cc:240] Negotiation successful
0807 08:39:53.672225 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"mutex_wait_us":30,"thread_start_us":66,"threads_started":1}
I20260807 08:39:53.672365 10810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.667072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36100 (local address 127.8.208.195:34239)
0807 08:39:53.667403 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:53.667411 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:53.667774 (+ 363us) server_negotiation.cc:407] Connection header received
0807 08:39:53.667997 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:53.668003 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:53.668191 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:53.668339 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:39:53.668601 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.669660 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.671021 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.671674 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.671793 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.671948 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:53.672142 (+ 194us) server_negotiation.cc:299] Negotiation successful
0807 08:39:53.672227 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":101,"threads_started":1}
I20260807 08:39:53.673044 10812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.667107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:39047 (local address 127.0.0.1:46574)
0807 08:39:53.668071 (+ 964us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:53.668085 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:53.668166 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:53.668970 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:53.668972 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:53.668989 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:39:53.669070 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.669074 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.670227 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.670231 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.671355 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.671364 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.672649 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.672653 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.672751 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.672778 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 08:39:53.672852 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 08:39:53.672914 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":896,"mutex_wait_us":46,"thread_start_us":75,"threads_started":1}
I20260807 08:39:53.673413 10811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.667573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:43317 (local address 127.0.0.1:35144)
0807 08:39:53.668645 (+ 1072us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:53.668661 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:53.668753 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:53.669116 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:53.669118 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:53.669135 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:39:53.669212 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.669219 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.670286 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.670290 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.671780 (+ 1490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.671789 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.673015 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.673018 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.673102 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.673132 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 08:39:53.673225 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 08:39:53.673297 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1016,"mutex_wait_us":84,"thread_start_us":80,"threads_started":1}
I20260807 08:39:53.673583 10815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.667955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46574 (local address 127.8.208.194:39047)
0807 08:39:53.668540 (+ 585us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:53.668552 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:53.668574 (+ 22us) server_negotiation.cc:407] Connection header received
0807 08:39:53.668648 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:53.668651 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:53.668809 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:53.668954 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:39:53.669180 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.670127 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.671515 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.672317 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.672416 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.672571 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:53.673324 (+ 753us) server_negotiation.cc:299] Negotiation successful
0807 08:39:53.673407 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":497,"thread_start_us":95,"threads_started":1}
I20260807 08:39:53.674065 10814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.667736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35144 (local address 127.8.208.193:43317)
0807 08:39:53.668354 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:53.668371 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:53.668749 (+ 378us) server_negotiation.cc:407] Connection header received
0807 08:39:53.668848 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:53.668857 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:53.669011 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:53.669130 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:39:53.669347 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.670197 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.671910 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.672694 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.672788 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.672960 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:53.673760 (+ 800us) server_negotiation.cc:299] Negotiation successful
0807 08:39:53.673912 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":500,"thread_start_us":81,"threads_started":1}
I20260807 08:39:53.675613 10721 tablet_service.cc:1467] Processing CreateTablet for tablet 7c9d4824d6fa4a57986e3f20fb740525 (DEFAULT_TABLE table=test-table [id=823b81720cdc443f9f5f0d113c2982b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:39:53.675988 10566 tablet_service.cc:1467] Processing CreateTablet for tablet 7c9d4824d6fa4a57986e3f20fb740525 (DEFAULT_TABLE table=test-table [id=823b81720cdc443f9f5f0d113c2982b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:39:53.676664 10721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c9d4824d6fa4a57986e3f20fb740525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:53.676869 10566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c9d4824d6fa4a57986e3f20fb740525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:53.676549 10410 tablet_service.cc:1467] Processing CreateTablet for tablet 7c9d4824d6fa4a57986e3f20fb740525 (DEFAULT_TABLE table=test-table [id=823b81720cdc443f9f5f0d113c2982b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:39:53.677336 10410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c9d4824d6fa4a57986e3f20fb740525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:53.682442 10816 tablet_bootstrap.cc:492] T 7c9d4824d6fa4a57986e3f20fb740525 P f43089391d264e1cb5c9e19bc98f8747: Bootstrap starting.
I20260807 08:39:53.684103 10818 tablet_bootstrap.cc:492] T 7c9d4824d6fa4a57986e3f20fb740525 P 8129cd08812d441caeb89b1ea8e458c2: Bootstrap starting.
I20260807 08:39:53.684638 10816 tablet_bootstrap.cc:654] T 7c9d4824d6fa4a57986e3f20fb740525 P f43089391d264e1cb5c9e19bc98f8747: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:53.685307 10816 log.cc:824] T 7c9d4824d6fa4a57986e3f20fb740525 P f43089391d264e1cb5c9e19bc98f8747: Log is configured to *not* fsync() on all Append() calls
I20260807 08:39:53.685699 10818 tablet_bootstrap.cc:654] T 7c9d4824d6fa4a57986e3f20fb740525 P 8129cd08812d441caeb89b1ea8e458c2: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:53.686190 10817 tablet_bootstrap.cc:492] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f: Bootstrap starting.
I20260807 08:39:53.686563 10818 log.cc:824] T 7c9d4824d6fa4a57986e3f20fb740525 P 8129cd08812d441caeb89b1ea8e458c2: Log is configured to *not* fsync() on all Append() calls
I20260807 08:39:53.687249 10816 tablet_bootstrap.cc:492] T 7c9d4824d6fa4a57986e3f20fb740525 P f43089391d264e1cb5c9e19bc98f8747: No bootstrap required, opened a new log
I20260807 08:39:53.687430 10816 ts_tablet_manager.cc:1397] T 7c9d4824d6fa4a57986e3f20fb740525 P f43089391d264e1cb5c9e19bc98f8747: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 08:39:53.688067 10817 tablet_bootstrap.cc:654] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:53.688339 10818 tablet_bootstrap.cc:492] T 7c9d4824d6fa4a57986e3f20fb740525 P 8129cd08812d441caeb89b1ea8e458c2: No bootstrap required, opened a new log
I20260807 08:39:53.688505 10818 ts_tablet_manager.cc:1397] T 7c9d4824d6fa4a57986e3f20fb740525 P 8129cd08812d441caeb89b1ea8e458c2: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 08:39:53.688828 10817 log.cc:824] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f: Log is configured to *not* fsync() on all Append() calls
I20260807 08:39:53.690438 10817 tablet_bootstrap.cc:492] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f: No bootstrap required, opened a new log
I20260807 08:39:53.690609 10817 ts_tablet_manager.cc:1397] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 08:39:53.691018 10816 raft_consensus.cc:348] T 7c9d4824d6fa4a57986e3f20fb740525 P f43089391d264e1cb5c9e19bc98f8747 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } }
I20260807 08:39:53.691255 10816 raft_consensus.cc:374] T 7c9d4824d6fa4a57986e3f20fb740525 P f43089391d264e1cb5c9e19bc98f8747 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:53.691354 10816 raft_consensus.cc:729] T 7c9d4824d6fa4a57986e3f20fb740525 P f43089391d264e1cb5c9e19bc98f8747 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f43089391d264e1cb5c9e19bc98f8747, State: Initialized, Role: FOLLOWER
I20260807 08:39:53.692026 10816 consensus_queue.cc:260] T 7c9d4824d6fa4a57986e3f20fb740525 P f43089391d264e1cb5c9e19bc98f8747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } }
I20260807 08:39:53.692103 10818 raft_consensus.cc:348] T 7c9d4824d6fa4a57986e3f20fb740525 P 8129cd08812d441caeb89b1ea8e458c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } }
I20260807 08:39:53.692337 10818 raft_consensus.cc:374] T 7c9d4824d6fa4a57986e3f20fb740525 P 8129cd08812d441caeb89b1ea8e458c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:53.692406 10818 raft_consensus.cc:729] T 7c9d4824d6fa4a57986e3f20fb740525 P 8129cd08812d441caeb89b1ea8e458c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8129cd08812d441caeb89b1ea8e458c2, State: Initialized, Role: FOLLOWER
I20260807 08:39:53.692797 10818 consensus_queue.cc:260] T 7c9d4824d6fa4a57986e3f20fb740525 P 8129cd08812d441caeb89b1ea8e458c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } }
I20260807 08:39:53.693121 10816 ts_tablet_manager.cc:1428] T 7c9d4824d6fa4a57986e3f20fb740525 P f43089391d264e1cb5c9e19bc98f8747: Time spent starting tablet: real 0.006s user 0.000s sys 0.006s
I20260807 08:39:53.693383 10483 heartbeater.cc:503] Master 127.8.208.254:46883 was elected leader, sending a full tablet report...
I20260807 08:39:53.693496 10639 heartbeater.cc:503] Master 127.8.208.254:46883 was elected leader, sending a full tablet report...
I20260807 08:39:53.693686 10818 ts_tablet_manager.cc:1428] T 7c9d4824d6fa4a57986e3f20fb740525 P 8129cd08812d441caeb89b1ea8e458c2: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 08:39:53.695324 10817 raft_consensus.cc:348] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } }
I20260807 08:39:53.695578 10817 raft_consensus.cc:374] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:53.695647 10817 raft_consensus.cc:729] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1f06a2bafbd4671a278a40cbdd9786f, State: Initialized, Role: FOLLOWER
I20260807 08:39:53.696013 10817 consensus_queue.cc:260] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } }
I20260807 08:39:53.696626 10792 heartbeater.cc:503] Master 127.8.208.254:46883 was elected leader, sending a full tablet report...
I20260807 08:39:53.696952 10817 ts_tablet_manager.cc:1428] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 08:39:53.725164 10825 raft_consensus.cc:482] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:39:53.725317 10825 raft_consensus.cc:504] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } }
I20260807 08:39:53.726341 10825 leader_election.cc:288] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f43089391d264e1cb5c9e19bc98f8747 (127.8.208.194:39047), 8129cd08812d441caeb89b1ea8e458c2 (127.8.208.193:43317)
I20260807 08:39:53.729540 10815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.726666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:44615 (local address 127.8.208.194:39047)
0807 08:39:53.726784 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:53.726790 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:53.726807 (+ 17us) server_negotiation.cc:407] Connection header received
0807 08:39:53.726856 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:53.726859 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:53.726916 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:53.726993 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:39:53.727227 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.727671 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.728553 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.729029 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.729147 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.729194 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:53.729385 (+ 191us) server_negotiation.cc:299] Negotiation successful
0807 08:39:53.729447 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 08:39:53.729542 10672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.726575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:39047 (local address 127.8.208.195:44615)
0807 08:39:53.726687 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:53.726703 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:53.726782 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:53.727010 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:53.727013 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:53.727027 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:39:53.727135 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.727139 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.727776 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.727779 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.728444 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.728452 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.729143 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.729146 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.729248 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.729269 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 08:39:53.729345 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 08:39:53.729428 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260807 08:39:53.730162 10590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c9d4824d6fa4a57986e3f20fb740525" candidate_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f43089391d264e1cb5c9e19bc98f8747" is_pre_election: true
I20260807 08:39:53.730413 10590 raft_consensus.cc:2454] T 7c9d4824d6fa4a57986e3f20fb740525 P f43089391d264e1cb5c9e19bc98f8747 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1f06a2bafbd4671a278a40cbdd9786f in term 0.
I20260807 08:39:53.730844 10667 leader_election.cc:302] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1f06a2bafbd4671a278a40cbdd9786f, f43089391d264e1cb5c9e19bc98f8747; no voters:
I20260807 08:39:53.731009 10826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.726830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:43317 (local address 127.8.208.195:54859)
0807 08:39:53.727157 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:53.727167 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:53.727274 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:53.727495 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:53.727498 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:53.727513 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:39:53.727635 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.727640 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.728275 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.728280 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.729869 (+ 1589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.729880 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.730619 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.730623 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.730717 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.730740 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 08:39:53.730814 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 08:39:53.730879 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":105,"threads_started":1}
I20260807 08:39:53.731050 10814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.726906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:54859 (local address 127.8.208.193:43317)
0807 08:39:53.727020 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:53.727025 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:53.727240 (+ 215us) server_negotiation.cc:407] Connection header received
0807 08:39:53.727350 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:53.727353 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:53.727401 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:53.727475 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:39:53.727736 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.728167 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.729995 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.730478 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.730617 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.730683 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:53.730845 (+ 162us) server_negotiation.cc:299] Negotiation successful
0807 08:39:53.730906 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 08:39:53.731091 10825 raft_consensus.cc:2781] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:39:53.731335 10825 raft_consensus.cc:482] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:39:53.731410 10825 raft_consensus.cc:3037] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:53.731750 10434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c9d4824d6fa4a57986e3f20fb740525" candidate_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8129cd08812d441caeb89b1ea8e458c2" is_pre_election: true
I20260807 08:39:53.731999 10434 raft_consensus.cc:2454] T 7c9d4824d6fa4a57986e3f20fb740525 P 8129cd08812d441caeb89b1ea8e458c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1f06a2bafbd4671a278a40cbdd9786f in term 0.
I20260807 08:39:53.732640 10825 raft_consensus.cc:504] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } }
I20260807 08:39:53.732914 10825 leader_election.cc:288] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f [CANDIDATE]: Term 1 election: Requested vote from peers f43089391d264e1cb5c9e19bc98f8747 (127.8.208.194:39047), 8129cd08812d441caeb89b1ea8e458c2 (127.8.208.193:43317)
I20260807 08:39:53.733284 10590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c9d4824d6fa4a57986e3f20fb740525" candidate_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f43089391d264e1cb5c9e19bc98f8747"
I20260807 08:39:53.733330 10434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c9d4824d6fa4a57986e3f20fb740525" candidate_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8129cd08812d441caeb89b1ea8e458c2"
I20260807 08:39:53.733426 10434 raft_consensus.cc:3037] T 7c9d4824d6fa4a57986e3f20fb740525 P 8129cd08812d441caeb89b1ea8e458c2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:53.733431 10590 raft_consensus.cc:3037] T 7c9d4824d6fa4a57986e3f20fb740525 P f43089391d264e1cb5c9e19bc98f8747 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:53.734462 10434 raft_consensus.cc:2454] T 7c9d4824d6fa4a57986e3f20fb740525 P 8129cd08812d441caeb89b1ea8e458c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1f06a2bafbd4671a278a40cbdd9786f in term 1.
I20260807 08:39:53.734747 10667 leader_election.cc:302] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8129cd08812d441caeb89b1ea8e458c2, c1f06a2bafbd4671a278a40cbdd9786f; no voters:
I20260807 08:39:53.734895 10590 raft_consensus.cc:2454] T 7c9d4824d6fa4a57986e3f20fb740525 P f43089391d264e1cb5c9e19bc98f8747 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1f06a2bafbd4671a278a40cbdd9786f in term 1.
I20260807 08:39:53.734949 10825 raft_consensus.cc:2781] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:39:53.735219 10825 raft_consensus.cc:686] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f [term 1 LEADER]: Becoming Leader. State: Replica: c1f06a2bafbd4671a278a40cbdd9786f, State: Running, Role: LEADER
I20260807 08:39:53.735518 10825 consensus_queue.cc:237] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } }
I20260807 08:39:53.738333 10257 catalog_manager.cc:5495] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f reported cstate change: term changed from 0 to 1, leader changed from <none> to c1f06a2bafbd4671a278a40cbdd9786f (127.8.208.195). New cstate: current_term: 1 leader_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } health_report { overall_health: UNKNOWN } } }
I20260807 08:39:53.758626 10810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.755550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36114 (local address 127.8.208.195:34239)
0807 08:39:53.755678 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:53.755688 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:53.755703 (+ 15us) server_negotiation.cc:407] Connection header received
0807 08:39:53.755869 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:53.755871 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:53.755914 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:53.755992 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:39:53.756234 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.756645 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.757414 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.757612 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.757691 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.757986 (+ 295us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:39:53.758286 (+ 300us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:39:53.758380 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:53.758434 (+ 54us) server_negotiation.cc:299] Negotiation successful
0807 08:39:53.758474 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 08:39:53.763621 10590 raft_consensus.cc:1261] T 7c9d4824d6fa4a57986e3f20fb740525 P f43089391d264e1cb5c9e19bc98f8747 [term 1 FOLLOWER]: Refusing update from remote peer c1f06a2bafbd4671a278a40cbdd9786f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:39:53.763646 10434 raft_consensus.cc:1261] T 7c9d4824d6fa4a57986e3f20fb740525 P 8129cd08812d441caeb89b1ea8e458c2 [term 1 FOLLOWER]: Refusing update from remote peer c1f06a2bafbd4671a278a40cbdd9786f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:39:53.764288 10827 consensus_queue.cc:1035] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:39:53.764520 10825 consensus_queue.cc:1035] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:39:53.772347 10833 mvcc.cc:205] Tried to move back new op lower bound from 7315832806449856512 to 7315832806343294976. Current Snapshot: MvccSnapshot[applied={T|T < 7315832806449856512}]
I20260807 08:39:53.774317 10832 mvcc.cc:205] Tried to move back new op lower bound from 7315832806449856512 to 7315832806343294976. Current Snapshot: MvccSnapshot[applied={T|T < 7315832806449856512}]
I20260807 08:39:53.781602 10257 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:39:53.781721 10257 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:39:53.784077 10257 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ee32f0a4eae74a0a88225ad3d7be8f4a: Sending DeleteTablet for 3 replicas of tablet 7c9d4824d6fa4a57986e3f20fb740525
I20260807 08:39:53.784801 10721 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c9d4824d6fa4a57986e3f20fb740525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:39:53 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:36100
I20260807 08:39:53.784854 10566 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c9d4824d6fa4a57986e3f20fb740525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:39:53 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:46574
I20260807 08:39:53.785018 10410 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c9d4824d6fa4a57986e3f20fb740525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:39:53 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:35144
I20260807 08:39:53.785431 10843 tablet_replica.cc:330] T 7c9d4824d6fa4a57986e3f20fb740525 P 8129cd08812d441caeb89b1ea8e458c2: stopping tablet replica
I20260807 08:39:53.785584 10257 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48840:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 08:39:53.785754 10843 raft_consensus.cc:2229] T 7c9d4824d6fa4a57986e3f20fb740525 P 8129cd08812d441caeb89b1ea8e458c2 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260807 08:39:53.786019 10257 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:39:53.786042 10843 raft_consensus.cc:2258] T 7c9d4824d6fa4a57986e3f20fb740525 P 8129cd08812d441caeb89b1ea8e458c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:39:53.786613 10842 tablet_replica.cc:330] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f: stopping tablet replica
I20260807 08:39:53.786896 10842 raft_consensus.cc:2229] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f [term 1 LEADER]: Raft consensus shutting down.
I20260807 08:39:53.787223 10842 raft_consensus.cc:2258] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:39:53.787566 10841 tablet_replica.cc:330] T 7c9d4824d6fa4a57986e3f20fb740525 P f43089391d264e1cb5c9e19bc98f8747: stopping tablet replica
I20260807 08:39:53.787871 10841 raft_consensus.cc:2229] T 7c9d4824d6fa4a57986e3f20fb740525 P f43089391d264e1cb5c9e19bc98f8747 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:39:53.788183 10841 raft_consensus.cc:2258] T 7c9d4824d6fa4a57986e3f20fb740525 P f43089391d264e1cb5c9e19bc98f8747 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:39:53.788808 10842 ts_tablet_manager.cc:1905] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:39:53.790645 10843 ts_tablet_manager.cc:1905] T 7c9d4824d6fa4a57986e3f20fb740525 P 8129cd08812d441caeb89b1ea8e458c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:39:53.791548 10841 ts_tablet_manager.cc:1905] T 7c9d4824d6fa4a57986e3f20fb740525 P f43089391d264e1cb5c9e19bc98f8747: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:39:53.791582 10842 ts_tablet_manager.cc:1918] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:39:53.791747 10842 log.cc:1196] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/7c9d4824d6fa4a57986e3f20fb740525
I20260807 08:39:53.791751 10721 tablet_service.cc:1467] Processing CreateTablet for tablet 47de116b4469451798470de96bb9ce3d (DEFAULT_TABLE table=test-table [id=fa503481b34f4b1e82d96b36015d4681]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:39:53.792075 10842 ts_tablet_manager.cc:1939] T 7c9d4824d6fa4a57986e3f20fb740525 P c1f06a2bafbd4671a278a40cbdd9786f: Deleting consensus metadata
I20260807 08:39:53.792140 10721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47de116b4469451798470de96bb9ce3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:53.794201 10566 tablet_service.cc:1467] Processing CreateTablet for tablet 47de116b4469451798470de96bb9ce3d (DEFAULT_TABLE table=test-table [id=fa503481b34f4b1e82d96b36015d4681]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:39:53.794443 10817 tablet_bootstrap.cc:492] T 47de116b4469451798470de96bb9ce3d P c1f06a2bafbd4671a278a40cbdd9786f: Bootstrap starting.
I20260807 08:39:53.794469 10566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47de116b4469451798470de96bb9ce3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:53.795331 10817 tablet_bootstrap.cc:654] T 47de116b4469451798470de96bb9ce3d P c1f06a2bafbd4671a278a40cbdd9786f: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:53.796319 10816 tablet_bootstrap.cc:492] T 47de116b4469451798470de96bb9ce3d P f43089391d264e1cb5c9e19bc98f8747: Bootstrap starting.
I20260807 08:39:53.796452 10817 tablet_bootstrap.cc:492] T 47de116b4469451798470de96bb9ce3d P c1f06a2bafbd4671a278a40cbdd9786f: No bootstrap required, opened a new log
I20260807 08:39:53.796522 10817 ts_tablet_manager.cc:1397] T 47de116b4469451798470de96bb9ce3d P c1f06a2bafbd4671a278a40cbdd9786f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 08:39:53.796550 10843 ts_tablet_manager.cc:1918] T 7c9d4824d6fa4a57986e3f20fb740525 P 8129cd08812d441caeb89b1ea8e458c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:39:53.796628 10843 log.cc:1196] T 7c9d4824d6fa4a57986e3f20fb740525 P 8129cd08812d441caeb89b1ea8e458c2: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-0/wal/wals/7c9d4824d6fa4a57986e3f20fb740525
I20260807 08:39:53.796715 10410 tablet_service.cc:1467] Processing CreateTablet for tablet 47de116b4469451798470de96bb9ce3d (DEFAULT_TABLE table=test-table [id=fa503481b34f4b1e82d96b36015d4681]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:39:53.796911 10843 ts_tablet_manager.cc:1939] T 7c9d4824d6fa4a57986e3f20fb740525 P 8129cd08812d441caeb89b1ea8e458c2: Deleting consensus metadata
I20260807 08:39:53.796931 10410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47de116b4469451798470de96bb9ce3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:53.797011 10817 raft_consensus.cc:348] T 47de116b4469451798470de96bb9ce3d P c1f06a2bafbd4671a278a40cbdd9786f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } }
I20260807 08:39:53.797103 10817 raft_consensus.cc:374] T 47de116b4469451798470de96bb9ce3d P c1f06a2bafbd4671a278a40cbdd9786f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:53.797130 10817 raft_consensus.cc:729] T 47de116b4469451798470de96bb9ce3d P c1f06a2bafbd4671a278a40cbdd9786f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1f06a2bafbd4671a278a40cbdd9786f, State: Initialized, Role: FOLLOWER
I20260807 08:39:53.797163 10816 tablet_bootstrap.cc:654] T 47de116b4469451798470de96bb9ce3d P f43089391d264e1cb5c9e19bc98f8747: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:53.797231 10817 consensus_queue.cc:260] T 47de116b4469451798470de96bb9ce3d P c1f06a2bafbd4671a278a40cbdd9786f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } }
I20260807 08:39:53.797462 10817 ts_tablet_manager.cc:1428] T 47de116b4469451798470de96bb9ce3d P c1f06a2bafbd4671a278a40cbdd9786f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 08:39:53.797729 10242 catalog_manager.cc:4841] TS c1f06a2bafbd4671a278a40cbdd9786f (127.8.208.195:34239): tablet 7c9d4824d6fa4a57986e3f20fb740525 (table test-table [id=823b81720cdc443f9f5f0d113c2982b1]) successfully deleted
I20260807 08:39:53.798426 10841 ts_tablet_manager.cc:1918] T 7c9d4824d6fa4a57986e3f20fb740525 P f43089391d264e1cb5c9e19bc98f8747: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:39:53.798470 10243 catalog_manager.cc:4841] TS 8129cd08812d441caeb89b1ea8e458c2 (127.8.208.193:43317): tablet 7c9d4824d6fa4a57986e3f20fb740525 (table test-table [id=823b81720cdc443f9f5f0d113c2982b1]) successfully deleted
I20260807 08:39:53.798604 10841 log.cc:1196] T 7c9d4824d6fa4a57986e3f20fb740525 P f43089391d264e1cb5c9e19bc98f8747: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-1/wal/wals/7c9d4824d6fa4a57986e3f20fb740525
I20260807 08:39:53.799014 10818 tablet_bootstrap.cc:492] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2: Bootstrap starting.
I20260807 08:39:53.799630 10841 ts_tablet_manager.cc:1939] T 7c9d4824d6fa4a57986e3f20fb740525 P f43089391d264e1cb5c9e19bc98f8747: Deleting consensus metadata
I20260807 08:39:53.799945 10818 tablet_bootstrap.cc:654] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:53.800879 10243 catalog_manager.cc:4841] TS f43089391d264e1cb5c9e19bc98f8747 (127.8.208.194:39047): tablet 7c9d4824d6fa4a57986e3f20fb740525 (table test-table [id=823b81720cdc443f9f5f0d113c2982b1]) successfully deleted
I20260807 08:39:53.801117 10818 tablet_bootstrap.cc:492] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2: No bootstrap required, opened a new log
I20260807 08:39:53.801216 10818 ts_tablet_manager.cc:1397] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 08:39:53.801420 10816 tablet_bootstrap.cc:492] T 47de116b4469451798470de96bb9ce3d P f43089391d264e1cb5c9e19bc98f8747: No bootstrap required, opened a new log
I20260807 08:39:53.801486 10816 ts_tablet_manager.cc:1397] T 47de116b4469451798470de96bb9ce3d P f43089391d264e1cb5c9e19bc98f8747: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260807 08:39:53.801878 10816 raft_consensus.cc:348] T 47de116b4469451798470de96bb9ce3d P f43089391d264e1cb5c9e19bc98f8747 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } }
I20260807 08:39:53.801975 10816 raft_consensus.cc:374] T 47de116b4469451798470de96bb9ce3d P f43089391d264e1cb5c9e19bc98f8747 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:53.801931 10818 raft_consensus.cc:348] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } }
I20260807 08:39:53.802002 10816 raft_consensus.cc:729] T 47de116b4469451798470de96bb9ce3d P f43089391d264e1cb5c9e19bc98f8747 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f43089391d264e1cb5c9e19bc98f8747, State: Initialized, Role: FOLLOWER
I20260807 08:39:53.802038 10818 raft_consensus.cc:374] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:53.802075 10818 raft_consensus.cc:729] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8129cd08812d441caeb89b1ea8e458c2, State: Initialized, Role: FOLLOWER
I20260807 08:39:53.802099 10816 consensus_queue.cc:260] T 47de116b4469451798470de96bb9ce3d P f43089391d264e1cb5c9e19bc98f8747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } }
I20260807 08:39:53.802224 10818 consensus_queue.cc:260] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } }
I20260807 08:39:53.802305 10816 ts_tablet_manager.cc:1428] T 47de116b4469451798470de96bb9ce3d P f43089391d264e1cb5c9e19bc98f8747: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 08:39:53.802609 10818 ts_tablet_manager.cc:1428] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
W20260807 08:39:53.865267 10793 tablet.cc:2369] T 47de116b4469451798470de96bb9ce3d P c1f06a2bafbd4671a278a40cbdd9786f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 08:39:53.906102 10640 tablet.cc:2369] T 47de116b4469451798470de96bb9ce3d P f43089391d264e1cb5c9e19bc98f8747: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 08:39:53.914862 10824 raft_consensus.cc:482] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:39:53.914999 10824 raft_consensus.cc:504] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } }
I20260807 08:39:53.916231 10824 leader_election.cc:288] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f43089391d264e1cb5c9e19bc98f8747 (127.8.208.194:39047), c1f06a2bafbd4671a278a40cbdd9786f (127.8.208.195:34239)
I20260807 08:39:53.920946 10810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.917035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:48727 (local address 127.8.208.195:34239)
0807 08:39:53.917152 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:53.917156 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:53.917170 (+ 14us) server_negotiation.cc:407] Connection header received
0807 08:39:53.917220 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:53.917222 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:53.917267 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:53.917353 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:39:53.917742 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.918516 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.919885 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.920359 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.920515 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.920571 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:53.920747 (+ 176us) server_negotiation.cc:299] Negotiation successful
0807 08:39:53.920820 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 08:39:53.920970 10848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.916608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:34239 (local address 127.8.208.193:48727)
0807 08:39:53.916987 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:53.916999 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:53.917077 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:53.917392 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:53.917395 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:53.917416 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:39:53.917567 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.917574 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.918813 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.918815 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.919764 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.919773 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.920516 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.920519 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.920621 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.920639 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 08:39:53.920719 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 08:39:53.920800 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"mutex_wait_us":22,"thread_start_us":124,"threads_started":1}
I20260807 08:39:53.921396 10815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.917167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:46589 (local address 127.8.208.194:39047)
0807 08:39:53.917304 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:53.917307 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:53.917338 (+ 31us) server_negotiation.cc:407] Connection header received
0807 08:39:53.917403 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:53.917405 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:53.917445 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:53.917513 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:39:53.917939 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.918582 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.920195 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.920758 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.920864 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.920906 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:53.921207 (+ 301us) server_negotiation.cc:299] Negotiation successful
0807 08:39:53.921278 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 08:39:53.921504 10744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47de116b4469451798470de96bb9ce3d" candidate_uuid: "8129cd08812d441caeb89b1ea8e458c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" is_pre_election: true
I20260807 08:39:53.921702 10847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.916467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:39047 (local address 127.8.208.193:46589)
0807 08:39:53.916857 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:53.916873 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:53.916974 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:53.917635 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:53.917640 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:53.917657 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:39:53.917781 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.917786 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.918699 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.918702 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.920049 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.920058 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.920990 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.920993 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.921099 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.921117 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 08:39:53.921514 (+ 397us) client_negotiation.cc:240] Negotiation successful
0807 08:39:53.921579 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"mutex_wait_us":45,"thread_start_us":67,"threads_started":1}
I20260807 08:39:53.921708 10744 raft_consensus.cc:2454] T 47de116b4469451798470de96bb9ce3d P c1f06a2bafbd4671a278a40cbdd9786f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8129cd08812d441caeb89b1ea8e458c2 in term 0.
I20260807 08:39:53.922107 10359 leader_election.cc:302] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8129cd08812d441caeb89b1ea8e458c2, c1f06a2bafbd4671a278a40cbdd9786f; no voters:
I20260807 08:39:53.922138 10590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47de116b4469451798470de96bb9ce3d" candidate_uuid: "8129cd08812d441caeb89b1ea8e458c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f43089391d264e1cb5c9e19bc98f8747" is_pre_election: true
I20260807 08:39:53.922255 10590 raft_consensus.cc:2454] T 47de116b4469451798470de96bb9ce3d P f43089391d264e1cb5c9e19bc98f8747 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8129cd08812d441caeb89b1ea8e458c2 in term 0.
I20260807 08:39:53.922426 10824 raft_consensus.cc:2781] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:39:53.922505 10824 raft_consensus.cc:482] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:39:53.922569 10824 raft_consensus.cc:3037] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:53.923753 10824 raft_consensus.cc:504] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } }
I20260807 08:39:53.924124 10824 leader_election.cc:288] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2 [CANDIDATE]: Term 1 election: Requested vote from peers f43089391d264e1cb5c9e19bc98f8747 (127.8.208.194:39047), c1f06a2bafbd4671a278a40cbdd9786f (127.8.208.195:34239)
I20260807 08:39:53.924431 10590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47de116b4469451798470de96bb9ce3d" candidate_uuid: "8129cd08812d441caeb89b1ea8e458c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f43089391d264e1cb5c9e19bc98f8747"
I20260807 08:39:53.924500 10744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47de116b4469451798470de96bb9ce3d" candidate_uuid: "8129cd08812d441caeb89b1ea8e458c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f06a2bafbd4671a278a40cbdd9786f"
I20260807 08:39:53.924549 10590 raft_consensus.cc:3037] T 47de116b4469451798470de96bb9ce3d P f43089391d264e1cb5c9e19bc98f8747 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:53.924638 10744 raft_consensus.cc:3037] T 47de116b4469451798470de96bb9ce3d P c1f06a2bafbd4671a278a40cbdd9786f [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:53.925658 10744 raft_consensus.cc:2454] T 47de116b4469451798470de96bb9ce3d P c1f06a2bafbd4671a278a40cbdd9786f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8129cd08812d441caeb89b1ea8e458c2 in term 1.
I20260807 08:39:53.925658 10590 raft_consensus.cc:2454] T 47de116b4469451798470de96bb9ce3d P f43089391d264e1cb5c9e19bc98f8747 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8129cd08812d441caeb89b1ea8e458c2 in term 1.
I20260807 08:39:53.925967 10360 leader_election.cc:302] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8129cd08812d441caeb89b1ea8e458c2, f43089391d264e1cb5c9e19bc98f8747; no voters:
I20260807 08:39:53.926158 10824 raft_consensus.cc:2781] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:39:53.926437 10824 raft_consensus.cc:686] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2 [term 1 LEADER]: Becoming Leader. State: Replica: 8129cd08812d441caeb89b1ea8e458c2, State: Running, Role: LEADER
I20260807 08:39:53.926673 10824 consensus_queue.cc:237] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } }
I20260807 08:39:53.928779 10257 catalog_manager.cc:5495] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8129cd08812d441caeb89b1ea8e458c2 (127.8.208.193). New cstate: current_term: 1 leader_uuid: "8129cd08812d441caeb89b1ea8e458c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } health_report { overall_health: UNKNOWN } } }
W20260807 08:39:53.940375 10485 tablet.cc:2369] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 08:39:53 dist-test-slave-6nmv krb5kdc[10207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091992, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:39:53.982971 10857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.975262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:46883 (local address 127.0.0.1:48852)
0807 08:39:53.975698 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:53.975718 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:53.975834 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:53.976090 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:53.976093 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:53.976477 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:39:53.976577 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.976583 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.977259 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.977264 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.977810 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:53.977835 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.978272 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.978275 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:53.978355 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.978869 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:39:53.978880 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:39:53.980138 (+ 1258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:39:53.981478 (+ 1340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:53.981488 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:53.981494 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:53.981699 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:53.981991 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:53.981994 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:53.981996 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:53.982071 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:53.982435 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:39:53.982443 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:39:53.982547 (+ 104us) client_negotiation.cc:769] Sending connection context
0807 08:39:53.982652 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 08:39:53.982794 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":124,"threads_started":1}
I20260807 08:39:53.982971 10313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:53.975399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48852 (local address 127.8.208.254:46883)
0807 08:39:53.975657 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:53.975662 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:53.975795 (+ 133us) server_negotiation.cc:407] Connection header received
0807 08:39:53.975951 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:53.975958 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:53.975993 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:53.976073 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:53.976692 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.977160 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.977964 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:53.978168 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:53.978272 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:53.980258 (+ 1986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:53.980262 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:53.980266 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:53.980290 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:53.981376 (+ 1086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:53.981789 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:53.981793 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:53.981795 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:53.981904 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:53.982154 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:53.982157 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:53.982158 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:53.982327 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:53.982429 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:53.982703 (+ 274us) server_negotiation.cc:299] Negotiation successful
0807 08:39:53.982845 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":55,"server-negotiator.queue_time_us":174}
I20260807 08:39:53.986799 10257 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:48852:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 08:39:53.987635 10257 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:39:53.992322 10566 tablet_service.cc:1467] Processing CreateTablet for tablet 2e16c93c96c44f3687ec6ed030de7790 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f9926999aa684ca28c8b6d244ecce658]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 08:39:53.992456 10721 tablet_service.cc:1467] Processing CreateTablet for tablet 2e16c93c96c44f3687ec6ed030de7790 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f9926999aa684ca28c8b6d244ecce658]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 08:39:53.992777 10566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e16c93c96c44f3687ec6ed030de7790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:53.992862 10721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e16c93c96c44f3687ec6ed030de7790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:53.992321 10410 tablet_service.cc:1467] Processing CreateTablet for tablet 2e16c93c96c44f3687ec6ed030de7790 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f9926999aa684ca28c8b6d244ecce658]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 08:39:53.994688 10410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e16c93c96c44f3687ec6ed030de7790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:53.995232 10817 tablet_bootstrap.cc:492] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f: Bootstrap starting.
I20260807 08:39:53.995535 10816 tablet_bootstrap.cc:492] T 2e16c93c96c44f3687ec6ed030de7790 P f43089391d264e1cb5c9e19bc98f8747: Bootstrap starting.
I20260807 08:39:53.996021 10817 tablet_bootstrap.cc:654] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:53.996526 10816 tablet_bootstrap.cc:654] T 2e16c93c96c44f3687ec6ed030de7790 P f43089391d264e1cb5c9e19bc98f8747: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:53.996978 10817 tablet_bootstrap.cc:492] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f: No bootstrap required, opened a new log
I20260807 08:39:53.997079 10817 ts_tablet_manager.cc:1397] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 08:39:53.997525 10817 raft_consensus.cc:348] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } }
I20260807 08:39:53.997637 10817 raft_consensus.cc:374] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:53.997671 10817 raft_consensus.cc:729] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1f06a2bafbd4671a278a40cbdd9786f, State: Initialized, Role: FOLLOWER
I20260807 08:39:53.997691 10818 tablet_bootstrap.cc:492] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2: Bootstrap starting.
I20260807 08:39:53.997786 10817 consensus_queue.cc:260] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } }
I20260807 08:39:53.997916 10816 tablet_bootstrap.cc:492] T 2e16c93c96c44f3687ec6ed030de7790 P f43089391d264e1cb5c9e19bc98f8747: No bootstrap required, opened a new log
I20260807 08:39:53.998030 10816 ts_tablet_manager.cc:1397] T 2e16c93c96c44f3687ec6ed030de7790 P f43089391d264e1cb5c9e19bc98f8747: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 08:39:53.998121 10817 ts_tablet_manager.cc:1428] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 08:39:53.998162 10827 tablet_replica.cc:439] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } } }
I20260807 08:39:53.998308 10827 tablet_replica.cc:442] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 08:39:53.998520 10816 raft_consensus.cc:348] T 2e16c93c96c44f3687ec6ed030de7790 P f43089391d264e1cb5c9e19bc98f8747 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } }
I20260807 08:39:53.998631 10816 raft_consensus.cc:374] T 2e16c93c96c44f3687ec6ed030de7790 P f43089391d264e1cb5c9e19bc98f8747 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:53.998673 10816 raft_consensus.cc:729] T 2e16c93c96c44f3687ec6ed030de7790 P f43089391d264e1cb5c9e19bc98f8747 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f43089391d264e1cb5c9e19bc98f8747, State: Initialized, Role: FOLLOWER
I20260807 08:39:53.998682 10818 tablet_bootstrap.cc:654] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:53.998802 10816 consensus_queue.cc:260] T 2e16c93c96c44f3687ec6ed030de7790 P f43089391d264e1cb5c9e19bc98f8747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } }
I20260807 08:39:53.999035 10823 tablet_replica.cc:439] T 2e16c93c96c44f3687ec6ed030de7790 P f43089391d264e1cb5c9e19bc98f8747: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } } }
I20260807 08:39:53.999109 10816 ts_tablet_manager.cc:1428] T 2e16c93c96c44f3687ec6ed030de7790 P f43089391d264e1cb5c9e19bc98f8747: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 08:39:53.999157 10823 tablet_replica.cc:442] T 2e16c93c96c44f3687ec6ed030de7790 P f43089391d264e1cb5c9e19bc98f8747: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 08:39:54.000317 10818 tablet_bootstrap.cc:492] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2: No bootstrap required, opened a new log
I20260807 08:39:54.000414 10818 ts_tablet_manager.cc:1397] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 08:39:54.000756 10818 raft_consensus.cc:348] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } }
I20260807 08:39:54.000837 10818 raft_consensus.cc:374] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:54.000857 10818 raft_consensus.cc:729] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8129cd08812d441caeb89b1ea8e458c2, State: Initialized, Role: FOLLOWER
I20260807 08:39:54.000983 10818 consensus_queue.cc:260] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } }
I20260807 08:39:54.001231 10818 ts_tablet_manager.cc:1428] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 08:39:54.001180 10824 tablet_replica.cc:439] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } } }
I20260807 08:39:54.001320 10824 tablet_replica.cc:442] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 08:39:54.037856 10824 raft_consensus.cc:482] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:39:54.037994 10824 raft_consensus.cc:504] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } }
I20260807 08:39:54.038237 10827 raft_consensus.cc:482] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:39:54.038344 10827 raft_consensus.cc:504] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } }
I20260807 08:39:54.038427 10824 leader_election.cc:288] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f43089391d264e1cb5c9e19bc98f8747 (127.8.208.194:39047), c1f06a2bafbd4671a278a40cbdd9786f (127.8.208.195:34239)
I20260807 08:39:54.038734 10827 leader_election.cc:288] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8129cd08812d441caeb89b1ea8e458c2 (127.8.208.193:43317), f43089391d264e1cb5c9e19bc98f8747 (127.8.208.194:39047)
I20260807 08:39:54.038771 10744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e16c93c96c44f3687ec6ed030de7790" candidate_uuid: "8129cd08812d441caeb89b1ea8e458c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" is_pre_election: true
I20260807 08:39:54.038790 10590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e16c93c96c44f3687ec6ed030de7790" candidate_uuid: "8129cd08812d441caeb89b1ea8e458c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f43089391d264e1cb5c9e19bc98f8747" is_pre_election: true
I20260807 08:39:54.038874 10744 raft_consensus.cc:2454] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8129cd08812d441caeb89b1ea8e458c2 in term 0.
I20260807 08:39:54.038959 10590 raft_consensus.cc:2454] T 2e16c93c96c44f3687ec6ed030de7790 P f43089391d264e1cb5c9e19bc98f8747 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8129cd08812d441caeb89b1ea8e458c2 in term 0.
I20260807 08:39:54.039155 10359 leader_election.cc:302] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8129cd08812d441caeb89b1ea8e458c2, c1f06a2bafbd4671a278a40cbdd9786f; no voters:
I20260807 08:39:54.039167 10589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e16c93c96c44f3687ec6ed030de7790" candidate_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f43089391d264e1cb5c9e19bc98f8747" is_pre_election: true
I20260807 08:39:54.039275 10589 raft_consensus.cc:2454] T 2e16c93c96c44f3687ec6ed030de7790 P f43089391d264e1cb5c9e19bc98f8747 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1f06a2bafbd4671a278a40cbdd9786f in term 0.
I20260807 08:39:54.039314 10434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e16c93c96c44f3687ec6ed030de7790" candidate_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8129cd08812d441caeb89b1ea8e458c2" is_pre_election: true
I20260807 08:39:54.039397 10824 raft_consensus.cc:2781] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:39:54.039477 10434 raft_consensus.cc:2454] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1f06a2bafbd4671a278a40cbdd9786f in term 0.
I20260807 08:39:54.039533 10824 raft_consensus.cc:482] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:39:54.039578 10824 raft_consensus.cc:3037] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:54.039573 10667 leader_election.cc:302] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1f06a2bafbd4671a278a40cbdd9786f, f43089391d264e1cb5c9e19bc98f8747; no voters:
I20260807 08:39:54.039737 10827 raft_consensus.cc:2781] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:39:54.039812 10827 raft_consensus.cc:482] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:39:54.039860 10827 raft_consensus.cc:3037] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:54.040517 10824 raft_consensus.cc:504] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } }
I20260807 08:39:54.040757 10827 raft_consensus.cc:504] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } }
I20260807 08:39:54.040868 10824 leader_election.cc:288] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2 [CANDIDATE]: Term 1 election: Requested vote from peers f43089391d264e1cb5c9e19bc98f8747 (127.8.208.194:39047), c1f06a2bafbd4671a278a40cbdd9786f (127.8.208.195:34239)
I20260807 08:39:54.041075 10827 leader_election.cc:288] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f [CANDIDATE]: Term 1 election: Requested vote from peers 8129cd08812d441caeb89b1ea8e458c2 (127.8.208.193:43317), f43089391d264e1cb5c9e19bc98f8747 (127.8.208.194:39047)
I20260807 08:39:54.041134 10589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e16c93c96c44f3687ec6ed030de7790" candidate_uuid: "8129cd08812d441caeb89b1ea8e458c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f43089391d264e1cb5c9e19bc98f8747"
I20260807 08:39:54.041240 10589 raft_consensus.cc:3037] T 2e16c93c96c44f3687ec6ed030de7790 P f43089391d264e1cb5c9e19bc98f8747 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:54.041249 10744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e16c93c96c44f3687ec6ed030de7790" candidate_uuid: "8129cd08812d441caeb89b1ea8e458c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f06a2bafbd4671a278a40cbdd9786f"
I20260807 08:39:54.041404 10744 raft_consensus.cc:2379] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8129cd08812d441caeb89b1ea8e458c2 in current term 1: Already voted for candidate c1f06a2bafbd4671a278a40cbdd9786f in this term.
I20260807 08:39:54.041453 10434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e16c93c96c44f3687ec6ed030de7790" candidate_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8129cd08812d441caeb89b1ea8e458c2"
I20260807 08:39:54.041530 10590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e16c93c96c44f3687ec6ed030de7790" candidate_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f43089391d264e1cb5c9e19bc98f8747"
I20260807 08:39:54.041586 10434 raft_consensus.cc:2379] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c1f06a2bafbd4671a278a40cbdd9786f in current term 1: Already voted for candidate 8129cd08812d441caeb89b1ea8e458c2 in this term.
I20260807 08:39:54.041918 10667 leader_election.cc:302] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1f06a2bafbd4671a278a40cbdd9786f; no voters: 8129cd08812d441caeb89b1ea8e458c2, f43089391d264e1cb5c9e19bc98f8747
I20260807 08:39:54.042112 10827 raft_consensus.cc:2726] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 08:39:54.042501 10589 raft_consensus.cc:2454] T 2e16c93c96c44f3687ec6ed030de7790 P f43089391d264e1cb5c9e19bc98f8747 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8129cd08812d441caeb89b1ea8e458c2 in term 1.
I20260807 08:39:54.042830 10360 leader_election.cc:302] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8129cd08812d441caeb89b1ea8e458c2, f43089391d264e1cb5c9e19bc98f8747; no voters: c1f06a2bafbd4671a278a40cbdd9786f
I20260807 08:39:54.043004 10824 raft_consensus.cc:2781] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:39:54.043084 10824 raft_consensus.cc:686] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2 [term 1 LEADER]: Becoming Leader. State: Replica: 8129cd08812d441caeb89b1ea8e458c2, State: Running, Role: LEADER
I20260807 08:39:54.043223 10824 consensus_queue.cc:237] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } }
I20260807 08:39:54.044142 10849 tablet_replica.cc:439] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2: TxnStatusTablet state changed. Reason: New leader 8129cd08812d441caeb89b1ea8e458c2. Latest consensus state: current_term: 1 leader_uuid: "8129cd08812d441caeb89b1ea8e458c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } } }
I20260807 08:39:54.044261 10849 tablet_replica.cc:442] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2: This TxnStatusTablet replica's current role is: LEADER
I20260807 08:39:54.044647 10863 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 08:39:54.044843 10863 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 08:39:54.044818 10256 catalog_manager.cc:5495] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8129cd08812d441caeb89b1ea8e458c2 (127.8.208.193). New cstate: current_term: 1 leader_uuid: "8129cd08812d441caeb89b1ea8e458c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } health_report { overall_health: UNKNOWN } } }
I20260807 08:39:54.066224 10857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:54.062371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:43317 (local address 127.0.0.1:35158)
0807 08:39:54.062531 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:54.062548 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:54.062641 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:54.063096 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:54.063099 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:54.063107 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 08:39:54.063229 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:54.063234 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:54.064162 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:54.064166 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:54.064743 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:54.064750 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:54.065216 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:54.065219 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:54.065297 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:54.065353 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 08:39:54.065959 (+ 606us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 08:39:54.065973 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 08:39:54.066039 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 08:39:54.066116 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260807 08:39:54.066226 10814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:54.062766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35158 (local address 127.8.208.193:43317)
0807 08:39:54.062873 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:54.062877 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:54.062894 (+ 17us) server_negotiation.cc:407] Connection header received
0807 08:39:54.062944 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:54.062946 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:54.062986 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:54.063082 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:39:54.063339 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:54.064047 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:54.064853 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:54.065112 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:54.065203 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:54.065484 (+ 281us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:39:54.065868 (+ 384us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:39:54.065969 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:54.066048 (+ 79us) server_negotiation.cc:299] Negotiation successful
0807 08:39:54.066092 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 08:39:54.068481 10589 raft_consensus.cc:1261] T 2e16c93c96c44f3687ec6ed030de7790 P f43089391d264e1cb5c9e19bc98f8747 [term 1 FOLLOWER]: Refusing update from remote peer 8129cd08812d441caeb89b1ea8e458c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:39:54.068910 10744 raft_consensus.cc:1261] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f [term 1 FOLLOWER]: Refusing update from remote peer 8129cd08812d441caeb89b1ea8e458c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:39:54.068868 10824 consensus_queue.cc:1035] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:39:54.069322 10849 consensus_queue.cc:1035] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:39:54.070250 10823 tablet_replica.cc:439] T 2e16c93c96c44f3687ec6ed030de7790 P f43089391d264e1cb5c9e19bc98f8747: TxnStatusTablet state changed. Reason: New leader 8129cd08812d441caeb89b1ea8e458c2. Latest consensus state: current_term: 1 leader_uuid: "8129cd08812d441caeb89b1ea8e458c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } } }
I20260807 08:39:54.070344 10823 tablet_replica.cc:442] T 2e16c93c96c44f3687ec6ed030de7790 P f43089391d264e1cb5c9e19bc98f8747: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 08:39:54.071457 10827 tablet_replica.cc:439] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f: TxnStatusTablet state changed. Reason: New leader 8129cd08812d441caeb89b1ea8e458c2. Latest consensus state: current_term: 1 leader_uuid: "8129cd08812d441caeb89b1ea8e458c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } } }
I20260807 08:39:54.071583 10827 tablet_replica.cc:442] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 08:39:54.072583 10849 tablet_replica.cc:439] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8129cd08812d441caeb89b1ea8e458c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } } }
I20260807 08:39:54.072687 10849 tablet_replica.cc:442] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2: This TxnStatusTablet replica's current role is: LEADER
I20260807 08:39:54.072844 10823 tablet_replica.cc:439] T 2e16c93c96c44f3687ec6ed030de7790 P f43089391d264e1cb5c9e19bc98f8747: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8129cd08812d441caeb89b1ea8e458c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } } }
I20260807 08:39:54.072938 10823 tablet_replica.cc:442] T 2e16c93c96c44f3687ec6ed030de7790 P f43089391d264e1cb5c9e19bc98f8747: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 08:39:54.074115 10824 tablet_replica.cc:439] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8129cd08812d441caeb89b1ea8e458c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } } }
I20260807 08:39:54.074216 10824 tablet_replica.cc:442] T 2e16c93c96c44f3687ec6ed030de7790 P 8129cd08812d441caeb89b1ea8e458c2: This TxnStatusTablet replica's current role is: LEADER
I20260807 08:39:54.077265 10827 tablet_replica.cc:439] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8129cd08812d441caeb89b1ea8e458c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8129cd08812d441caeb89b1ea8e458c2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43317 } } peers { permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 } } peers { permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 } } }
I20260807 08:39:54.077394 10827 tablet_replica.cc:442] T 2e16c93c96c44f3687ec6ed030de7790 P c1f06a2bafbd4671a278a40cbdd9786f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 08:39:54.081946 10814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:54.078610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35164 (local address 127.8.208.193:43317)
0807 08:39:54.078715 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:54.078723 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:54.078742 (+ 19us) server_negotiation.cc:407] Connection header received
0807 08:39:54.078889 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:54.078892 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:54.078936 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:54.078994 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:39:54.079316 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:54.079848 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:54.080967 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:54.081160 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:54.081244 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:54.081507 (+ 263us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:39:54.081568 (+ 61us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:39:54.081625 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:54.081732 (+ 107us) server_negotiation.cc:299] Negotiation successful
0807 08:39:54.081771 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 08:39:54.092132 10870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:54.088770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:43317 (local address 127.8.208.193:49399)
0807 08:39:54.089033 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:54.089045 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:54.089125 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:54.089297 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:54.089299 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:54.089304 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 08:39:54.089616 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:54.089620 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:54.090437 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:54.090439 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:54.090993 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:54.091000 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:54.091491 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:54.091493 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:54.091573 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:54.091617 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 08:39:54.091890 (+ 273us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 08:39:54.091895 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 08:39:54.091944 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 08:39:54.092007 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"mutex_wait_us":8,"thread_start_us":99,"threads_started":1}
I20260807 08:39:54.092136 10814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:54.088845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:49399 (local address 127.8.208.193:43317)
0807 08:39:54.088943 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:54.088947 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:54.089111 (+ 164us) server_negotiation.cc:407] Connection header received
0807 08:39:54.089179 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:54.089182 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:54.089219 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:54.089285 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:39:54.089702 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:54.090346 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:54.091095 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:54.091395 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:54.091484 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:54.091744 (+ 260us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:39:54.091811 (+ 67us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:39:54.091881 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:54.091954 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 08:39:54.092009 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":40}
I20260807 08:39:54.098148 10744 raft_consensus.cc:1261] T 47de116b4469451798470de96bb9ce3d P c1f06a2bafbd4671a278a40cbdd9786f [term 1 FOLLOWER]: Refusing update from remote peer 8129cd08812d441caeb89b1ea8e458c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:39:54.098268 10589 raft_consensus.cc:1261] T 47de116b4469451798470de96bb9ce3d P f43089391d264e1cb5c9e19bc98f8747 [term 1 FOLLOWER]: Refusing update from remote peer 8129cd08812d441caeb89b1ea8e458c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:39:54.098666 10871 consensus_queue.cc:1035] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1f06a2bafbd4671a278a40cbdd9786f" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:39:54.098798 10849 consensus_queue.cc:1035] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f43089391d264e1cb5c9e19bc98f8747" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:39:54.134369 10258 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:39:54.134539 10258 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:39:54.136219 10258 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ee32f0a4eae74a0a88225ad3d7be8f4a: Sending DeleteTablet for 3 replicas of tablet 47de116b4469451798470de96bb9ce3d
I20260807 08:39:54.136649 10410 tablet_service.cc:1514] Processing DeleteTablet for tablet 47de116b4469451798470de96bb9ce3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:39:54 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:35144
I20260807 08:39:54.136726 10566 tablet_service.cc:1514] Processing DeleteTablet for tablet 47de116b4469451798470de96bb9ce3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:39:54 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:46574
I20260807 08:39:54.136792 10843 tablet_replica.cc:330] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2: stopping tablet replica
I20260807 08:39:54.136830 10721 tablet_service.cc:1514] Processing DeleteTablet for tablet 47de116b4469451798470de96bb9ce3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:39:54 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:36100
I20260807 08:39:54.136878 10843 raft_consensus.cc:2229] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2 [term 1 LEADER]: Raft consensus shutting down.
I20260807 08:39:54.136989 10842 tablet_replica.cc:330] T 47de116b4469451798470de96bb9ce3d P c1f06a2bafbd4671a278a40cbdd9786f: stopping tablet replica
I20260807 08:39:54.137072 10843 raft_consensus.cc:2258] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:39:54.137106 10842 raft_consensus.cc:2229] T 47de116b4469451798470de96bb9ce3d P c1f06a2bafbd4671a278a40cbdd9786f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:39:54.137205 10842 raft_consensus.cc:2258] T 47de116b4469451798470de96bb9ce3d P c1f06a2bafbd4671a278a40cbdd9786f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:39:54.137225 10841 tablet_replica.cc:330] T 47de116b4469451798470de96bb9ce3d P f43089391d264e1cb5c9e19bc98f8747: stopping tablet replica
I20260807 08:39:54.137318 10841 raft_consensus.cc:2229] T 47de116b4469451798470de96bb9ce3d P f43089391d264e1cb5c9e19bc98f8747 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:39:54.137404 10841 raft_consensus.cc:2258] T 47de116b4469451798470de96bb9ce3d P f43089391d264e1cb5c9e19bc98f8747 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:39:54.137765 10842 ts_tablet_manager.cc:1905] T 47de116b4469451798470de96bb9ce3d P c1f06a2bafbd4671a278a40cbdd9786f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:39:54.138134 10841 ts_tablet_manager.cc:1905] T 47de116b4469451798470de96bb9ce3d P f43089391d264e1cb5c9e19bc98f8747: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:39:54.140396 10842 ts_tablet_manager.cc:1918] T 47de116b4469451798470de96bb9ce3d P c1f06a2bafbd4671a278a40cbdd9786f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 08:39:54.140467 10842 log.cc:1196] T 47de116b4469451798470de96bb9ce3d P c1f06a2bafbd4671a278a40cbdd9786f: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/47de116b4469451798470de96bb9ce3d
I20260807 08:39:54.140784 10842 ts_tablet_manager.cc:1939] T 47de116b4469451798470de96bb9ce3d P c1f06a2bafbd4671a278a40cbdd9786f: Deleting consensus metadata
I20260807 08:39:54.140877 10841 ts_tablet_manager.cc:1918] T 47de116b4469451798470de96bb9ce3d P f43089391d264e1cb5c9e19bc98f8747: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 08:39:54.140941 10841 log.cc:1196] T 47de116b4469451798470de96bb9ce3d P f43089391d264e1cb5c9e19bc98f8747: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-1/wal/wals/47de116b4469451798470de96bb9ce3d
I20260807 08:39:54.141429 10242 catalog_manager.cc:4841] TS c1f06a2bafbd4671a278a40cbdd9786f (127.8.208.195:34239): tablet 47de116b4469451798470de96bb9ce3d (table test-table [id=fa503481b34f4b1e82d96b36015d4681]) successfully deleted
I20260807 08:39:54.141741 10843 ts_tablet_manager.cc:1905] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:39:54.142208 10841 ts_tablet_manager.cc:1939] T 47de116b4469451798470de96bb9ce3d P f43089391d264e1cb5c9e19bc98f8747: Deleting consensus metadata
I20260807 08:39:54.142854 10243 catalog_manager.cc:4841] TS f43089391d264e1cb5c9e19bc98f8747 (127.8.208.194:39047): tablet 47de116b4469451798470de96bb9ce3d (table test-table [id=fa503481b34f4b1e82d96b36015d4681]) successfully deleted
I20260807 08:39:54.144338 10843 ts_tablet_manager.cc:1918] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 08:39:54.144472 10843 log.cc:1196] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786091987266300-9027-0/minicluster-data/ts-0/wal/wals/47de116b4469451798470de96bb9ce3d
I20260807 08:39:54.144748 10843 ts_tablet_manager.cc:1939] T 47de116b4469451798470de96bb9ce3d P 8129cd08812d441caeb89b1ea8e458c2: Deleting consensus metadata
I20260807 08:39:54.145314 10243 catalog_manager.cc:4841] TS 8129cd08812d441caeb89b1ea8e458c2 (127.8.208.193:43317): tablet 47de116b4469451798470de96bb9ce3d (table test-table [id=fa503481b34f4b1e82d96b36015d4681]) successfully deleted
Aug 07 08:39:54 dist-test-slave-6nmv krb5kdc[10207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091993, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.208.193@KRBTEST.COM
I20260807 08:39:54.151523 10814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:54.140439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35174 (local address 127.8.208.193:43317)
0807 08:39:54.140603 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:54.140609 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:54.140624 (+ 15us) server_negotiation.cc:407] Connection header received
0807 08:39:54.140665 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:54.140670 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:54.140736 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:54.140864 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:54.142133 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:54.142818 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:54.143723 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:54.143986 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:54.144098 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:54.147683 (+ 3585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:54.147691 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:54.147700 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:54.147719 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:54.149557 (+ 1838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:54.150061 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:54.150067 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:54.150069 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:54.150166 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:54.150486 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:54.150490 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:54.150492 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:54.150790 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:54.150993 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:54.151233 (+ 240us) server_negotiation.cc:299] Negotiation successful
0807 08:39:54.151375 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
W20260807 08:39:54.152170 10464 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35174
I20260807 08:39:54.161688 10313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:54.153950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48860 (local address 127.8.208.254:46883)
0807 08:39:54.154067 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:54.154071 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:54.154185 (+ 114us) server_negotiation.cc:407] Connection header received
0807 08:39:54.154271 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:54.154275 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:54.154322 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:54.154410 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:54.155082 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:54.155867 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:54.156562 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:54.156892 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:54.156996 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:54.158535 (+ 1539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:54.158559 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:54.158562 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:54.158592 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:54.160147 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:54.160535 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:54.160538 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:54.160540 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:54.160629 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:54.160873 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:54.160876 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:54.160878 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:54.161089 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:54.161217 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:54.161401 (+ 184us) server_negotiation.cc:299] Negotiation successful
0807 08:39:54.161525 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
W20260807 08:39:54.162120 10258 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48860
I20260807 08:39:54.163607 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 10341
I20260807 08:39:54.171651 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 10493
I20260807 08:39:54.177982 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 10648
I20260807 08:39:54.184984 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 10222
2026-08-07T08:39:54Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2563 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:39:54 dist-test-slave-6nmv krb5kdc[10882](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:39:54 dist-test-slave-6nmv krb5kdc[10882](info): set up 2 sockets
Aug 07 08:39:54 dist-test-slave-6nmv krb5kdc[10882](info): commencing operation
krb5kdc: starting...
W20260807 08:39:55.189695 9027 mini_kdc.cc:121] Time spent starting KDC: real 0.981s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:39:55 dist-test-slave-6nmv krb5kdc[10882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091995, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:39:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:39:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:39:55.308537 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:34107
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:43695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:34107
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:39:55.411791 10897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:39:55.412027 10897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:39:55.412098 10897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:39:55.416123 10897 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:39:55.416172 10897 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 08:39:55.416188 10897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:39:55.416225 10897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:39:55.416256 10897 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:39:55.416281 10897 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:39:55.422174 10897 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:43695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:34107
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:34107
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:39:55.423264 10897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:39:55.424291 10897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:39:55.432271 10903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:55.432291 10906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:55.432286 10904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:39:55.432448 10897 server_base.cc:1034] running on GCE node
I20260807 08:39:55.433094 10897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:39:55.434242 10897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:39:55.435426 10897 hybrid_clock.cc:648] HybridClock initialized: now 1786091995435410 us; error 29 us; skew 500 ppm
Aug 07 08:39:55 dist-test-slave-6nmv krb5kdc[10882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091995, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:39:55.437969 10897 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:39:55.438724 10897 webserver.cc:460] Webserver started at http://127.8.208.254:46239/ using document root <none> and password file <none>
I20260807 08:39:55.439230 10897 fs_manager.cc:359] Metadata directory not provided
I20260807 08:39:55.439313 10897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:39:55.439517 10897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:39:55.441285 10897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "7b2f1cb1b73a4a9bafa0b1e3a1612fe9"
format_stamp: "Formatted at 2026-08-07 08:39:55 on dist-test-slave-6nmv"
server_key: "d210d4037f382bcca9602d8396383615"
server_key_iv: "8e00d738f4a61251c4b662adf5853295"
server_key_version: "encryptionkey@0"
I20260807 08:39:55.441891 10897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "7b2f1cb1b73a4a9bafa0b1e3a1612fe9"
format_stamp: "Formatted at 2026-08-07 08:39:55 on dist-test-slave-6nmv"
server_key: "d210d4037f382bcca9602d8396383615"
server_key_iv: "8e00d738f4a61251c4b662adf5853295"
server_key_version: "encryptionkey@0"
I20260807 08:39:55.445349 10897 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 08:39:55.447504 10913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:55.448602 10897 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260807 08:39:55.448743 10897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "7b2f1cb1b73a4a9bafa0b1e3a1612fe9"
format_stamp: "Formatted at 2026-08-07 08:39:55 on dist-test-slave-6nmv"
server_key: "d210d4037f382bcca9602d8396383615"
server_key_iv: "8e00d738f4a61251c4b662adf5853295"
server_key_version: "encryptionkey@0"
I20260807 08:39:55.448844 10897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:39:55.465574 10897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:39:55.468058 10897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:39:55.468242 10897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:39:55.475629 10897 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:34107
I20260807 08:39:55.475653 10984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:34107 every 8 connection(s)
I20260807 08:39:55.476476 10897 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:39:55.479045 10985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:55.483999 10985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9: Bootstrap starting.
I20260807 08:39:55.484287 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 10897
I20260807 08:39:55.484406 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:39:55.484694 9027 external_mini_cluster.cc:1428] Setting key f83afe29551201e6834a07a9bc121c3f
I20260807 08:39:55.486464 10985 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:55.487108 10985 log.cc:824] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9: Log is configured to *not* fsync() on all Append() calls
I20260807 08:39:55.488967 10985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9: No bootstrap required, opened a new log
Aug 07 08:39:55 dist-test-slave-6nmv krb5kdc[10882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091995, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:39:55.493077 10985 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b2f1cb1b73a4a9bafa0b1e3a1612fe9" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 34107 } }
I20260807 08:39:55.493321 10985 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:55.493432 10985 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b2f1cb1b73a4a9bafa0b1e3a1612fe9, State: Initialized, Role: FOLLOWER
I20260807 08:39:55.493937 10985 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b2f1cb1b73a4a9bafa0b1e3a1612fe9" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 34107 } }
I20260807 08:39:55.494082 10985 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:39:55.494148 10985 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:39:55.494239 10985 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:55.495148 10985 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b2f1cb1b73a4a9bafa0b1e3a1612fe9" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 34107 } }
I20260807 08:39:55.495484 10985 leader_election.cc:302] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7b2f1cb1b73a4a9bafa0b1e3a1612fe9; no voters:
I20260807 08:39:55.495800 10985 leader_election.cc:288] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:39:55.495875 10990 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:39:55.496069 10990 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9 [term 1 LEADER]: Becoming Leader. State: Replica: 7b2f1cb1b73a4a9bafa0b1e3a1612fe9, State: Running, Role: LEADER
I20260807 08:39:55.496467 10990 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b2f1cb1b73a4a9bafa0b1e3a1612fe9" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 34107 } }
I20260807 08:39:55.497000 10985 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:39:55.498154 10991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7b2f1cb1b73a4a9bafa0b1e3a1612fe9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b2f1cb1b73a4a9bafa0b1e3a1612fe9" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 34107 } } }
I20260807 08:39:55.498265 10991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9 [sys.catalog]: This master's current role is: LEADER
I20260807 08:39:55.498615 10992 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b2f1cb1b73a4a9bafa0b1e3a1612fe9. Latest consensus state: current_term: 1 leader_uuid: "7b2f1cb1b73a4a9bafa0b1e3a1612fe9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b2f1cb1b73a4a9bafa0b1e3a1612fe9" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 34107 } } }
I20260807 08:39:55.498783 10992 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9 [sys.catalog]: This master's current role is: LEADER
I20260807 08:39:55.498831 10999 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:39:55.498602 10988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:55.485884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55840 (local address 127.8.208.254:34107)
0807 08:39:55.486286 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:55.486300 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:55.486330 (+ 30us) server_negotiation.cc:407] Connection header received
0807 08:39:55.486951 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:55.486969 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:55.487297 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:55.487625 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:55.488360 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:55.489222 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:55.490267 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:55.490672 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:55.490792 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:55.493355 (+ 2563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:55.493361 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:55.493398 (+ 37us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:55.493438 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:55.495260 (+ 1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:55.495721 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:55.495725 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:55.495729 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:55.495905 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:55.496256 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:55.496259 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:55.496260 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:55.496749 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:55.496950 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:55.497223 (+ 273us) server_negotiation.cc:299] Negotiation successful
0807 08:39:55.497672 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":137,"threads_started":1}
I20260807 08:39:55.501691 10999 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:39:55.506795 10999 catalog_manager.cc:1347] Generated new cluster ID: 41f8e42f1c3449f185fe6b8e5c980796
I20260807 08:39:55.506852 10999 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:39:55.525699 10999 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:39:55.526602 10999 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:39:55.533524 10999 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9: Generated new TSK 0
I20260807 08:39:55.534261 10999 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.208.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
I20260807 08:39:55.566854 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:34107
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:43695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:39:55.670445 11012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:39:55.670672 11012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:39:55.670742 11012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:39:55.674705 11012 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:39:55.674774 11012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:39:55.674836 11012 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 08:39:55.674881 11012 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 08:39:55.674945 11012 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:39:55.679541 11012 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:43695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.208.254:34107
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11012
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:39:55.680397 11012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:39:55.681263 11012 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:39:55.689759 11017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:55.689782 11018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:39:55.689967 11012 server_base.cc:1034] running on GCE node
W20260807 08:39:55.689836 11021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:39:55.690398 11012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:39:55.690948 11012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:39:55.692160 11012 hybrid_clock.cc:648] HybridClock initialized: now 1786091995692132 us; error 41 us; skew 500 ppm
Aug 07 08:39:55 dist-test-slave-6nmv krb5kdc[10882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091995, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:39:55.694877 11012 init.cc:377] Logged in from keytab as kudu/127.8.208.193@KRBTEST.COM (short username kudu)
I20260807 08:39:55.695590 11012 webserver.cc:460] Webserver started at http://127.8.208.193:36611/ using document root <none> and password file <none>
I20260807 08:39:55.696071 11012 fs_manager.cc:359] Metadata directory not provided
I20260807 08:39:55.696156 11012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:39:55.696359 11012 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:39:55.698271 11012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "08d766969a724484b9f56279645b6c1b"
format_stamp: "Formatted at 2026-08-07 08:39:55 on dist-test-slave-6nmv"
server_key: "afaddff5617d549baad4a4f87531bad5"
server_key_iv: "7e069d0e8f2e3f6fb2068aff7b6fd161"
server_key_version: "encryptionkey@0"
I20260807 08:39:55.698891 11012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "08d766969a724484b9f56279645b6c1b"
format_stamp: "Formatted at 2026-08-07 08:39:55 on dist-test-slave-6nmv"
server_key: "afaddff5617d549baad4a4f87531bad5"
server_key_iv: "7e069d0e8f2e3f6fb2068aff7b6fd161"
server_key_version: "encryptionkey@0"
I20260807 08:39:55.702086 11012 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 08:39:55.704386 11028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:55.705453 11012 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:39:55.705595 11012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "08d766969a724484b9f56279645b6c1b"
format_stamp: "Formatted at 2026-08-07 08:39:55 on dist-test-slave-6nmv"
server_key: "afaddff5617d549baad4a4f87531bad5"
server_key_iv: "7e069d0e8f2e3f6fb2068aff7b6fd161"
server_key_version: "encryptionkey@0"
I20260807 08:39:55.705694 11012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:39:55.725637 11012 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:39:55.728446 11012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:39:55.728621 11012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:39:55.729789 11012 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:39:55.729924 11012 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:55.729995 11012 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:39:55.730042 11012 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 08:39:55 dist-test-slave-6nmv krb5kdc[10882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091995, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:39:55.740260 11012 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:39767
I20260807 08:39:55.740322 11158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:39767 every 8 connection(s)
I20260807 08:39:55.741017 11012 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:39:55.742558 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 11012
I20260807 08:39:55.742709 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
I20260807 08:39:55.743023 9027 external_mini_cluster.cc:1428] Setting key 8587f5df4b577eb180fe8ed25f1b90ff
I20260807 08:39:55.743611 10988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:55.730666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:38663 (local address 127.8.208.254:34107)
0807 08:39:55.730808 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:55.730813 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:55.731527 (+ 714us) server_negotiation.cc:407] Connection header received
0807 08:39:55.732601 (+ 1074us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:55.732607 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:55.732661 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:55.732723 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:55.734385 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:55.735242 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:55.736886 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:55.737118 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:55.737235 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:55.739850 (+ 2615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:55.739853 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:55.739856 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:55.739881 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:55.741308 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:55.741914 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:55.741917 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:55.741919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:55.742012 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:55.742407 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:55.742409 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:55.742410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:55.742576 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:55.742662 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:55.743274 (+ 612us) server_negotiation.cc:299] Negotiation successful
0807 08:39:55.743437 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 08:39:55.744405 11039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:55.730982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:34107 (local address 127.8.208.193:38663)
0807 08:39:55.731369 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:55.731412 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:55.732363 (+ 951us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:55.733123 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:55.733130 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:55.733600 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:39:55.734228 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:55.734249 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:55.735372 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:55.735376 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:55.736732 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:55.736745 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:55.737285 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:55.737289 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:55.737478 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:55.737988 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:39:55.738010 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:39:55.739697 (+ 1687us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:39:55.741439 (+ 1742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:55.741445 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:55.741457 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:55.741785 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:55.742112 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:55.742114 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:55.742115 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:55.742254 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:55.742729 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:39:55.742737 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:39:55.743038 (+ 301us) client_negotiation.cc:769] Sending connection context
0807 08:39:55.743219 (+ 181us) client_negotiation.cc:240] Negotiation successful
0807 08:39:55.743534 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":118,"threads_started":1}
I20260807 08:39:55.746953 11159 heartbeater.cc:347] Connected to a master server at 127.8.208.254:34107
I20260807 08:39:55.747097 11159 heartbeater.cc:464] Registering TS with master...
I20260807 08:39:55.747601 11159 heartbeater.cc:511] Master 127.8.208.254:34107 requested a full tablet report, sending...
I20260807 08:39:55.749020 10932 ts_manager.cc:194] Registered new tserver with Master: 08d766969a724484b9f56279645b6c1b (127.8.208.193:39767)
I20260807 08:39:55.750589 10932 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.193@KRBTEST.COM'} at 127.8.208.193:38663
WARNING: no policy specified for kudu/127.8.208.194@KRBTEST.COM; defaulting to no policy
I20260807 08:39:55.756974 10988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:55.748823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:35215 (local address 127.8.208.254:34107)
0807 08:39:55.748961 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:55.748967 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:55.749388 (+ 421us) server_negotiation.cc:407] Connection header received
0807 08:39:55.749509 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:55.749512 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:55.749553 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:55.749628 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:55.750217 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:55.750925 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:55.752290 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:55.752649 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:55.752757 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:55.753885 (+ 1128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:55.753889 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:55.753892 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:55.753914 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:55.755350 (+ 1436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:55.755769 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:55.755774 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:55.755775 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:55.755851 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:55.756139 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:55.756143 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:55.756145 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:55.756351 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:55.756457 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:55.756731 (+ 274us) server_negotiation.cc:299] Negotiation successful
0807 08:39:55.756840 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.194@KRBTEST.COM" created.
I20260807 08:39:55.757046 11167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:55.748947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:34107 (local address 127.8.208.193:35215)
0807 08:39:55.749242 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:55.749282 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:55.749416 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:55.749737 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:55.749740 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:55.749979 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:39:55.750090 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:55.750097 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:55.751073 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:55.751079 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:55.752138 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:55.752153 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:55.752804 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:55.752808 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:55.752910 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:55.753439 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:39:55.753451 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:39:55.753730 (+ 279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:39:55.755475 (+ 1745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:55.755479 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:55.755480 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:55.755672 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:55.755946 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:55.755948 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:55.755950 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:55.756036 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:55.756485 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:39:55.756488 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:39:55.756573 (+ 85us) client_negotiation.cc:769] Sending connection context
0807 08:39:55.756677 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 08:39:55.756814 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"mutex_wait_us":8,"thread_start_us":84,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
I20260807 08:39:55.772257 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:34107
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:43695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:39:55.876972 11169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:39:55.877218 11169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:39:55.877292 11169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:39:55.880914 11169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:39:55.880996 11169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:39:55.881059 11169 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 08:39:55.881103 11169 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 08:39:55.881175 11169 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:39:55.886004 11169 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:43695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.208.254:34107
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11169
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:39:55.887034 11169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:39:55.887884 11169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 08:39:55.897243 11169 server_base.cc:1034] running on GCE node
W20260807 08:39:55.897178 11177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:55.897168 11175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:55.897174 11174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:39:55.897921 11169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:39:55.898586 11169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:39:55.899823 11169 hybrid_clock.cc:648] HybridClock initialized: now 1786091995899774 us; error 44 us; skew 500 ppm
Aug 07 08:39:55 dist-test-slave-6nmv krb5kdc[10882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091995, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:39:55.902684 11169 init.cc:377] Logged in from keytab as kudu/127.8.208.194@KRBTEST.COM (short username kudu)
I20260807 08:39:55.903607 11169 webserver.cc:460] Webserver started at http://127.8.208.194:33075/ using document root <none> and password file <none>
I20260807 08:39:55.904135 11169 fs_manager.cc:359] Metadata directory not provided
I20260807 08:39:55.904202 11169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:39:55.904443 11169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:39:55.906447 11169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "11151f37daf3472e997c6d85717cf789"
format_stamp: "Formatted at 2026-08-07 08:39:55 on dist-test-slave-6nmv"
server_key: "81c592da48dc0f8e1f7d67650072942d"
server_key_iv: "baaf9869b007244c6d2bb046489d95e4"
server_key_version: "encryptionkey@0"
I20260807 08:39:55.907058 11169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "11151f37daf3472e997c6d85717cf789"
format_stamp: "Formatted at 2026-08-07 08:39:55 on dist-test-slave-6nmv"
server_key: "81c592da48dc0f8e1f7d67650072942d"
server_key_iv: "baaf9869b007244c6d2bb046489d95e4"
server_key_version: "encryptionkey@0"
I20260807 08:39:55.910889 11169 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 08:39:55.913144 11185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:55.914492 11169 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 08:39:55.914624 11169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "11151f37daf3472e997c6d85717cf789"
format_stamp: "Formatted at 2026-08-07 08:39:55 on dist-test-slave-6nmv"
server_key: "81c592da48dc0f8e1f7d67650072942d"
server_key_iv: "baaf9869b007244c6d2bb046489d95e4"
server_key_version: "encryptionkey@0"
I20260807 08:39:55.914729 11169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:39:55.941417 11169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:39:55.944032 11169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:39:55.944221 11169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:39:55.945570 11169 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:39:55.945616 11169 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:55.945649 11169 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:39:55.945664 11169 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 08:39:55 dist-test-slave-6nmv krb5kdc[10882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091995, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:39:55.956331 11169 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:44999
I20260807 08:39:55.956386 11318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:44999 every 8 connection(s)
I20260807 08:39:55.957258 11169 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:39:55.958057 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 11169
I20260807 08:39:55.958171 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:39:55.958434 9027 external_mini_cluster.cc:1428] Setting key abefb8f062f625a435574d4f2a58be07
I20260807 08:39:55.959224 11194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:55.946936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:34107 (local address 127.8.208.194:40753)
0807 08:39:55.947477 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:55.947518 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:55.948507 (+ 989us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:55.949064 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:55.949071 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:55.949405 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:39:55.950025 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:55.950041 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:55.950792 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:55.950794 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:55.951779 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:55.951789 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:55.952403 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:55.952407 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:55.952601 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:55.953160 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:39:55.953177 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:39:55.954704 (+ 1527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:39:55.956625 (+ 1921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:55.956629 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:55.956637 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:55.956852 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:55.957130 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:55.957132 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:55.957133 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:55.957255 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:55.957682 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:39:55.957687 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:39:55.957962 (+ 275us) client_negotiation.cc:769] Sending connection context
0807 08:39:55.958142 (+ 180us) client_negotiation.cc:240] Negotiation successful
0807 08:39:55.958421 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":218,"threads_started":1}
I20260807 08:39:55.959836 10988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:55.946180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:40753 (local address 127.8.208.254:34107)
0807 08:39:55.946337 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:55.946342 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:55.947641 (+ 1299us) server_negotiation.cc:407] Connection header received
0807 08:39:55.948701 (+ 1060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:55.948705 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:55.948769 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:55.948867 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:55.950162 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:55.950681 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:55.951906 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:55.952250 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:55.952346 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:55.954871 (+ 2525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:55.954876 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:55.954881 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:55.954914 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:55.956528 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:55.956949 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:55.956955 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:55.956957 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:55.957043 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:55.957348 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:55.957351 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:55.957353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:55.957574 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:55.957694 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:55.959566 (+ 1872us) server_negotiation.cc:299] Negotiation successful
0807 08:39:55.959682 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 08:39:55.960796 11319 heartbeater.cc:347] Connected to a master server at 127.8.208.254:34107
I20260807 08:39:55.960954 11319 heartbeater.cc:464] Registering TS with master...
I20260807 08:39:55.961386 11319 heartbeater.cc:511] Master 127.8.208.254:34107 requested a full tablet report, sending...
I20260807 08:39:55.962370 10933 ts_manager.cc:194] Registered new tserver with Master: 11151f37daf3472e997c6d85717cf789 (127.8.208.194:44999)
I20260807 08:39:55.963089 10933 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.194@KRBTEST.COM'} at 127.8.208.194:40753
WARNING: no policy specified for kudu/127.8.208.195@KRBTEST.COM; defaulting to no policy
I20260807 08:39:55.969677 10988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:55.963346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:44037 (local address 127.8.208.254:34107)
0807 08:39:55.963483 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:55.963486 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:55.963499 (+ 13us) server_negotiation.cc:407] Connection header received
0807 08:39:55.963534 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:55.963539 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:55.963587 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:55.963667 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:55.964087 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:55.964581 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:55.965414 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:55.965626 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:55.965721 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:55.966779 (+ 1058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:55.966782 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:55.966785 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:55.966808 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:55.968128 (+ 1320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:55.968550 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:55.968553 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:55.968554 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:55.968632 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:55.968910 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:55.968912 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:55.968914 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:55.969110 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:55.969212 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:55.969457 (+ 245us) server_negotiation.cc:299] Negotiation successful
0807 08:39:55.969551 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 08:39:55.969688 11326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:55.962883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:34107 (local address 127.8.208.194:44037)
0807 08:39:55.963106 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:55.963117 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:55.963193 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:55.963702 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:55.963708 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:55.963871 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:39:55.963971 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:55.963976 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:55.964703 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:55.964706 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:55.965290 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:55.965305 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:55.965727 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:55.965730 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:55.965854 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:55.966319 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:39:55.966330 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:39:55.966630 (+ 300us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:39:55.968241 (+ 1611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:55.968246 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:55.968248 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:55.968451 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:55.968718 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:55.968722 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:55.968724 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:55.968805 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:55.969205 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:39:55.969208 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:39:55.969296 (+ 88us) client_negotiation.cc:769] Sending connection context
0807 08:39:55.969405 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 08:39:55.969534 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":75,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
I20260807 08:39:55.984969 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:34107
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:43695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:39:56.086726 11328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:39:56.086966 11328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:39:56.087008 11328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:39:56.090781 11328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:39:56.090840 11328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:39:56.090884 11328 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 08:39:56.090896 11328 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 08:39:56.090973 11328 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:39:56.096944 11328 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:43695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.208.254:34107
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:39:56.097915 11328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:39:56.098839 11328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:39:56.107617 11336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:56.107613 11334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:39:56.107613 11333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:39:56.107666 11328 server_base.cc:1034] running on GCE node
I20260807 08:39:56.108294 11328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:39:56.108855 11328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:39:56.110038 11328 hybrid_clock.cc:648] HybridClock initialized: now 1786091996110014 us; error 33 us; skew 500 ppm
Aug 07 08:39:56 dist-test-slave-6nmv krb5kdc[10882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091996, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:39:56.112685 11328 init.cc:377] Logged in from keytab as kudu/127.8.208.195@KRBTEST.COM (short username kudu)
I20260807 08:39:56.113515 11328 webserver.cc:460] Webserver started at http://127.8.208.195:35345/ using document root <none> and password file <none>
I20260807 08:39:56.114104 11328 fs_manager.cc:359] Metadata directory not provided
I20260807 08:39:56.114194 11328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:39:56.114411 11328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:39:56.116192 11328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "c3d88e2cde5e44d986d590a5b81ecb8e"
format_stamp: "Formatted at 2026-08-07 08:39:56 on dist-test-slave-6nmv"
server_key: "12af9c0a0db0705feb8e80b6a13335d5"
server_key_iv: "db924840acaf6f95f7eacdf9017d8e4d"
server_key_version: "encryptionkey@0"
I20260807 08:39:56.116724 11328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "c3d88e2cde5e44d986d590a5b81ecb8e"
format_stamp: "Formatted at 2026-08-07 08:39:56 on dist-test-slave-6nmv"
server_key: "12af9c0a0db0705feb8e80b6a13335d5"
server_key_iv: "db924840acaf6f95f7eacdf9017d8e4d"
server_key_version: "encryptionkey@0"
I20260807 08:39:56.120373 11328 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 08:39:56.122483 11344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:56.123636 11328 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:39:56.123761 11328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "c3d88e2cde5e44d986d590a5b81ecb8e"
format_stamp: "Formatted at 2026-08-07 08:39:56 on dist-test-slave-6nmv"
server_key: "12af9c0a0db0705feb8e80b6a13335d5"
server_key_iv: "db924840acaf6f95f7eacdf9017d8e4d"
server_key_version: "encryptionkey@0"
I20260807 08:39:56.123860 11328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:39:56.149504 11328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:39:56.152541 11328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:39:56.152736 11328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:39:56.154227 11328 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:39:56.154275 11328 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:39:56.154314 11328 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:39:56.154371 11328 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 08:39:56 dist-test-slave-6nmv krb5kdc[10882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091996, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:39:56.164584 11328 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:38397
I20260807 08:39:56.165361 11328 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:39:56.165841 11474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:38397 every 8 connection(s)
I20260807 08:39:56.168529 10988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.154916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:40275 (local address 127.8.208.254:34107)
0807 08:39:56.155092 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:56.155098 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:56.156355 (+ 1257us) server_negotiation.cc:407] Connection header received
0807 08:39:56.157689 (+ 1334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:56.157695 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:56.157757 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:56.157918 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:56.159481 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.160106 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.161754 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.162021 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.162097 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.165070 (+ 2973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:56.165073 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:56.165075 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:56.165102 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:56.166503 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:56.167004 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:56.167008 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:56.167010 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:56.167126 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:56.167484 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:56.167489 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:56.167491 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:56.167668 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:56.167768 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:56.168246 (+ 478us) server_negotiation.cc:299] Negotiation successful
0807 08:39:56.168379 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 08:39:56.169152 11355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.155703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:34107 (local address 127.8.208.195:40275)
0807 08:39:56.156208 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:56.156259 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:56.157449 (+ 1190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:56.158113 (+ 664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:56.158123 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:56.158629 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:39:56.159320 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:56.159342 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.160221 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.160225 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:56.161644 (+ 1419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:56.161652 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.162179 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.162184 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:56.162418 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.163072 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:39:56.163093 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:39:56.164927 (+ 1834us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:39:56.166608 (+ 1681us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:56.166614 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:56.166625 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:56.166906 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:56.167227 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:56.167230 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:56.167232 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:56.167380 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:56.167782 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:39:56.167790 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:39:56.168006 (+ 216us) client_negotiation.cc:769] Sending connection context
0807 08:39:56.168183 (+ 177us) client_negotiation.cc:240] Negotiation successful
0807 08:39:56.168502 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":143,"threads_started":1}
I20260807 08:39:56.170150 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 11328
I20260807 08:39:56.170258 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:39:56.170293 11475 heartbeater.cc:347] Connected to a master server at 127.8.208.254:34107
I20260807 08:39:56.170413 11475 heartbeater.cc:464] Registering TS with master...
I20260807 08:39:56.170574 9027 external_mini_cluster.cc:1428] Setting key 3885b620279a5a75c1a4aa9c8b191fff
I20260807 08:39:56.170892 11475 heartbeater.cc:511] Master 127.8.208.254:34107 requested a full tablet report, sending...
I20260807 08:39:56.171887 10932 ts_manager.cc:194] Registered new tserver with Master: c3d88e2cde5e44d986d590a5b81ecb8e (127.8.208.195:38397)
I20260807 08:39:56.172547 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 08:39:56.172608 10932 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.195@KRBTEST.COM'} at 127.8.208.195:40275
I20260807 08:39:56.181139 11482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.172451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:34107 (local address 127.8.208.195:41769)
0807 08:39:56.174977 (+ 2526us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:56.175006 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:56.175099 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:56.175303 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:56.175306 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:56.175553 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:39:56.175687 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:56.175696 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.176281 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.176283 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:56.176790 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:56.176797 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.177223 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.177226 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:56.177312 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.177802 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:39:56.177843 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:39:56.178188 (+ 345us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:39:56.179745 (+ 1557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:56.179749 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:56.179752 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:56.180015 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:56.180256 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:56.180260 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:56.180264 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:56.180364 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:56.180786 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:39:56.180787 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:39:56.180853 (+ 66us) client_negotiation.cc:769] Sending connection context
0807 08:39:56.180932 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 08:39:56.181032 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2421,"thread_start_us":2318,"threads_started":1}
I20260807 08:39:56.181352 10988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.172381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:41769 (local address 127.8.208.254:34107)
0807 08:39:56.172476 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:56.172480 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:56.175067 (+ 2587us) server_negotiation.cc:407] Connection header received
0807 08:39:56.175174 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:56.175176 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:56.175207 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:56.175262 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:56.175790 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.176184 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.176916 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.177120 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.177219 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.178300 (+ 1081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:56.178302 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:56.178304 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:56.178323 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:56.179646 (+ 1323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:56.180110 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:56.180112 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:56.180113 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:56.180177 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:56.180463 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:56.180467 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:56.180471 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:56.180692 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:56.180795 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:56.181030 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 08:39:56.181142 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
Aug 07 08:39:56 dist-test-slave-6nmv krb5kdc[10882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091996, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 08:39:56 dist-test-slave-6nmv krb5kdc[10882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091996, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:39:56.198338 10988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.190817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55854 (local address 127.8.208.254:34107)
0807 08:39:56.190937 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:56.190940 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:56.190950 (+ 10us) server_negotiation.cc:407] Connection header received
0807 08:39:56.190977 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:56.190979 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:56.191008 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:56.191066 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:56.191752 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.192213 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.193010 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.193185 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.193251 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.195554 (+ 2303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:56.195557 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:56.195561 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:56.195584 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:56.196837 (+ 1253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:56.197204 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:56.197207 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:56.197209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:56.197281 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:56.197573 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:56.197576 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:56.197577 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:56.197726 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:56.197866 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:56.198103 (+ 237us) server_negotiation.cc:299] Negotiation successful
0807 08:39:56.198196 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 08:39:56.200994 10932 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55854:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 08:39:56.203905 10932 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:39:56.217522 11496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.212501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39878 (local address 127.8.208.193:39767)
0807 08:39:56.212902 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:56.212917 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:56.213091 (+ 174us) server_negotiation.cc:407] Connection header received
0807 08:39:56.213169 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:56.213174 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:56.213358 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:56.213550 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:39:56.213779 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.214636 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.216062 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.216781 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.216884 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.217016 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:56.217205 (+ 189us) server_negotiation.cc:299] Negotiation successful
0807 08:39:56.217348 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":105,"threads_started":1}
I20260807 08:39:56.217490 11494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.212081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:38397 (local address 127.0.0.1:59440)
0807 08:39:56.212303 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:56.212316 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:56.212412 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:56.213696 (+ 1284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:56.213702 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:56.213723 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:39:56.213814 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:56.213820 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.215163 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.215166 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:56.216205 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:56.216212 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.217153 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.217156 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:56.217238 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.217256 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 08:39:56.217316 (+ 60us) client_negotiation.cc:240] Negotiation successful
0807 08:39:56.217374 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":97,"threads_started":1}
I20260807 08:39:56.217492 11495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.212090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:39767 (local address 127.0.0.1:39878)
0807 08:39:56.212885 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:56.212898 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:56.212999 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:56.213526 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:56.213529 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:56.213548 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:39:56.213643 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:56.213653 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.214748 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.214751 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:56.215939 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:56.215950 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.216909 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.216913 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:56.217021 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.217055 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 08:39:56.217159 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 08:39:56.217267 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":739,"thread_start_us":90,"threads_started":1}
I20260807 08:39:56.217711 11493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.211587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38546 (local address 127.8.208.194:44999)
0807 08:39:56.211954 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:56.211968 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:56.211992 (+ 24us) server_negotiation.cc:407] Connection header received
0807 08:39:56.212214 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:56.212220 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:56.212433 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:56.212614 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:39:56.213270 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.214492 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.215957 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.216781 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.216891 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.217016 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:56.217453 (+ 437us) server_negotiation.cc:299] Negotiation successful
0807 08:39:56.217541 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":172,"threads_started":1}
I20260807 08:39:56.217980 11492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.211459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:44999 (local address 127.0.0.1:38546)
0807 08:39:56.211736 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:56.211776 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:56.211881 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:56.212987 (+ 1106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:56.212993 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:56.213010 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:39:56.213153 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:56.213159 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.214641 (+ 1482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.214644 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:56.215812 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:56.215821 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.217088 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.217090 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:56.217188 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.217211 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 08:39:56.217277 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 08:39:56.217337 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"mutex_wait_us":2,"thread_start_us":51,"threads_started":1}
I20260807 08:39:56.218219 11497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.212639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59440 (local address 127.8.208.195:38397)
0807 08:39:56.213113 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:56.213123 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:56.213140 (+ 17us) server_negotiation.cc:407] Connection header received
0807 08:39:56.213195 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:56.213199 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:56.213420 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:56.213593 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:39:56.213954 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.215037 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.216316 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.216831 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.216965 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.217094 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:56.217810 (+ 716us) server_negotiation.cc:299] Negotiation successful
0807 08:39:56.218033 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":127,"threads_started":1}
I20260807 08:39:56.220546 11239 tablet_service.cc:1467] Processing CreateTablet for tablet d0a897060b7b40fd97e0f19ef98cfb84 (DEFAULT_TABLE table=test-table [id=067f9094ef264af7a33f7df344e08865]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:39:56.220541 11402 tablet_service.cc:1467] Processing CreateTablet for tablet d0a897060b7b40fd97e0f19ef98cfb84 (DEFAULT_TABLE table=test-table [id=067f9094ef264af7a33f7df344e08865]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:39:56.221452 11239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0a897060b7b40fd97e0f19ef98cfb84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:56.221491 11402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0a897060b7b40fd97e0f19ef98cfb84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:56.222633 11085 tablet_service.cc:1467] Processing CreateTablet for tablet d0a897060b7b40fd97e0f19ef98cfb84 (DEFAULT_TABLE table=test-table [id=067f9094ef264af7a33f7df344e08865]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:39:56.223505 11085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0a897060b7b40fd97e0f19ef98cfb84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:56.228263 11498 tablet_bootstrap.cc:492] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789: Bootstrap starting.
I20260807 08:39:56.230096 11498 tablet_bootstrap.cc:654] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:56.230225 11501 tablet_bootstrap.cc:492] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b: Bootstrap starting.
I20260807 08:39:56.230759 11499 tablet_bootstrap.cc:492] T d0a897060b7b40fd97e0f19ef98cfb84 P c3d88e2cde5e44d986d590a5b81ecb8e: Bootstrap starting.
I20260807 08:39:56.230943 11498 log.cc:824] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789: Log is configured to *not* fsync() on all Append() calls
I20260807 08:39:56.232235 11501 tablet_bootstrap.cc:654] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:56.232610 11498 tablet_bootstrap.cc:492] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789: No bootstrap required, opened a new log
I20260807 08:39:56.232741 11499 tablet_bootstrap.cc:654] T d0a897060b7b40fd97e0f19ef98cfb84 P c3d88e2cde5e44d986d590a5b81ecb8e: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:56.232839 11498 ts_tablet_manager.cc:1397] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 08:39:56.233029 11501 log.cc:824] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b: Log is configured to *not* fsync() on all Append() calls
I20260807 08:39:56.233629 11499 log.cc:824] T d0a897060b7b40fd97e0f19ef98cfb84 P c3d88e2cde5e44d986d590a5b81ecb8e: Log is configured to *not* fsync() on all Append() calls
I20260807 08:39:56.235113 11501 tablet_bootstrap.cc:492] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b: No bootstrap required, opened a new log
I20260807 08:39:56.235289 11501 ts_tablet_manager.cc:1397] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 08:39:56.235504 11499 tablet_bootstrap.cc:492] T d0a897060b7b40fd97e0f19ef98cfb84 P c3d88e2cde5e44d986d590a5b81ecb8e: No bootstrap required, opened a new log
I20260807 08:39:56.235662 11499 ts_tablet_manager.cc:1397] T d0a897060b7b40fd97e0f19ef98cfb84 P c3d88e2cde5e44d986d590a5b81ecb8e: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 08:39:56.236631 11498 raft_consensus.cc:348] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.236868 11498 raft_consensus.cc:374] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:56.236948 11498 raft_consensus.cc:729] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11151f37daf3472e997c6d85717cf789, State: Initialized, Role: FOLLOWER
I20260807 08:39:56.237341 11498 consensus_queue.cc:260] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.238008 11319 heartbeater.cc:503] Master 127.8.208.254:34107 was elected leader, sending a full tablet report...
I20260807 08:39:56.238296 11498 ts_tablet_manager.cc:1428] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 08:39:56.238247 11501 raft_consensus.cc:348] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.238472 11501 raft_consensus.cc:374] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:56.238519 11501 raft_consensus.cc:729] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08d766969a724484b9f56279645b6c1b, State: Initialized, Role: FOLLOWER
I20260807 08:39:56.238862 11501 consensus_queue.cc:260] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.239110 11499 raft_consensus.cc:348] T d0a897060b7b40fd97e0f19ef98cfb84 P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.239363 11499 raft_consensus.cc:374] T d0a897060b7b40fd97e0f19ef98cfb84 P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:56.239446 11499 raft_consensus.cc:729] T d0a897060b7b40fd97e0f19ef98cfb84 P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d88e2cde5e44d986d590a5b81ecb8e, State: Initialized, Role: FOLLOWER
I20260807 08:39:56.239475 11159 heartbeater.cc:503] Master 127.8.208.254:34107 was elected leader, sending a full tablet report...
I20260807 08:39:56.239825 11501 ts_tablet_manager.cc:1428] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260807 08:39:56.239797 11499 consensus_queue.cc:260] T d0a897060b7b40fd97e0f19ef98cfb84 P c3d88e2cde5e44d986d590a5b81ecb8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.240374 11475 heartbeater.cc:503] Master 127.8.208.254:34107 was elected leader, sending a full tablet report...
I20260807 08:39:56.240687 11499 ts_tablet_manager.cc:1428] T d0a897060b7b40fd97e0f19ef98cfb84 P c3d88e2cde5e44d986d590a5b81ecb8e: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260807 08:39:56.242585 11160 tablet.cc:2369] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 08:39:56.416498 11476 tablet.cc:2369] T d0a897060b7b40fd97e0f19ef98cfb84 P c3d88e2cde5e44d986d590a5b81ecb8e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 08:39:56.458854 11320 tablet.cc:2369] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 08:39:56.462075 11505 raft_consensus.cc:482] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:39:56.462229 11505 raft_consensus.cc:504] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.462549 11506 raft_consensus.cc:482] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:39:56.462741 11506 raft_consensus.cc:504] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.463490 11505 leader_election.cc:288] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08d766969a724484b9f56279645b6c1b (127.8.208.193:39767), c3d88e2cde5e44d986d590a5b81ecb8e (127.8.208.195:38397)
I20260807 08:39:56.465094 11506 leader_election.cc:288] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11151f37daf3472e997c6d85717cf789 (127.8.208.194:44999), c3d88e2cde5e44d986d590a5b81ecb8e (127.8.208.195:38397)
I20260807 08:39:56.468168 11497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.463868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:35857 (local address 127.8.208.195:38397)
0807 08:39:56.464238 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:56.464245 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:56.464259 (+ 14us) server_negotiation.cc:407] Connection header received
0807 08:39:56.464316 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:56.464319 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:56.464369 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:56.464472 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:39:56.464808 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.465458 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.466980 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.467504 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.467584 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.467632 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:56.467968 (+ 336us) server_negotiation.cc:299] Negotiation successful
0807 08:39:56.468046 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286}
I20260807 08:39:56.468441 11493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.464227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:37995 (local address 127.8.208.194:44999)
0807 08:39:56.464326 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:56.464330 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:56.464467 (+ 137us) server_negotiation.cc:407] Connection header received
0807 08:39:56.464619 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:56.464622 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:56.464674 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:56.464718 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:39:56.465111 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.465713 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.467093 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.467598 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.467715 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.467785 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:56.468239 (+ 454us) server_negotiation.cc:299] Negotiation successful
0807 08:39:56.468322 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":42}
I20260807 08:39:56.468722 11508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.463740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:38397 (local address 127.8.208.194:35857)
0807 08:39:56.464104 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:56.464119 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:56.464186 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:56.464517 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:56.464519 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:56.464537 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:39:56.464677 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:56.464683 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.465602 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.465605 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:56.466870 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:56.466879 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.467715 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.467718 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:56.467835 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.467855 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 08:39:56.468442 (+ 587us) client_negotiation.cc:240] Negotiation successful
0807 08:39:56.468539 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"mutex_wait_us":51,"spinlock_wait_cycles":768,"thread_start_us":83,"threads_started":1}
I20260807 08:39:56.469166 11510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.463918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:44999 (local address 127.8.208.193:37995)
0807 08:39:56.464373 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:56.464386 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:56.464488 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:56.464868 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:56.464871 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:56.464887 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:39:56.464995 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:56.465001 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.465814 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.465817 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:56.466962 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:56.466971 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.467834 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.467837 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:56.467933 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.467955 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 08:39:56.468022 (+ 67us) client_negotiation.cc:240] Negotiation successful
0807 08:39:56.468089 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":394,"mutex_wait_us":24,"thread_start_us":62,"threads_started":1}
I20260807 08:39:56.469781 11496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.464011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:57465 (local address 127.8.208.193:39767)
0807 08:39:56.464115 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:56.464121 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:56.464140 (+ 19us) server_negotiation.cc:407] Connection header received
0807 08:39:56.464316 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:56.464320 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:56.464389 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:56.464457 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:39:56.465668 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.466472 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.467763 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.468552 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.468746 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.468834 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:56.469527 (+ 693us) server_negotiation.cc:299] Negotiation successful
0807 08:39:56.469632 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":35}
I20260807 08:39:56.469908 11256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0a897060b7b40fd97e0f19ef98cfb84" candidate_uuid: "08d766969a724484b9f56279645b6c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11151f37daf3472e997c6d85717cf789" is_pre_election: true
I20260807 08:39:56.470094 11256 raft_consensus.cc:2454] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08d766969a724484b9f56279645b6c1b in term 0.
I20260807 08:39:56.470304 11509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.463684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:39767 (local address 127.8.208.194:57465)
0807 08:39:56.464048 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:56.464065 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:56.464178 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:56.464612 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:56.464614 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:56.464627 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:39:56.465564 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:56.465572 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.466598 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.466601 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:56.467639 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:56.467654 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.469018 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.469021 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:56.469266 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.469333 (+ 67us) client_negotiation.cc:769] Sending connection context
0807 08:39:56.469971 (+ 638us) client_negotiation.cc:240] Negotiation successful
0807 08:39:56.470036 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"mutex_wait_us":798,"spinlock_wait_cycles":384,"thread_start_us":91,"threads_started":1}
I20260807 08:39:56.470480 11511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.464852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:38397 (local address 127.8.208.193:37911)
0807 08:39:56.465391 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:56.465404 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:56.465490 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:56.465758 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:56.465760 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:56.465775 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:39:56.465991 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:56.466001 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.466885 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.466888 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:56.467869 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:56.467889 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.470075 (+ 2186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.470078 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:56.470163 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.470188 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 08:39:56.470262 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 08:39:56.470320 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"mutex_wait_us":74,"thread_start_us":62,"threads_started":1}
I20260807 08:39:56.470443 11425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0a897060b7b40fd97e0f19ef98cfb84" candidate_uuid: "11151f37daf3472e997c6d85717cf789" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" is_pre_election: true
I20260807 08:39:56.470530 11031 leader_election.cc:302] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08d766969a724484b9f56279645b6c1b, 11151f37daf3472e997c6d85717cf789; no voters:
I20260807 08:39:56.470701 11425 raft_consensus.cc:2454] T d0a897060b7b40fd97e0f19ef98cfb84 P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11151f37daf3472e997c6d85717cf789 in term 0.
I20260807 08:39:56.470903 11100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0a897060b7b40fd97e0f19ef98cfb84" candidate_uuid: "11151f37daf3472e997c6d85717cf789" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08d766969a724484b9f56279645b6c1b" is_pre_election: true
I20260807 08:39:56.471073 11506 raft_consensus.cc:2781] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:39:56.471186 11512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.465156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:37911 (local address 127.8.208.195:38397)
0807 08:39:56.465494 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:56.465501 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:56.465514 (+ 13us) server_negotiation.cc:407] Connection header received
0807 08:39:56.465556 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:56.465561 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:56.465608 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:56.465675 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:39:56.466119 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.466771 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.468004 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.469859 (+ 1855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.469969 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.470017 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:56.470599 (+ 582us) server_negotiation.cc:299] Negotiation successful
0807 08:39:56.470697 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":120,"threads_started":1}
I20260807 08:39:56.471135 11189 leader_election.cc:302] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11151f37daf3472e997c6d85717cf789, c3d88e2cde5e44d986d590a5b81ecb8e; no voters:
I20260807 08:39:56.471161 11100 raft_consensus.cc:2454] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11151f37daf3472e997c6d85717cf789 in term 0.
I20260807 08:39:56.471232 11506 raft_consensus.cc:482] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:39:56.471275 11506 raft_consensus.cc:3037] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:56.471388 11505 raft_consensus.cc:2781] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:39:56.471462 11505 raft_consensus.cc:482] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:39:56.471504 11505 raft_consensus.cc:3037] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:56.471793 11425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0a897060b7b40fd97e0f19ef98cfb84" candidate_uuid: "08d766969a724484b9f56279645b6c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" is_pre_election: true
I20260807 08:39:56.471889 11425 raft_consensus.cc:2454] T d0a897060b7b40fd97e0f19ef98cfb84 P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08d766969a724484b9f56279645b6c1b in term 0.
I20260807 08:39:56.472618 11506 raft_consensus.cc:504] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.472638 11505 raft_consensus.cc:504] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.472967 11506 leader_election.cc:288] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b [CANDIDATE]: Term 1 election: Requested vote from peers 11151f37daf3472e997c6d85717cf789 (127.8.208.194:44999), c3d88e2cde5e44d986d590a5b81ecb8e (127.8.208.195:38397)
I20260807 08:39:56.472995 11505 leader_election.cc:288] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789 [CANDIDATE]: Term 1 election: Requested vote from peers 08d766969a724484b9f56279645b6c1b (127.8.208.193:39767), c3d88e2cde5e44d986d590a5b81ecb8e (127.8.208.195:38397)
I20260807 08:39:56.473383 11100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0a897060b7b40fd97e0f19ef98cfb84" candidate_uuid: "11151f37daf3472e997c6d85717cf789" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08d766969a724484b9f56279645b6c1b"
I20260807 08:39:56.473398 11256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0a897060b7b40fd97e0f19ef98cfb84" candidate_uuid: "08d766969a724484b9f56279645b6c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11151f37daf3472e997c6d85717cf789"
I20260807 08:39:56.473439 11425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0a897060b7b40fd97e0f19ef98cfb84" candidate_uuid: "08d766969a724484b9f56279645b6c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e"
I20260807 08:39:56.473479 11424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0a897060b7b40fd97e0f19ef98cfb84" candidate_uuid: "11151f37daf3472e997c6d85717cf789" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e"
I20260807 08:39:56.473527 11425 raft_consensus.cc:3037] T d0a897060b7b40fd97e0f19ef98cfb84 P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:56.473567 11100 raft_consensus.cc:2379] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 11151f37daf3472e997c6d85717cf789 in current term 1: Already voted for candidate 08d766969a724484b9f56279645b6c1b in this term.
I20260807 08:39:56.473575 11256 raft_consensus.cc:2379] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 08d766969a724484b9f56279645b6c1b in current term 1: Already voted for candidate 11151f37daf3472e997c6d85717cf789 in this term.
I20260807 08:39:56.474046 11189 leader_election.cc:302] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11151f37daf3472e997c6d85717cf789; no voters: 08d766969a724484b9f56279645b6c1b, c3d88e2cde5e44d986d590a5b81ecb8e
I20260807 08:39:56.474202 11505 raft_consensus.cc:2726] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 08:39:56.474829 11425 raft_consensus.cc:2454] T d0a897060b7b40fd97e0f19ef98cfb84 P c3d88e2cde5e44d986d590a5b81ecb8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08d766969a724484b9f56279645b6c1b in term 1.
I20260807 08:39:56.475092 11032 leader_election.cc:302] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08d766969a724484b9f56279645b6c1b, c3d88e2cde5e44d986d590a5b81ecb8e; no voters: 11151f37daf3472e997c6d85717cf789
I20260807 08:39:56.475242 11506 raft_consensus.cc:2781] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:39:56.475412 11506 raft_consensus.cc:686] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b [term 1 LEADER]: Becoming Leader. State: Replica: 08d766969a724484b9f56279645b6c1b, State: Running, Role: LEADER
I20260807 08:39:56.475700 11506 consensus_queue.cc:237] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.478813 10932 catalog_manager.cc:5495] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 08d766969a724484b9f56279645b6c1b (127.8.208.193). New cstate: current_term: 1 leader_uuid: "08d766969a724484b9f56279645b6c1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } health_report { overall_health: UNKNOWN } } }
Aug 07 08:39:56 dist-test-slave-6nmv krb5kdc[10882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091995, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:39:56.523535 10988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.515387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55864 (local address 127.8.208.254:34107)
0807 08:39:56.515501 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:56.515504 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:56.515724 (+ 220us) server_negotiation.cc:407] Connection header received
0807 08:39:56.515820 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:56.515822 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:56.515858 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:56.515938 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:56.516513 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.516996 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.517782 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.518315 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.518419 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.520648 (+ 2229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:56.520652 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:56.520654 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:56.520683 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:56.521883 (+ 1200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:56.522306 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:56.522309 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:56.522310 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:56.522387 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:56.522645 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:56.522648 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:56.522649 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:56.522809 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:56.522941 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:56.523220 (+ 279us) server_negotiation.cc:299] Negotiation successful
0807 08:39:56.523378 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":67,"server-negotiator.queue_time_us":44}
I20260807 08:39:56.523536 11520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.515309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:34107 (local address 127.0.0.1:55864)
0807 08:39:56.515623 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:56.515638 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:56.515750 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:56.515981 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:56.515983 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:56.516325 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:39:56.516419 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:56.516424 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.517096 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.517098 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:56.517631 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:56.517638 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.518417 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.518420 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:56.518484 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.519028 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:39:56.519039 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:39:56.520517 (+ 1478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:39:56.521973 (+ 1456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:56.521984 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:56.521989 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:56.522204 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:56.522471 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:39:56.522475 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:39:56.522477 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:39:56.522555 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:39:56.522941 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:39:56.522947 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:39:56.523048 (+ 101us) client_negotiation.cc:769] Sending connection context
0807 08:39:56.523157 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 08:39:56.523323 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"mutex_wait_us":1,"thread_start_us":138,"threads_started":1}
I20260807 08:39:56.527180 10932 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:55864:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 08:39:56.527935 10932 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:39:56.532603 11239 tablet_service.cc:1467] Processing CreateTablet for tablet d7f0d3350262427b98db7a8cfc3962d5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2d15970470af4db0a82a89d6236b73b9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 08:39:56.532567 11085 tablet_service.cc:1467] Processing CreateTablet for tablet d7f0d3350262427b98db7a8cfc3962d5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2d15970470af4db0a82a89d6236b73b9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 08:39:56.532759 11402 tablet_service.cc:1467] Processing CreateTablet for tablet d7f0d3350262427b98db7a8cfc3962d5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2d15970470af4db0a82a89d6236b73b9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 08:39:56.533268 11239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7f0d3350262427b98db7a8cfc3962d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:56.533268 11085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7f0d3350262427b98db7a8cfc3962d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:56.533291 11402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7f0d3350262427b98db7a8cfc3962d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:56.536000 11499 tablet_bootstrap.cc:492] T d7f0d3350262427b98db7a8cfc3962d5 P c3d88e2cde5e44d986d590a5b81ecb8e: Bootstrap starting.
I20260807 08:39:56.536188 11498 tablet_bootstrap.cc:492] T d7f0d3350262427b98db7a8cfc3962d5 P 11151f37daf3472e997c6d85717cf789: Bootstrap starting.
I20260807 08:39:56.537006 11499 tablet_bootstrap.cc:654] T d7f0d3350262427b98db7a8cfc3962d5 P c3d88e2cde5e44d986d590a5b81ecb8e: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:56.537434 11498 tablet_bootstrap.cc:654] T d7f0d3350262427b98db7a8cfc3962d5 P 11151f37daf3472e997c6d85717cf789: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:56.537940 11501 tablet_bootstrap.cc:492] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b: Bootstrap starting.
I20260807 08:39:56.539149 11501 tablet_bootstrap.cc:654] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:56.539831 11499 tablet_bootstrap.cc:492] T d7f0d3350262427b98db7a8cfc3962d5 P c3d88e2cde5e44d986d590a5b81ecb8e: No bootstrap required, opened a new log
I20260807 08:39:56.539896 11499 ts_tablet_manager.cc:1397] T d7f0d3350262427b98db7a8cfc3962d5 P c3d88e2cde5e44d986d590a5b81ecb8e: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260807 08:39:56.540169 11501 tablet_bootstrap.cc:492] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b: No bootstrap required, opened a new log
I20260807 08:39:56.540235 11501 ts_tablet_manager.cc:1397] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 08:39:56.540373 11499 raft_consensus.cc:348] T d7f0d3350262427b98db7a8cfc3962d5 P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.540477 11499 raft_consensus.cc:374] T d7f0d3350262427b98db7a8cfc3962d5 P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:56.540516 11499 raft_consensus.cc:729] T d7f0d3350262427b98db7a8cfc3962d5 P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d88e2cde5e44d986d590a5b81ecb8e, State: Initialized, Role: FOLLOWER
I20260807 08:39:56.540635 11499 consensus_queue.cc:260] T d7f0d3350262427b98db7a8cfc3962d5 P c3d88e2cde5e44d986d590a5b81ecb8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.540710 11501 raft_consensus.cc:348] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.540827 11501 raft_consensus.cc:374] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:56.540858 11501 raft_consensus.cc:729] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08d766969a724484b9f56279645b6c1b, State: Initialized, Role: FOLLOWER
I20260807 08:39:56.540881 11507 tablet_replica.cc:439] T d7f0d3350262427b98db7a8cfc3962d5 P c3d88e2cde5e44d986d590a5b81ecb8e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } } }
I20260807 08:39:56.540977 11501 consensus_queue.cc:260] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.541033 11507 tablet_replica.cc:442] T d7f0d3350262427b98db7a8cfc3962d5 P c3d88e2cde5e44d986d590a5b81ecb8e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 08:39:56.540897 11499 ts_tablet_manager.cc:1428] T d7f0d3350262427b98db7a8cfc3962d5 P c3d88e2cde5e44d986d590a5b81ecb8e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 08:39:56.541214 11501 ts_tablet_manager.cc:1428] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 08:39:56.541651 11506 tablet_replica.cc:439] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } } }
I20260807 08:39:56.541831 11506 tablet_replica.cc:442] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 08:39:56.541962 11498 tablet_bootstrap.cc:492] T d7f0d3350262427b98db7a8cfc3962d5 P 11151f37daf3472e997c6d85717cf789: No bootstrap required, opened a new log
I20260807 08:39:56.542065 11498 ts_tablet_manager.cc:1397] T d7f0d3350262427b98db7a8cfc3962d5 P 11151f37daf3472e997c6d85717cf789: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260807 08:39:56.542495 11498 raft_consensus.cc:348] T d7f0d3350262427b98db7a8cfc3962d5 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.542608 11498 raft_consensus.cc:374] T d7f0d3350262427b98db7a8cfc3962d5 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:56.542646 11498 raft_consensus.cc:729] T d7f0d3350262427b98db7a8cfc3962d5 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11151f37daf3472e997c6d85717cf789, State: Initialized, Role: FOLLOWER
I20260807 08:39:56.542773 11498 consensus_queue.cc:260] T d7f0d3350262427b98db7a8cfc3962d5 P 11151f37daf3472e997c6d85717cf789 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.543064 11498 ts_tablet_manager.cc:1428] T d7f0d3350262427b98db7a8cfc3962d5 P 11151f37daf3472e997c6d85717cf789: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 08:39:56.543059 11505 tablet_replica.cc:439] T d7f0d3350262427b98db7a8cfc3962d5 P 11151f37daf3472e997c6d85717cf789: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } } }
I20260807 08:39:56.543239 11505 tablet_replica.cc:442] T d7f0d3350262427b98db7a8cfc3962d5 P 11151f37daf3472e997c6d85717cf789: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 08:39:56.571623 11506 raft_consensus.cc:482] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:39:56.571744 11506 raft_consensus.cc:504] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.572177 11506 leader_election.cc:288] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11151f37daf3472e997c6d85717cf789 (127.8.208.194:44999), c3d88e2cde5e44d986d590a5b81ecb8e (127.8.208.195:38397)
I20260807 08:39:56.572530 11256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7f0d3350262427b98db7a8cfc3962d5" candidate_uuid: "08d766969a724484b9f56279645b6c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11151f37daf3472e997c6d85717cf789" is_pre_election: true
I20260807 08:39:56.572594 11425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7f0d3350262427b98db7a8cfc3962d5" candidate_uuid: "08d766969a724484b9f56279645b6c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" is_pre_election: true
I20260807 08:39:56.572646 11256 raft_consensus.cc:2454] T d7f0d3350262427b98db7a8cfc3962d5 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08d766969a724484b9f56279645b6c1b in term 0.
I20260807 08:39:56.572773 11425 raft_consensus.cc:2454] T d7f0d3350262427b98db7a8cfc3962d5 P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08d766969a724484b9f56279645b6c1b in term 0.
I20260807 08:39:56.572974 11031 leader_election.cc:302] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08d766969a724484b9f56279645b6c1b, 11151f37daf3472e997c6d85717cf789; no voters:
I20260807 08:39:56.573145 11506 raft_consensus.cc:2781] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:39:56.573210 11506 raft_consensus.cc:482] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:39:56.573235 11506 raft_consensus.cc:3037] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:56.574148 11506 raft_consensus.cc:504] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.574429 11506 leader_election.cc:288] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b [CANDIDATE]: Term 1 election: Requested vote from peers 11151f37daf3472e997c6d85717cf789 (127.8.208.194:44999), c3d88e2cde5e44d986d590a5b81ecb8e (127.8.208.195:38397)
I20260807 08:39:56.574708 11256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7f0d3350262427b98db7a8cfc3962d5" candidate_uuid: "08d766969a724484b9f56279645b6c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11151f37daf3472e997c6d85717cf789"
I20260807 08:39:56.574846 11256 raft_consensus.cc:3037] T d7f0d3350262427b98db7a8cfc3962d5 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:56.574820 11425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7f0d3350262427b98db7a8cfc3962d5" candidate_uuid: "08d766969a724484b9f56279645b6c1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e"
I20260807 08:39:56.574934 11425 raft_consensus.cc:3037] T d7f0d3350262427b98db7a8cfc3962d5 P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:56.575891 11256 raft_consensus.cc:2454] T d7f0d3350262427b98db7a8cfc3962d5 P 11151f37daf3472e997c6d85717cf789 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08d766969a724484b9f56279645b6c1b in term 1.
I20260807 08:39:56.575893 11425 raft_consensus.cc:2454] T d7f0d3350262427b98db7a8cfc3962d5 P c3d88e2cde5e44d986d590a5b81ecb8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08d766969a724484b9f56279645b6c1b in term 1.
I20260807 08:39:56.576130 11031 leader_election.cc:302] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08d766969a724484b9f56279645b6c1b, 11151f37daf3472e997c6d85717cf789; no voters:
I20260807 08:39:56.576283 11506 raft_consensus.cc:2781] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:39:56.576408 11506 raft_consensus.cc:686] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b [term 1 LEADER]: Becoming Leader. State: Replica: 08d766969a724484b9f56279645b6c1b, State: Running, Role: LEADER
I20260807 08:39:56.576537 11506 consensus_queue.cc:237] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.577241 11513 tablet_replica.cc:439] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b: TxnStatusTablet state changed. Reason: New leader 08d766969a724484b9f56279645b6c1b. Latest consensus state: current_term: 1 leader_uuid: "08d766969a724484b9f56279645b6c1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } } }
I20260807 08:39:56.577343 11513 tablet_replica.cc:442] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b: This TxnStatusTablet replica's current role is: LEADER
I20260807 08:39:56.577657 11526 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 08:39:56.577896 11526 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 08:39:56.578132 10931 catalog_manager.cc:5495] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 08d766969a724484b9f56279645b6c1b (127.8.208.193). New cstate: current_term: 1 leader_uuid: "08d766969a724484b9f56279645b6c1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } health_report { overall_health: UNKNOWN } } }
I20260807 08:39:56.595199 11520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.591350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:39767 (local address 127.0.0.1:39882)
0807 08:39:56.591470 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:56.591486 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:56.591574 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:56.591910 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:56.591912 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:56.591918 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 08:39:56.592011 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:56.592015 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.593011 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.593014 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:56.593582 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:56.593590 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.594165 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.594167 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:56.594232 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.594273 (+ 41us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 08:39:56.594971 (+ 698us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 08:39:56.594981 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 08:39:56.595024 (+ 43us) client_negotiation.cc:240] Negotiation successful
0807 08:39:56.595104 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260807 08:39:56.595216 11496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.591431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39882 (local address 127.8.208.193:39767)
0807 08:39:56.591536 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:56.591540 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:56.591554 (+ 14us) server_negotiation.cc:407] Connection header received
0807 08:39:56.591735 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:56.591738 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:56.591795 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:56.591905 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:39:56.592123 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.592902 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.593693 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.594062 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.594163 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.594417 (+ 254us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:39:56.594890 (+ 473us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:39:56.594986 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:56.595053 (+ 67us) server_negotiation.cc:299] Negotiation successful
0807 08:39:56.595101 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 08:39:56.599720 11256 raft_consensus.cc:1261] T d7f0d3350262427b98db7a8cfc3962d5 P 11151f37daf3472e997c6d85717cf789 [term 1 FOLLOWER]: Refusing update from remote peer 08d766969a724484b9f56279645b6c1b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:39:56.599757 11425 raft_consensus.cc:1261] T d7f0d3350262427b98db7a8cfc3962d5 P c3d88e2cde5e44d986d590a5b81ecb8e [term 1 FOLLOWER]: Refusing update from remote peer 08d766969a724484b9f56279645b6c1b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:39:56.600261 11506 consensus_queue.cc:1035] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:39:56.601116 11506 consensus_queue.cc:1035] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:39:56.604709 11507 tablet_replica.cc:439] T d7f0d3350262427b98db7a8cfc3962d5 P c3d88e2cde5e44d986d590a5b81ecb8e: TxnStatusTablet state changed. Reason: New leader 08d766969a724484b9f56279645b6c1b. Latest consensus state: current_term: 1 leader_uuid: "08d766969a724484b9f56279645b6c1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } } }
I20260807 08:39:56.604822 11507 tablet_replica.cc:442] T d7f0d3350262427b98db7a8cfc3962d5 P c3d88e2cde5e44d986d590a5b81ecb8e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 08:39:56.606528 11505 tablet_replica.cc:439] T d7f0d3350262427b98db7a8cfc3962d5 P 11151f37daf3472e997c6d85717cf789: TxnStatusTablet state changed. Reason: New leader 08d766969a724484b9f56279645b6c1b. Latest consensus state: current_term: 1 leader_uuid: "08d766969a724484b9f56279645b6c1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } } }
I20260807 08:39:56.606628 11505 tablet_replica.cc:442] T d7f0d3350262427b98db7a8cfc3962d5 P 11151f37daf3472e997c6d85717cf789: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 08:39:56.609539 11513 tablet_replica.cc:439] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "08d766969a724484b9f56279645b6c1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } } }
I20260807 08:39:56.609625 11513 tablet_replica.cc:442] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b: This TxnStatusTablet replica's current role is: LEADER
I20260807 08:39:56.609859 11507 tablet_replica.cc:439] T d7f0d3350262427b98db7a8cfc3962d5 P c3d88e2cde5e44d986d590a5b81ecb8e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "08d766969a724484b9f56279645b6c1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } } }
I20260807 08:39:56.609959 11507 tablet_replica.cc:442] T d7f0d3350262427b98db7a8cfc3962d5 P c3d88e2cde5e44d986d590a5b81ecb8e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 08:39:56.610702 11513 tablet_replica.cc:439] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "08d766969a724484b9f56279645b6c1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } } }
I20260807 08:39:56.610791 11513 tablet_replica.cc:442] T d7f0d3350262427b98db7a8cfc3962d5 P 08d766969a724484b9f56279645b6c1b: This TxnStatusTablet replica's current role is: LEADER
I20260807 08:39:56.611999 11505 tablet_replica.cc:439] T d7f0d3350262427b98db7a8cfc3962d5 P 11151f37daf3472e997c6d85717cf789: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "08d766969a724484b9f56279645b6c1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } } }
I20260807 08:39:56.612102 11505 tablet_replica.cc:442] T d7f0d3350262427b98db7a8cfc3962d5 P 11151f37daf3472e997c6d85717cf789: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 08:39:56.612572 11530 mvcc.cc:205] Tried to move back new op lower bound from 7315832818066518016 to 7315832817978720256. Current Snapshot: MvccSnapshot[applied={T|T < 7315832818066518016}]
I20260807 08:39:56.612766 11531 mvcc.cc:205] Tried to move back new op lower bound from 7315832818066518016 to 7315832817978720256. Current Snapshot: MvccSnapshot[applied={T|T < 7315832818066518016}]
I20260807 08:39:56.621918 11496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.618540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39896 (local address 127.8.208.193:39767)
0807 08:39:56.618969 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:56.618973 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:56.618984 (+ 11us) server_negotiation.cc:407] Connection header received
0807 08:39:56.619021 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:56.619024 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:56.619063 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:56.619122 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:39:56.619366 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.620111 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.620838 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.621176 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.621271 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.621483 (+ 212us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:39:56.621558 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:39:56.621629 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:56.621718 (+ 89us) server_negotiation.cc:299] Negotiation successful
0807 08:39:56.621766 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331}
I20260807 08:39:56.631439 11496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.628469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:41679 (local address 127.8.208.193:39767)
0807 08:39:56.628571 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:56.628575 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:56.628778 (+ 203us) server_negotiation.cc:407] Connection header received
0807 08:39:56.628881 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:56.628883 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:56.628932 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:56.628999 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:39:56.629279 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.629689 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.630482 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.630677 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.630766 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.631067 (+ 301us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:39:56.631126 (+ 59us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:39:56.631194 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:56.631272 (+ 78us) server_negotiation.cc:299] Negotiation successful
0807 08:39:56.631318 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":39}
I20260807 08:39:56.631480 11541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:56.628419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:39767 (local address 127.8.208.193:41679)
0807 08:39:56.628674 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:56.628701 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:56.628809 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:56.629016 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:56.629019 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:56.629025 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 08:39:56.629168 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:56.629174 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.629783 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.629789 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:56.630363 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:56.630370 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:56.630768 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:56.630771 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:56.630891 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:56.630923 (+ 32us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 08:39:56.631206 (+ 283us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 08:39:56.631213 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 08:39:56.631266 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 08:39:56.631340 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":29,"thread_start_us":100,"threads_started":1}
I20260807 08:39:56.637290 11256 raft_consensus.cc:1261] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789 [term 1 FOLLOWER]: Refusing update from remote peer 08d766969a724484b9f56279645b6c1b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:39:56.637301 11425 raft_consensus.cc:1261] T d0a897060b7b40fd97e0f19ef98cfb84 P c3d88e2cde5e44d986d590a5b81ecb8e [term 1 FOLLOWER]: Refusing update from remote peer 08d766969a724484b9f56279645b6c1b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:39:56.637713 11506 consensus_queue.cc:1035] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:39:56.637830 11513 consensus_queue.cc:1035] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:39:56.675035 10931 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:39:56.675200 10931 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:39:56.677320 10931 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9: Sending DeleteTablet for 3 replicas of tablet d0a897060b7b40fd97e0f19ef98cfb84
I20260807 08:39:56.678031 11085 tablet_service.cc:1514] Processing DeleteTablet for tablet d0a897060b7b40fd97e0f19ef98cfb84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:39:56 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:39878
I20260807 08:39:56.678063 11239 tablet_service.cc:1514] Processing DeleteTablet for tablet d0a897060b7b40fd97e0f19ef98cfb84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:39:56 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:38546
I20260807 08:39:56.678437 11546 tablet_replica.cc:330] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b: stopping tablet replica
I20260807 08:39:56.678463 11402 tablet_service.cc:1514] Processing DeleteTablet for tablet d0a897060b7b40fd97e0f19ef98cfb84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:39:56 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:59440
I20260807 08:39:56.678786 11548 tablet_replica.cc:330] T d0a897060b7b40fd97e0f19ef98cfb84 P c3d88e2cde5e44d986d590a5b81ecb8e: stopping tablet replica
I20260807 08:39:56.678797 11546 raft_consensus.cc:2229] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b [term 1 LEADER]: Raft consensus shutting down.
I20260807 08:39:56.679005 11548 raft_consensus.cc:2229] T d0a897060b7b40fd97e0f19ef98cfb84 P c3d88e2cde5e44d986d590a5b81ecb8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:39:56.679014 10931 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55854:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 08:39:56.679186 11548 raft_consensus.cc:2258] T d0a897060b7b40fd97e0f19ef98cfb84 P c3d88e2cde5e44d986d590a5b81ecb8e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260807 08:39:56.679370 10931 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:39:56.679366 11546 raft_consensus.cc:2258] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:39:56.680572 11548 ts_tablet_manager.cc:1905] T d0a897060b7b40fd97e0f19ef98cfb84 P c3d88e2cde5e44d986d590a5b81ecb8e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:39:56.680572 11546 ts_tablet_manager.cc:1905] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:39:56.683215 11546 ts_tablet_manager.cc:1918] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 08:39:56.683215 11548 ts_tablet_manager.cc:1918] T d0a897060b7b40fd97e0f19ef98cfb84 P c3d88e2cde5e44d986d590a5b81ecb8e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 08:39:56.683302 11548 log.cc:1196] T d0a897060b7b40fd97e0f19ef98cfb84 P c3d88e2cde5e44d986d590a5b81ecb8e: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/d0a897060b7b40fd97e0f19ef98cfb84
I20260807 08:39:56.683415 11546 log.cc:1196] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-0/wal/wals/d0a897060b7b40fd97e0f19ef98cfb84
I20260807 08:39:56.683642 11548 ts_tablet_manager.cc:1939] T d0a897060b7b40fd97e0f19ef98cfb84 P c3d88e2cde5e44d986d590a5b81ecb8e: Deleting consensus metadata
I20260807 08:39:56.683863 11546 ts_tablet_manager.cc:1939] T d0a897060b7b40fd97e0f19ef98cfb84 P 08d766969a724484b9f56279645b6c1b: Deleting consensus metadata
I20260807 08:39:56.684661 11085 tablet_service.cc:1467] Processing CreateTablet for tablet d5e3d5c0eee948b696771ceb2f36371e (DEFAULT_TABLE table=test-table [id=c3df3c077a9848018ce095d7b2c6107e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:39:56.684891 11085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5e3d5c0eee948b696771ceb2f36371e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:56.686046 10919 catalog_manager.cc:4841] TS 08d766969a724484b9f56279645b6c1b (127.8.208.193:39767): tablet d0a897060b7b40fd97e0f19ef98cfb84 (table test-table [id=067f9094ef264af7a33f7df344e08865]) successfully deleted
I20260807 08:39:56.686199 11239 tablet_service.cc:1467] Processing CreateTablet for tablet d5e3d5c0eee948b696771ceb2f36371e (DEFAULT_TABLE table=test-table [id=c3df3c077a9848018ce095d7b2c6107e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:39:56.686389 11239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5e3d5c0eee948b696771ceb2f36371e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:56.686671 11501 tablet_bootstrap.cc:492] T d5e3d5c0eee948b696771ceb2f36371e P 08d766969a724484b9f56279645b6c1b: Bootstrap starting.
I20260807 08:39:56.687444 11501 tablet_bootstrap.cc:654] T d5e3d5c0eee948b696771ceb2f36371e P 08d766969a724484b9f56279645b6c1b: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:56.688562 11498 tablet_bootstrap.cc:492] T d5e3d5c0eee948b696771ceb2f36371e P 11151f37daf3472e997c6d85717cf789: Bootstrap starting.
I20260807 08:39:56.688612 11501 tablet_bootstrap.cc:492] T d5e3d5c0eee948b696771ceb2f36371e P 08d766969a724484b9f56279645b6c1b: No bootstrap required, opened a new log
I20260807 08:39:56.688688 11501 ts_tablet_manager.cc:1397] T d5e3d5c0eee948b696771ceb2f36371e P 08d766969a724484b9f56279645b6c1b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 08:39:56.688705 10920 catalog_manager.cc:4841] TS c3d88e2cde5e44d986d590a5b81ecb8e (127.8.208.195:38397): tablet d0a897060b7b40fd97e0f19ef98cfb84 (table test-table [id=067f9094ef264af7a33f7df344e08865]) successfully deleted
I20260807 08:39:56.689112 11547 tablet_replica.cc:330] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789: stopping tablet replica
I20260807 08:39:56.689097 11501 raft_consensus.cc:348] T d5e3d5c0eee948b696771ceb2f36371e P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.689206 11501 raft_consensus.cc:374] T d5e3d5c0eee948b696771ceb2f36371e P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:56.689244 11501 raft_consensus.cc:729] T d5e3d5c0eee948b696771ceb2f36371e P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08d766969a724484b9f56279645b6c1b, State: Initialized, Role: FOLLOWER
I20260807 08:39:56.689350 11501 consensus_queue.cc:260] T d5e3d5c0eee948b696771ceb2f36371e P 08d766969a724484b9f56279645b6c1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.689446 11547 raft_consensus.cc:2229] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:39:56.689589 11501 ts_tablet_manager.cc:1428] T d5e3d5c0eee948b696771ceb2f36371e P 08d766969a724484b9f56279645b6c1b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 08:39:56.689683 11547 raft_consensus.cc:2258] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:39:56.689484 11498 tablet_bootstrap.cc:654] T d5e3d5c0eee948b696771ceb2f36371e P 11151f37daf3472e997c6d85717cf789: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:56.690410 11402 tablet_service.cc:1467] Processing CreateTablet for tablet d5e3d5c0eee948b696771ceb2f36371e (DEFAULT_TABLE table=test-table [id=c3df3c077a9848018ce095d7b2c6107e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:39:56.690652 11402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5e3d5c0eee948b696771ceb2f36371e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:56.691190 11547 ts_tablet_manager.cc:1905] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:39:56.692687 11499 tablet_bootstrap.cc:492] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e: Bootstrap starting.
I20260807 08:39:56.693639 11499 tablet_bootstrap.cc:654] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:56.693681 11547 ts_tablet_manager.cc:1918] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 08:39:56.693830 11547 log.cc:1196] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-1/wal/wals/d0a897060b7b40fd97e0f19ef98cfb84
I20260807 08:39:56.694175 11547 ts_tablet_manager.cc:1939] T d0a897060b7b40fd97e0f19ef98cfb84 P 11151f37daf3472e997c6d85717cf789: Deleting consensus metadata
I20260807 08:39:56.694525 11498 tablet_bootstrap.cc:492] T d5e3d5c0eee948b696771ceb2f36371e P 11151f37daf3472e997c6d85717cf789: No bootstrap required, opened a new log
I20260807 08:39:56.694605 11498 ts_tablet_manager.cc:1397] T d5e3d5c0eee948b696771ceb2f36371e P 11151f37daf3472e997c6d85717cf789: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260807 08:39:56.694957 11498 raft_consensus.cc:348] T d5e3d5c0eee948b696771ceb2f36371e P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.695042 11498 raft_consensus.cc:374] T d5e3d5c0eee948b696771ceb2f36371e P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:56.695072 11498 raft_consensus.cc:729] T d5e3d5c0eee948b696771ceb2f36371e P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11151f37daf3472e997c6d85717cf789, State: Initialized, Role: FOLLOWER
I20260807 08:39:56.695165 11498 consensus_queue.cc:260] T d5e3d5c0eee948b696771ceb2f36371e P 11151f37daf3472e997c6d85717cf789 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.695225 10919 catalog_manager.cc:4841] TS 11151f37daf3472e997c6d85717cf789 (127.8.208.194:44999): tablet d0a897060b7b40fd97e0f19ef98cfb84 (table test-table [id=067f9094ef264af7a33f7df344e08865]) successfully deleted
I20260807 08:39:56.695393 11498 ts_tablet_manager.cc:1428] T d5e3d5c0eee948b696771ceb2f36371e P 11151f37daf3472e997c6d85717cf789: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 08:39:56.695854 11499 tablet_bootstrap.cc:492] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e: No bootstrap required, opened a new log
I20260807 08:39:56.695947 11499 ts_tablet_manager.cc:1397] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260807 08:39:56.696317 11499 raft_consensus.cc:348] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.696430 11499 raft_consensus.cc:374] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:56.696462 11499 raft_consensus.cc:729] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d88e2cde5e44d986d590a5b81ecb8e, State: Initialized, Role: FOLLOWER
I20260807 08:39:56.696607 11499 consensus_queue.cc:260] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:56.696837 11499 ts_tablet_manager.cc:1428] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 08:39:57.008689 11507 raft_consensus.cc:482] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:39:57.008826 11507 raft_consensus.cc:504] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:57.009769 11507 leader_election.cc:288] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08d766969a724484b9f56279645b6c1b (127.8.208.193:39767), 11151f37daf3472e997c6d85717cf789 (127.8.208.194:44999)
I20260807 08:39:57.013880 11496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:57.010169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:34849 (local address 127.8.208.193:39767)
0807 08:39:57.010364 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:57.010368 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:57.010484 (+ 116us) server_negotiation.cc:407] Connection header received
0807 08:39:57.010664 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:57.010667 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:57.010720 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:57.010771 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:39:57.011200 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:57.011784 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:57.012904 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:57.013281 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:57.013392 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:57.013449 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:57.013641 (+ 192us) server_negotiation.cc:299] Negotiation successful
0807 08:39:57.013715 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 08:39:57.013899 11553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:57.010091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:39767 (local address 127.8.208.195:34849)
0807 08:39:57.010400 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:57.010412 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:57.010539 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:57.010934 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:57.010937 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:57.010954 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:39:57.011073 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:57.011079 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:57.011896 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:57.011900 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:57.012753 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:57.012775 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:57.013402 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:57.013406 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:57.013498 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:57.013525 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 08:39:57.013601 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 08:39:57.013687 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"mutex_wait_us":3,"thread_start_us":100,"threads_started":1}
I20260807 08:39:57.013940 11555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:57.010614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:60345 (local address 127.8.208.194:44999)
0807 08:39:57.010831 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:57.010835 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:57.010848 (+ 13us) server_negotiation.cc:407] Connection header received
0807 08:39:57.010928 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:57.010931 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:57.010974 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:57.011064 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:39:57.011353 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:57.011896 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:57.012944 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:57.013304 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:57.013426 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:57.013495 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:57.013708 (+ 213us) server_negotiation.cc:299] Negotiation successful
0807 08:39:57.013785 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":62,"threads_started":1}
I20260807 08:39:57.013911 11554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:57.010496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:44999 (local address 127.8.208.195:60345)
0807 08:39:57.010670 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:57.010682 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:57.010766 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:57.011080 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:57.011082 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:57.011094 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:39:57.011242 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:57.011247 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:57.012006 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:57.012008 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:57.012777 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:57.012785 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:57.013447 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:57.013450 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:57.013559 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:57.013576 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 08:39:57.013676 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 08:39:57.013740 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"mutex_wait_us":3,"thread_start_us":55,"threads_started":1}
I20260807 08:39:57.014441 11256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5e3d5c0eee948b696771ceb2f36371e" candidate_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11151f37daf3472e997c6d85717cf789" is_pre_election: true
I20260807 08:39:57.014449 11100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5e3d5c0eee948b696771ceb2f36371e" candidate_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08d766969a724484b9f56279645b6c1b" is_pre_election: true
I20260807 08:39:57.014588 11256 raft_consensus.cc:2454] T d5e3d5c0eee948b696771ceb2f36371e P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3d88e2cde5e44d986d590a5b81ecb8e in term 0.
I20260807 08:39:57.014605 11100 raft_consensus.cc:2454] T d5e3d5c0eee948b696771ceb2f36371e P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3d88e2cde5e44d986d590a5b81ecb8e in term 0.
I20260807 08:39:57.014941 11347 leader_election.cc:302] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08d766969a724484b9f56279645b6c1b, c3d88e2cde5e44d986d590a5b81ecb8e; no voters:
I20260807 08:39:57.015192 11507 raft_consensus.cc:2781] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:39:57.015250 11507 raft_consensus.cc:482] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:39:57.015285 11507 raft_consensus.cc:3037] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:57.016258 11507 raft_consensus.cc:504] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:57.016564 11507 leader_election.cc:288] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e [CANDIDATE]: Term 1 election: Requested vote from peers 08d766969a724484b9f56279645b6c1b (127.8.208.193:39767), 11151f37daf3472e997c6d85717cf789 (127.8.208.194:44999)
I20260807 08:39:57.016914 11256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5e3d5c0eee948b696771ceb2f36371e" candidate_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11151f37daf3472e997c6d85717cf789"
I20260807 08:39:57.016966 11100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5e3d5c0eee948b696771ceb2f36371e" candidate_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08d766969a724484b9f56279645b6c1b"
I20260807 08:39:57.017047 11256 raft_consensus.cc:3037] T d5e3d5c0eee948b696771ceb2f36371e P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:57.017143 11100 raft_consensus.cc:3037] T d5e3d5c0eee948b696771ceb2f36371e P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:57.017985 11256 raft_consensus.cc:2454] T d5e3d5c0eee948b696771ceb2f36371e P 11151f37daf3472e997c6d85717cf789 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3d88e2cde5e44d986d590a5b81ecb8e in term 1.
I20260807 08:39:57.018326 11347 leader_election.cc:302] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11151f37daf3472e997c6d85717cf789, c3d88e2cde5e44d986d590a5b81ecb8e; no voters:
I20260807 08:39:57.018329 11100 raft_consensus.cc:2454] T d5e3d5c0eee948b696771ceb2f36371e P 08d766969a724484b9f56279645b6c1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3d88e2cde5e44d986d590a5b81ecb8e in term 1.
I20260807 08:39:57.018502 11507 raft_consensus.cc:2781] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:39:57.018679 11507 raft_consensus.cc:686] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e [term 1 LEADER]: Becoming Leader. State: Replica: c3d88e2cde5e44d986d590a5b81ecb8e, State: Running, Role: LEADER
I20260807 08:39:57.018922 11507 consensus_queue.cc:237] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:57.020962 10933 catalog_manager.cc:5495] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d88e2cde5e44d986d590a5b81ecb8e (127.8.208.195). New cstate: current_term: 1 leader_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } health_report { overall_health: HEALTHY } } }
I20260807 08:39:57.063340 11559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:57.060375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59450 (local address 127.8.208.195:38397)
0807 08:39:57.060564 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:57.060575 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:57.060587 (+ 12us) server_negotiation.cc:407] Connection header received
0807 08:39:57.060654 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:57.060656 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:57.060697 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:57.060788 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:39:57.060966 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:57.061453 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:57.062135 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:57.062331 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:57.062402 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:57.062595 (+ 193us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:39:57.062998 (+ 403us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:39:57.063078 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:57.063123 (+ 45us) server_negotiation.cc:299] Negotiation successful
0807 08:39:57.063161 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":64,"threads_started":1}
I20260807 08:39:57.073596 11496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:57.070506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:59607 (local address 127.8.208.193:39767)
0807 08:39:57.070633 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:57.070636 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:57.070717 (+ 81us) server_negotiation.cc:407] Connection header received
0807 08:39:57.070835 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:57.070838 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:57.070883 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:57.070986 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:39:57.071260 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:57.071729 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:57.072557 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:57.072775 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:57.072892 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:57.073166 (+ 274us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:39:57.073232 (+ 66us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:39:57.073306 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:57.073386 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 08:39:57.073434 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 08:39:57.073654 11562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:57.070383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:39767 (local address 127.8.208.195:59607)
0807 08:39:57.070654 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:57.070668 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:57.070757 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:57.071024 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:57.071026 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:57.071033 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 08:39:57.071170 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:57.071179 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:57.071841 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:57.071845 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:57.072430 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:57.072438 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:57.072905 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:57.072909 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:57.073008 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:57.073043 (+ 35us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 08:39:57.073313 (+ 270us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 08:39:57.073322 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 08:39:57.073378 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 08:39:57.073450 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":114,"threads_started":1}
I20260807 08:39:57.079154 11100 raft_consensus.cc:1261] T d5e3d5c0eee948b696771ceb2f36371e P 08d766969a724484b9f56279645b6c1b [term 1 FOLLOWER]: Refusing update from remote peer c3d88e2cde5e44d986d590a5b81ecb8e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:39:57.079495 11256 raft_consensus.cc:1261] T d5e3d5c0eee948b696771ceb2f36371e P 11151f37daf3472e997c6d85717cf789 [term 1 FOLLOWER]: Refusing update from remote peer c3d88e2cde5e44d986d590a5b81ecb8e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:39:57.079664 11556 consensus_queue.cc:1035] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:39:57.079826 11507 consensus_queue.cc:1035] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:39:57.095216 11541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:57.091892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:38397 (local address 127.8.208.193:57069)
0807 08:39:57.092020 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:57.092034 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:57.092133 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:57.092376 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:57.092379 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:57.092386 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 08:39:57.092487 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:57.092492 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:57.093313 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:57.093315 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:57.093973 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:57.093986 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:57.094525 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:57.094529 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:57.094621 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:57.094657 (+ 36us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 08:39:57.094952 (+ 295us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 08:39:57.094958 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 08:39:57.095009 (+ 51us) client_negotiation.cc:240] Negotiation successful
0807 08:39:57.095098 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260807 08:39:57.095211 11559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:57.091938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:57069 (local address 127.8.208.195:38397)
0807 08:39:57.092023 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:57.092029 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:57.092093 (+ 64us) server_negotiation.cc:407] Connection header received
0807 08:39:57.092236 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:57.092238 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:57.092279 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:57.092344 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:39:57.092599 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:57.093215 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:57.094088 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:57.094396 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:57.094511 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:57.094777 (+ 266us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:39:57.094851 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:39:57.094921 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:57.095049 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 08:39:57.095092 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
W20260807 08:39:57.095985 11530 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 08:39:58.650112 10933 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:39:58.650262 10933 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:39:58.652565 10933 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9: Sending DeleteTablet for 3 replicas of tablet d5e3d5c0eee948b696771ceb2f36371e
I20260807 08:39:58.653151 11085 tablet_service.cc:1514] Processing DeleteTablet for tablet d5e3d5c0eee948b696771ceb2f36371e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:39:58 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:39878
I20260807 08:39:58.653159 11402 tablet_service.cc:1514] Processing DeleteTablet for tablet d5e3d5c0eee948b696771ceb2f36371e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:39:58 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:59440
I20260807 08:39:58.653427 11239 tablet_service.cc:1514] Processing DeleteTablet for tablet d5e3d5c0eee948b696771ceb2f36371e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:39:58 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:38546
I20260807 08:39:58.653469 11592 tablet_replica.cc:330] T d5e3d5c0eee948b696771ceb2f36371e P 08d766969a724484b9f56279645b6c1b: stopping tablet replica
I20260807 08:39:58.653599 11592 raft_consensus.cc:2229] T d5e3d5c0eee948b696771ceb2f36371e P 08d766969a724484b9f56279645b6c1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:39:58.653728 11592 raft_consensus.cc:2258] T d5e3d5c0eee948b696771ceb2f36371e P 08d766969a724484b9f56279645b6c1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:39:58.653750 11595 tablet_replica.cc:330] T d5e3d5c0eee948b696771ceb2f36371e P 11151f37daf3472e997c6d85717cf789: stopping tablet replica
I20260807 08:39:58.653925 11595 raft_consensus.cc:2229] T d5e3d5c0eee948b696771ceb2f36371e P 11151f37daf3472e997c6d85717cf789 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:39:58.654042 11595 raft_consensus.cc:2258] T d5e3d5c0eee948b696771ceb2f36371e P 11151f37daf3472e997c6d85717cf789 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:39:58.654225 11593 tablet_replica.cc:330] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e: stopping tablet replica
I20260807 08:39:58.654394 11593 raft_consensus.cc:2229] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e [term 1 LEADER]: Raft consensus shutting down.
I20260807 08:39:58.654670 11593 raft_consensus.cc:2258] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:39:58.654726 11595 ts_tablet_manager.cc:1905] T d5e3d5c0eee948b696771ceb2f36371e P 11151f37daf3472e997c6d85717cf789: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:39:58.655175 11593 ts_tablet_manager.cc:1905] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:39:58.657120 11592 ts_tablet_manager.cc:1905] T d5e3d5c0eee948b696771ceb2f36371e P 08d766969a724484b9f56279645b6c1b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:39:58.657698 11595 ts_tablet_manager.cc:1918] T d5e3d5c0eee948b696771ceb2f36371e P 11151f37daf3472e997c6d85717cf789: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 08:39:58.657783 11595 log.cc:1196] T d5e3d5c0eee948b696771ceb2f36371e P 11151f37daf3472e997c6d85717cf789: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-1/wal/wals/d5e3d5c0eee948b696771ceb2f36371e
I20260807 08:39:58.657874 11593 ts_tablet_manager.cc:1918] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 08:39:58.657951 11593 log.cc:1196] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/d5e3d5c0eee948b696771ceb2f36371e
I20260807 08:39:58.658102 11595 ts_tablet_manager.cc:1939] T d5e3d5c0eee948b696771ceb2f36371e P 11151f37daf3472e997c6d85717cf789: Deleting consensus metadata
I20260807 08:39:58.658241 11593 ts_tablet_manager.cc:1939] T d5e3d5c0eee948b696771ceb2f36371e P c3d88e2cde5e44d986d590a5b81ecb8e: Deleting consensus metadata
I20260807 08:39:58.658740 10919 catalog_manager.cc:4841] TS 11151f37daf3472e997c6d85717cf789 (127.8.208.194:44999): tablet d5e3d5c0eee948b696771ceb2f36371e (table test-table [id=c3df3c077a9848018ce095d7b2c6107e]) successfully deleted
I20260807 08:39:58.658789 10920 catalog_manager.cc:4841] TS c3d88e2cde5e44d986d590a5b81ecb8e (127.8.208.195:38397): tablet d5e3d5c0eee948b696771ceb2f36371e (table test-table [id=c3df3c077a9848018ce095d7b2c6107e]) successfully deleted
I20260807 08:39:58.659970 11592 ts_tablet_manager.cc:1918] T d5e3d5c0eee948b696771ceb2f36371e P 08d766969a724484b9f56279645b6c1b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 08:39:58.660059 11592 log.cc:1196] T d5e3d5c0eee948b696771ceb2f36371e P 08d766969a724484b9f56279645b6c1b: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-0/wal/wals/d5e3d5c0eee948b696771ceb2f36371e
I20260807 08:39:58.660269 11592 ts_tablet_manager.cc:1939] T d5e3d5c0eee948b696771ceb2f36371e P 08d766969a724484b9f56279645b6c1b: Deleting consensus metadata
I20260807 08:39:58.660846 10919 catalog_manager.cc:4841] TS 08d766969a724484b9f56279645b6c1b (127.8.208.193:39767): tablet d5e3d5c0eee948b696771ceb2f36371e (table test-table [id=c3df3c077a9848018ce095d7b2c6107e]) successfully deleted
Aug 07 08:39:58 dist-test-slave-6nmv krb5kdc[10882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091998, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 08:39:58 dist-test-slave-6nmv krb5kdc[10882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786091998, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:39:58.685009 11603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:58.671379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55868 (local address 127.8.208.254:34107)
0807 08:39:58.671643 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:58.671651 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:58.671756 (+ 105us) server_negotiation.cc:407] Connection header received
0807 08:39:58.671924 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:58.671926 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:58.671976 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:58.672064 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:39:58.672727 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:58.673259 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:58.674177 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:58.674408 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:58.674523 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:58.682121 (+ 7598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:39:58.682124 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:39:58.682126 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:39:58.682145 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:39:58.683563 (+ 1418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:58.683966 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:58.683969 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:58.683970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:58.684046 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:39:58.684270 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:39:58.684272 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:39:58.684273 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:39:58.684436 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:39:58.684538 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:58.684750 (+ 212us) server_negotiation.cc:299] Negotiation successful
0807 08:39:58.684869 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":83,"threads_started":1}
I20260807 08:39:58.687289 10933 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55868:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 08:39:58.687645 10933 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:39:58.691658 11085 tablet_service.cc:1467] Processing CreateTablet for tablet df7c8747ccb14639b5f432f79d7fdb00 (DEFAULT_TABLE table=test-table [id=92d239e78f9b49e08b2e0ea4d16a706a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:39:58.691736 11239 tablet_service.cc:1467] Processing CreateTablet for tablet df7c8747ccb14639b5f432f79d7fdb00 (DEFAULT_TABLE table=test-table [id=92d239e78f9b49e08b2e0ea4d16a706a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:39:58.691944 11085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df7c8747ccb14639b5f432f79d7fdb00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:58.691954 11402 tablet_service.cc:1467] Processing CreateTablet for tablet df7c8747ccb14639b5f432f79d7fdb00 (DEFAULT_TABLE table=test-table [id=92d239e78f9b49e08b2e0ea4d16a706a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:39:58.692067 11239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df7c8747ccb14639b5f432f79d7fdb00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:58.692183 11402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df7c8747ccb14639b5f432f79d7fdb00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:58.694010 11604 tablet_bootstrap.cc:492] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789: Bootstrap starting.
I20260807 08:39:58.694484 11606 tablet_bootstrap.cc:492] T df7c8747ccb14639b5f432f79d7fdb00 P c3d88e2cde5e44d986d590a5b81ecb8e: Bootstrap starting.
I20260807 08:39:58.694968 11605 tablet_bootstrap.cc:492] T df7c8747ccb14639b5f432f79d7fdb00 P 08d766969a724484b9f56279645b6c1b: Bootstrap starting.
I20260807 08:39:58.695078 11604 tablet_bootstrap.cc:654] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:58.695369 11606 tablet_bootstrap.cc:654] T df7c8747ccb14639b5f432f79d7fdb00 P c3d88e2cde5e44d986d590a5b81ecb8e: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:58.695819 11605 tablet_bootstrap.cc:654] T df7c8747ccb14639b5f432f79d7fdb00 P 08d766969a724484b9f56279645b6c1b: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:58.696336 11604 tablet_bootstrap.cc:492] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789: No bootstrap required, opened a new log
I20260807 08:39:58.696424 11604 ts_tablet_manager.cc:1397] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 08:39:58.696528 11606 tablet_bootstrap.cc:492] T df7c8747ccb14639b5f432f79d7fdb00 P c3d88e2cde5e44d986d590a5b81ecb8e: No bootstrap required, opened a new log
I20260807 08:39:58.696616 11606 ts_tablet_manager.cc:1397] T df7c8747ccb14639b5f432f79d7fdb00 P c3d88e2cde5e44d986d590a5b81ecb8e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 08:39:58.696910 11605 tablet_bootstrap.cc:492] T df7c8747ccb14639b5f432f79d7fdb00 P 08d766969a724484b9f56279645b6c1b: No bootstrap required, opened a new log
I20260807 08:39:58.696844 11604 raft_consensus.cc:348] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:58.696964 11604 raft_consensus.cc:374] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:58.697016 11604 raft_consensus.cc:729] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11151f37daf3472e997c6d85717cf789, State: Initialized, Role: FOLLOWER
I20260807 08:39:58.697026 11605 ts_tablet_manager.cc:1397] T df7c8747ccb14639b5f432f79d7fdb00 P 08d766969a724484b9f56279645b6c1b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 08:39:58.697089 11606 raft_consensus.cc:348] T df7c8747ccb14639b5f432f79d7fdb00 P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:58.697180 11606 raft_consensus.cc:374] T df7c8747ccb14639b5f432f79d7fdb00 P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:58.697139 11604 consensus_queue.cc:260] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:58.697211 11606 raft_consensus.cc:729] T df7c8747ccb14639b5f432f79d7fdb00 P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d88e2cde5e44d986d590a5b81ecb8e, State: Initialized, Role: FOLLOWER
I20260807 08:39:58.697321 11606 consensus_queue.cc:260] T df7c8747ccb14639b5f432f79d7fdb00 P c3d88e2cde5e44d986d590a5b81ecb8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:58.697520 11604 ts_tablet_manager.cc:1428] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 08:39:58.697605 11606 ts_tablet_manager.cc:1428] T df7c8747ccb14639b5f432f79d7fdb00 P c3d88e2cde5e44d986d590a5b81ecb8e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 08:39:58.698418 11605 raft_consensus.cc:348] T df7c8747ccb14639b5f432f79d7fdb00 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:58.698562 11605 raft_consensus.cc:374] T df7c8747ccb14639b5f432f79d7fdb00 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:58.698602 11605 raft_consensus.cc:729] T df7c8747ccb14639b5f432f79d7fdb00 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08d766969a724484b9f56279645b6c1b, State: Initialized, Role: FOLLOWER
I20260807 08:39:58.698715 11605 consensus_queue.cc:260] T df7c8747ccb14639b5f432f79d7fdb00 P 08d766969a724484b9f56279645b6c1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:58.699059 11605 ts_tablet_manager.cc:1428] T df7c8747ccb14639b5f432f79d7fdb00 P 08d766969a724484b9f56279645b6c1b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 08:39:58.885336 11610 raft_consensus.cc:482] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:39:58.885504 11610 raft_consensus.cc:504] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:58.886005 11610 leader_election.cc:288] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08d766969a724484b9f56279645b6c1b (127.8.208.193:39767), c3d88e2cde5e44d986d590a5b81ecb8e (127.8.208.195:38397)
I20260807 08:39:58.886525 11425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df7c8747ccb14639b5f432f79d7fdb00" candidate_uuid: "11151f37daf3472e997c6d85717cf789" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" is_pre_election: true
I20260807 08:39:58.886528 11100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df7c8747ccb14639b5f432f79d7fdb00" candidate_uuid: "11151f37daf3472e997c6d85717cf789" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08d766969a724484b9f56279645b6c1b" is_pre_election: true
I20260807 08:39:58.886677 11425 raft_consensus.cc:2454] T df7c8747ccb14639b5f432f79d7fdb00 P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11151f37daf3472e997c6d85717cf789 in term 0.
I20260807 08:39:58.886724 11100 raft_consensus.cc:2454] T df7c8747ccb14639b5f432f79d7fdb00 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11151f37daf3472e997c6d85717cf789 in term 0.
I20260807 08:39:58.887126 11188 leader_election.cc:302] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08d766969a724484b9f56279645b6c1b, 11151f37daf3472e997c6d85717cf789; no voters:
I20260807 08:39:58.887387 11610 raft_consensus.cc:2781] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:39:58.887452 11610 raft_consensus.cc:482] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:39:58.887498 11610 raft_consensus.cc:3037] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:58.888466 11610 raft_consensus.cc:504] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:58.888875 11610 leader_election.cc:288] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789 [CANDIDATE]: Term 1 election: Requested vote from peers 08d766969a724484b9f56279645b6c1b (127.8.208.193:39767), c3d88e2cde5e44d986d590a5b81ecb8e (127.8.208.195:38397)
I20260807 08:39:58.889168 11100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df7c8747ccb14639b5f432f79d7fdb00" candidate_uuid: "11151f37daf3472e997c6d85717cf789" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08d766969a724484b9f56279645b6c1b"
I20260807 08:39:58.889309 11100 raft_consensus.cc:3037] T df7c8747ccb14639b5f432f79d7fdb00 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:58.889278 11425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df7c8747ccb14639b5f432f79d7fdb00" candidate_uuid: "11151f37daf3472e997c6d85717cf789" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e"
I20260807 08:39:58.889434 11425 raft_consensus.cc:3037] T df7c8747ccb14639b5f432f79d7fdb00 P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:58.890588 11425 raft_consensus.cc:2454] T df7c8747ccb14639b5f432f79d7fdb00 P c3d88e2cde5e44d986d590a5b81ecb8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11151f37daf3472e997c6d85717cf789 in term 1.
I20260807 08:39:58.890587 11100 raft_consensus.cc:2454] T df7c8747ccb14639b5f432f79d7fdb00 P 08d766969a724484b9f56279645b6c1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11151f37daf3472e997c6d85717cf789 in term 1.
I20260807 08:39:58.890841 11189 leader_election.cc:302] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11151f37daf3472e997c6d85717cf789, c3d88e2cde5e44d986d590a5b81ecb8e; no voters:
I20260807 08:39:58.891115 11610 raft_consensus.cc:2781] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:39:58.891319 11610 raft_consensus.cc:686] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789 [term 1 LEADER]: Becoming Leader. State: Replica: 11151f37daf3472e997c6d85717cf789, State: Running, Role: LEADER
I20260807 08:39:58.891572 11610 consensus_queue.cc:237] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:58.894528 10933 catalog_manager.cc:5495] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11151f37daf3472e997c6d85717cf789 (127.8.208.194). New cstate: current_term: 1 leader_uuid: "11151f37daf3472e997c6d85717cf789" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } health_report { overall_health: UNKNOWN } } }
I20260807 08:39:58.936138 11614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:58.932986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38550 (local address 127.8.208.194:44999)
0807 08:39:58.933200 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:58.933206 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:58.933216 (+ 10us) server_negotiation.cc:407] Connection header received
0807 08:39:58.933275 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:58.933277 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:58.933322 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:58.933426 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:39:58.933586 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:58.934125 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:58.934924 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:58.935120 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:58.935191 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:58.935439 (+ 248us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:39:58.935843 (+ 404us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:39:58.935942 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:58.935991 (+ 49us) server_negotiation.cc:299] Negotiation successful
0807 08:39:58.936032 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":97,"threads_started":1}
I20260807 08:39:58.945463 11617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:58.942260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:39767 (local address 127.8.208.194:37719)
0807 08:39:58.942543 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:58.942555 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:58.942628 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:58.942890 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:58.942892 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:58.942899 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 08:39:58.942986 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:58.942990 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:58.943653 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:58.943655 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:58.944357 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:58.944367 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:58.944837 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:58.944839 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:58.944918 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:58.944958 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 08:39:58.945216 (+ 258us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 08:39:58.945220 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 08:39:58.945269 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 08:39:58.945331 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":97,"threads_started":1}
I20260807 08:39:58.945465 11618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:58.942447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:37719 (local address 127.8.208.193:39767)
0807 08:39:58.942690 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:58.942697 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:58.942708 (+ 11us) server_negotiation.cc:407] Connection header received
0807 08:39:58.942745 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:58.942747 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:58.942785 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:58.942856 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:39:58.943075 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:58.943565 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:58.944485 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:58.944713 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:58.944795 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:58.945075 (+ 280us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:39:58.945139 (+ 64us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:39:58.945193 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:58.945294 (+ 101us) server_negotiation.cc:299] Negotiation successful
0807 08:39:58.945339 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":110,"threads_started":1}
I20260807 08:39:58.951156 11100 raft_consensus.cc:1261] T df7c8747ccb14639b5f432f79d7fdb00 P 08d766969a724484b9f56279645b6c1b [term 1 FOLLOWER]: Refusing update from remote peer 11151f37daf3472e997c6d85717cf789: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:39:58.951156 11425 raft_consensus.cc:1261] T df7c8747ccb14639b5f432f79d7fdb00 P c3d88e2cde5e44d986d590a5b81ecb8e [term 1 FOLLOWER]: Refusing update from remote peer 11151f37daf3472e997c6d85717cf789: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:39:58.951678 11611 consensus_queue.cc:1035] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:39:58.951864 11610 consensus_queue.cc:1035] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:39:58.972055 11623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:58.968086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:44999 (local address 127.8.208.193:60803)
0807 08:39:58.968331 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0807 08:39:58.968345 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:39:58.968456 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:39:58.968762 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:39:58.968767 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:39:58.968775 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 08:39:58.968869 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:58.968873 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:58.969682 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:58.969688 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:58.970610 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:39:58.970620 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:39:58.971355 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:39:58.971358 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:39:58.971450 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:58.971482 (+ 32us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 08:39:58.971797 (+ 315us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 08:39:58.971804 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 08:39:58.971864 (+ 60us) client_negotiation.cc:240] Negotiation successful
0807 08:39:58.971942 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":92,"threads_started":1}
I20260807 08:39:58.972064 11614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:58.968122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:60803 (local address 127.8.208.194:44999)
0807 08:39:58.968227 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:58.968231 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:58.968412 (+ 181us) server_negotiation.cc:407] Connection header received
0807 08:39:58.968554 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:58.968557 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:58.968608 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:58.968685 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:39:58.968972 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:58.969557 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:58.970742 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:58.971133 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:58.971242 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:58.971627 (+ 385us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:39:58.971706 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:39:58.971773 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:58.971894 (+ 121us) server_negotiation.cc:299] Negotiation successful
0807 08:39:58.971951 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 08:39:58.994408 10933 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:39:58.994549 10933 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:39:58.996389 10933 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9: Sending DeleteTablet for 3 replicas of tablet df7c8747ccb14639b5f432f79d7fdb00
I20260807 08:39:58.996887 11085 tablet_service.cc:1514] Processing DeleteTablet for tablet df7c8747ccb14639b5f432f79d7fdb00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:39:58 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:39878
I20260807 08:39:58.996971 11239 tablet_service.cc:1514] Processing DeleteTablet for tablet df7c8747ccb14639b5f432f79d7fdb00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:39:58 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:38546
I20260807 08:39:58.997051 11592 tablet_replica.cc:330] T df7c8747ccb14639b5f432f79d7fdb00 P 08d766969a724484b9f56279645b6c1b: stopping tablet replica
I20260807 08:39:58.997053 11402 tablet_service.cc:1514] Processing DeleteTablet for tablet df7c8747ccb14639b5f432f79d7fdb00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:39:58 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:59440
I20260807 08:39:58.997157 11592 raft_consensus.cc:2229] T df7c8747ccb14639b5f432f79d7fdb00 P 08d766969a724484b9f56279645b6c1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:39:58.997218 11593 tablet_replica.cc:330] T df7c8747ccb14639b5f432f79d7fdb00 P c3d88e2cde5e44d986d590a5b81ecb8e: stopping tablet replica
I20260807 08:39:58.997246 11592 raft_consensus.cc:2258] T df7c8747ccb14639b5f432f79d7fdb00 P 08d766969a724484b9f56279645b6c1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:39:58.997328 11593 raft_consensus.cc:2229] T df7c8747ccb14639b5f432f79d7fdb00 P c3d88e2cde5e44d986d590a5b81ecb8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:39:58.997380 11595 tablet_replica.cc:330] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789: stopping tablet replica
I20260807 08:39:58.997433 11593 raft_consensus.cc:2258] T df7c8747ccb14639b5f432f79d7fdb00 P c3d88e2cde5e44d986d590a5b81ecb8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:39:58.997486 11595 raft_consensus.cc:2229] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789 [term 1 LEADER]: Raft consensus shutting down.
I20260807 08:39:58.997704 11595 raft_consensus.cc:2258] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:39:58.998027 10933 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55868:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 08:39:58.998200 11593 ts_tablet_manager.cc:1905] T df7c8747ccb14639b5f432f79d7fdb00 P c3d88e2cde5e44d986d590a5b81ecb8e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 08:39:58.998412 10933 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:39:58.998859 11592 ts_tablet_manager.cc:1905] T df7c8747ccb14639b5f432f79d7fdb00 P 08d766969a724484b9f56279645b6c1b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:39:59.001304 11592 ts_tablet_manager.cc:1918] T df7c8747ccb14639b5f432f79d7fdb00 P 08d766969a724484b9f56279645b6c1b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 08:39:59.001372 11592 log.cc:1196] T df7c8747ccb14639b5f432f79d7fdb00 P 08d766969a724484b9f56279645b6c1b: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-0/wal/wals/df7c8747ccb14639b5f432f79d7fdb00
I20260807 08:39:59.001629 11592 ts_tablet_manager.cc:1939] T df7c8747ccb14639b5f432f79d7fdb00 P 08d766969a724484b9f56279645b6c1b: Deleting consensus metadata
I20260807 08:39:59.001998 11593 ts_tablet_manager.cc:1918] T df7c8747ccb14639b5f432f79d7fdb00 P c3d88e2cde5e44d986d590a5b81ecb8e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 08:39:59.002074 11593 log.cc:1196] T df7c8747ccb14639b5f432f79d7fdb00 P c3d88e2cde5e44d986d590a5b81ecb8e: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/df7c8747ccb14639b5f432f79d7fdb00
I20260807 08:39:59.002319 11593 ts_tablet_manager.cc:1939] T df7c8747ccb14639b5f432f79d7fdb00 P c3d88e2cde5e44d986d590a5b81ecb8e: Deleting consensus metadata
I20260807 08:39:59.002506 11595 ts_tablet_manager.cc:1905] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:39:59.003157 11402 tablet_service.cc:1467] Processing CreateTablet for tablet 1f1586de45fb44168520b2bb6b0c3b25 (DEFAULT_TABLE table=test-table [id=176ac953f32144cda25c967ff3baf7fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:39:59.003398 11402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f1586de45fb44168520b2bb6b0c3b25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:59.003537 10920 catalog_manager.cc:4841] TS c3d88e2cde5e44d986d590a5b81ecb8e (127.8.208.195:38397): tablet df7c8747ccb14639b5f432f79d7fdb00 (table test-table [id=92d239e78f9b49e08b2e0ea4d16a706a]) successfully deleted
I20260807 08:39:59.004159 11239 tablet_service.cc:1467] Processing CreateTablet for tablet 1f1586de45fb44168520b2bb6b0c3b25 (DEFAULT_TABLE table=test-table [id=176ac953f32144cda25c967ff3baf7fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:39:59.004407 11239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f1586de45fb44168520b2bb6b0c3b25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:59.005203 11595 ts_tablet_manager.cc:1918] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 08:39:59.005266 11595 log.cc:1196] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-1/wal/wals/df7c8747ccb14639b5f432f79d7fdb00
I20260807 08:39:59.005524 11595 ts_tablet_manager.cc:1939] T df7c8747ccb14639b5f432f79d7fdb00 P 11151f37daf3472e997c6d85717cf789: Deleting consensus metadata
I20260807 08:39:59.005664 11606 tablet_bootstrap.cc:492] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e: Bootstrap starting.
I20260807 08:39:59.006326 11085 tablet_service.cc:1467] Processing CreateTablet for tablet 1f1586de45fb44168520b2bb6b0c3b25 (DEFAULT_TABLE table=test-table [id=176ac953f32144cda25c967ff3baf7fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:39:59.006505 11606 tablet_bootstrap.cc:654] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:59.006539 11085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f1586de45fb44168520b2bb6b0c3b25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:39:59.006979 11604 tablet_bootstrap.cc:492] T 1f1586de45fb44168520b2bb6b0c3b25 P 11151f37daf3472e997c6d85717cf789: Bootstrap starting.
I20260807 08:39:59.007865 11604 tablet_bootstrap.cc:654] T 1f1586de45fb44168520b2bb6b0c3b25 P 11151f37daf3472e997c6d85717cf789: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:59.008381 11606 tablet_bootstrap.cc:492] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e: No bootstrap required, opened a new log
I20260807 08:39:59.008464 11606 ts_tablet_manager.cc:1397] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260807 08:39:59.008788 11606 raft_consensus.cc:348] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:59.008910 11606 raft_consensus.cc:374] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:59.008982 11606 raft_consensus.cc:729] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d88e2cde5e44d986d590a5b81ecb8e, State: Initialized, Role: FOLLOWER
I20260807 08:39:59.009119 11606 consensus_queue.cc:260] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:59.009395 11606 ts_tablet_manager.cc:1428] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 08:39:59.009492 10919 catalog_manager.cc:4841] TS 08d766969a724484b9f56279645b6c1b (127.8.208.193:39767): tablet df7c8747ccb14639b5f432f79d7fdb00 (table test-table [id=92d239e78f9b49e08b2e0ea4d16a706a]) successfully deleted
I20260807 08:39:59.009755 11605 tablet_bootstrap.cc:492] T 1f1586de45fb44168520b2bb6b0c3b25 P 08d766969a724484b9f56279645b6c1b: Bootstrap starting.
I20260807 08:39:59.010462 11605 tablet_bootstrap.cc:654] T 1f1586de45fb44168520b2bb6b0c3b25 P 08d766969a724484b9f56279645b6c1b: Neither blocks nor log segments found. Creating new log.
I20260807 08:39:59.010828 11604 tablet_bootstrap.cc:492] T 1f1586de45fb44168520b2bb6b0c3b25 P 11151f37daf3472e997c6d85717cf789: No bootstrap required, opened a new log
I20260807 08:39:59.010926 11604 ts_tablet_manager.cc:1397] T 1f1586de45fb44168520b2bb6b0c3b25 P 11151f37daf3472e997c6d85717cf789: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260807 08:39:59.011441 11605 tablet_bootstrap.cc:492] T 1f1586de45fb44168520b2bb6b0c3b25 P 08d766969a724484b9f56279645b6c1b: No bootstrap required, opened a new log
I20260807 08:39:59.011368 11604 raft_consensus.cc:348] T 1f1586de45fb44168520b2bb6b0c3b25 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:59.011519 11604 raft_consensus.cc:374] T 1f1586de45fb44168520b2bb6b0c3b25 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:59.011528 11605 ts_tablet_manager.cc:1397] T 1f1586de45fb44168520b2bb6b0c3b25 P 08d766969a724484b9f56279645b6c1b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 08:39:59.011559 11604 raft_consensus.cc:729] T 1f1586de45fb44168520b2bb6b0c3b25 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11151f37daf3472e997c6d85717cf789, State: Initialized, Role: FOLLOWER
I20260807 08:39:59.011566 10919 catalog_manager.cc:4841] TS 11151f37daf3472e997c6d85717cf789 (127.8.208.194:44999): tablet df7c8747ccb14639b5f432f79d7fdb00 (table test-table [id=92d239e78f9b49e08b2e0ea4d16a706a]) successfully deleted
I20260807 08:39:59.011708 11604 consensus_queue.cc:260] T 1f1586de45fb44168520b2bb6b0c3b25 P 11151f37daf3472e997c6d85717cf789 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:59.011893 11605 raft_consensus.cc:348] T 1f1586de45fb44168520b2bb6b0c3b25 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:59.011996 11605 raft_consensus.cc:374] T 1f1586de45fb44168520b2bb6b0c3b25 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:39:59.011996 11604 ts_tablet_manager.cc:1428] T 1f1586de45fb44168520b2bb6b0c3b25 P 11151f37daf3472e997c6d85717cf789: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 08:39:59.012025 11605 raft_consensus.cc:729] T 1f1586de45fb44168520b2bb6b0c3b25 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08d766969a724484b9f56279645b6c1b, State: Initialized, Role: FOLLOWER
I20260807 08:39:59.012126 11605 consensus_queue.cc:260] T 1f1586de45fb44168520b2bb6b0c3b25 P 08d766969a724484b9f56279645b6c1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:59.012356 11605 ts_tablet_manager.cc:1428] T 1f1586de45fb44168520b2bb6b0c3b25 P 08d766969a724484b9f56279645b6c1b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 08:39:59.258109 11582 raft_consensus.cc:482] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:39:59.258255 11582 raft_consensus.cc:504] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:59.258643 11582 leader_election.cc:288] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08d766969a724484b9f56279645b6c1b (127.8.208.193:39767), 11151f37daf3472e997c6d85717cf789 (127.8.208.194:44999)
I20260807 08:39:59.259049 11100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f1586de45fb44168520b2bb6b0c3b25" candidate_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08d766969a724484b9f56279645b6c1b" is_pre_election: true
I20260807 08:39:59.259112 11264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f1586de45fb44168520b2bb6b0c3b25" candidate_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11151f37daf3472e997c6d85717cf789" is_pre_election: true
I20260807 08:39:59.259199 11100 raft_consensus.cc:2454] T 1f1586de45fb44168520b2bb6b0c3b25 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3d88e2cde5e44d986d590a5b81ecb8e in term 0.
I20260807 08:39:59.259276 11264 raft_consensus.cc:2454] T 1f1586de45fb44168520b2bb6b0c3b25 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3d88e2cde5e44d986d590a5b81ecb8e in term 0.
I20260807 08:39:59.259523 11347 leader_election.cc:302] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08d766969a724484b9f56279645b6c1b, c3d88e2cde5e44d986d590a5b81ecb8e; no voters:
I20260807 08:39:59.259716 11582 raft_consensus.cc:2781] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:39:59.259793 11582 raft_consensus.cc:482] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:39:59.259838 11582 raft_consensus.cc:3037] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:59.260834 11582 raft_consensus.cc:504] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:59.261109 11582 leader_election.cc:288] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e [CANDIDATE]: Term 1 election: Requested vote from peers 08d766969a724484b9f56279645b6c1b (127.8.208.193:39767), 11151f37daf3472e997c6d85717cf789 (127.8.208.194:44999)
I20260807 08:39:59.261530 11100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f1586de45fb44168520b2bb6b0c3b25" candidate_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08d766969a724484b9f56279645b6c1b"
I20260807 08:39:59.261646 11100 raft_consensus.cc:3037] T 1f1586de45fb44168520b2bb6b0c3b25 P 08d766969a724484b9f56279645b6c1b [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:59.261669 11264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f1586de45fb44168520b2bb6b0c3b25" candidate_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11151f37daf3472e997c6d85717cf789"
I20260807 08:39:59.261781 11264 raft_consensus.cc:3037] T 1f1586de45fb44168520b2bb6b0c3b25 P 11151f37daf3472e997c6d85717cf789 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:39:59.262521 11100 raft_consensus.cc:2454] T 1f1586de45fb44168520b2bb6b0c3b25 P 08d766969a724484b9f56279645b6c1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3d88e2cde5e44d986d590a5b81ecb8e in term 1.
I20260807 08:39:59.262760 11264 raft_consensus.cc:2454] T 1f1586de45fb44168520b2bb6b0c3b25 P 11151f37daf3472e997c6d85717cf789 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3d88e2cde5e44d986d590a5b81ecb8e in term 1.
I20260807 08:39:59.263041 11347 leader_election.cc:302] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11151f37daf3472e997c6d85717cf789, c3d88e2cde5e44d986d590a5b81ecb8e; no voters:
I20260807 08:39:59.263242 11582 raft_consensus.cc:2781] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:39:59.263409 11582 raft_consensus.cc:686] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e [term 1 LEADER]: Becoming Leader. State: Replica: c3d88e2cde5e44d986d590a5b81ecb8e, State: Running, Role: LEADER
I20260807 08:39:59.263561 11582 consensus_queue.cc:237] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } }
I20260807 08:39:59.265113 10930 catalog_manager.cc:5495] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e reported cstate change: term changed from 0 to 1, leader changed from <none> to c3d88e2cde5e44d986d590a5b81ecb8e (127.8.208.195). New cstate: current_term: 1 leader_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3d88e2cde5e44d986d590a5b81ecb8e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 38397 } health_report { overall_health: HEALTHY } } }
I20260807 08:39:59.304898 11630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:39:59.301873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59464 (local address 127.8.208.195:38397)
0807 08:39:59.302227 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0807 08:39:59.302240 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 08:39:59.302249 (+ 9us) server_negotiation.cc:407] Connection header received
0807 08:39:59.302286 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:39:59.302288 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:39:59.302319 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:39:59.302378 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:39:59.302642 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:59.303122 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:59.303954 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:39:59.304170 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:39:59.304246 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:39:59.304470 (+ 224us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:39:59.304532 (+ 62us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:39:59.304587 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 08:39:59.304733 (+ 146us) server_negotiation.cc:299] Negotiation successful
0807 08:39:59.304777 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":96,"threads_started":1}
I20260807 08:39:59.310176 11264 raft_consensus.cc:1261] T 1f1586de45fb44168520b2bb6b0c3b25 P 11151f37daf3472e997c6d85717cf789 [term 1 FOLLOWER]: Refusing update from remote peer c3d88e2cde5e44d986d590a5b81ecb8e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:39:59.310242 11100 raft_consensus.cc:1261] T 1f1586de45fb44168520b2bb6b0c3b25 P 08d766969a724484b9f56279645b6c1b [term 1 FOLLOWER]: Refusing update from remote peer c3d88e2cde5e44d986d590a5b81ecb8e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:39:59.310570 11582 consensus_queue.cc:1035] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11151f37daf3472e997c6d85717cf789" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 44999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:39:59.310701 11628 consensus_queue.cc:1035] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "08d766969a724484b9f56279645b6c1b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:39:59.315090 11569 mvcc.cc:205] Tried to move back new op lower bound from 7315832829171650560 to 7315832828984938496. Current Snapshot: MvccSnapshot[applied={T|T < 7315832829171650560}]
W20260807 08:39:59.321938 11572 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 08:40:00.870551 10932 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:40:00.870682 10932 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:40:00.872975 10932 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7b2f1cb1b73a4a9bafa0b1e3a1612fe9: Sending DeleteTablet for 3 replicas of tablet 1f1586de45fb44168520b2bb6b0c3b25
I20260807 08:40:00.873463 11084 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f1586de45fb44168520b2bb6b0c3b25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:00 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:39878
I20260807 08:40:00.873518 11239 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f1586de45fb44168520b2bb6b0c3b25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:00 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:38546
I20260807 08:40:00.873626 11402 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f1586de45fb44168520b2bb6b0c3b25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:00 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:59440
I20260807 08:40:00.873834 11658 tablet_replica.cc:330] T 1f1586de45fb44168520b2bb6b0c3b25 P 11151f37daf3472e997c6d85717cf789: stopping tablet replica
I20260807 08:40:00.873973 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 11012
I20260807 08:40:00.873991 11658 raft_consensus.cc:2229] T 1f1586de45fb44168520b2bb6b0c3b25 P 11151f37daf3472e997c6d85717cf789 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:40:00.876997 11658 raft_consensus.cc:2258] T 1f1586de45fb44168520b2bb6b0c3b25 P 11151f37daf3472e997c6d85717cf789 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:00.877072 11659 tablet_replica.cc:330] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e: stopping tablet replica
I20260807 08:40:00.877193 11659 raft_consensus.cc:2229] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e [term 1 LEADER]: Raft consensus shutting down.
I20260807 08:40:00.877369 11659 raft_consensus.cc:2258] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:00.877688 11658 ts_tablet_manager.cc:1905] T 1f1586de45fb44168520b2bb6b0c3b25 P 11151f37daf3472e997c6d85717cf789: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:00.877938 11659 ts_tablet_manager.cc:1905] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:00.880065 11659 ts_tablet_manager.cc:1918] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 08:40:00.880162 11659 log.cc:1196] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/1f1586de45fb44168520b2bb6b0c3b25
I20260807 08:40:00.880441 11659 ts_tablet_manager.cc:1939] T 1f1586de45fb44168520b2bb6b0c3b25 P c3d88e2cde5e44d986d590a5b81ecb8e: Deleting consensus metadata
I20260807 08:40:00.881050 11658 ts_tablet_manager.cc:1918] T 1f1586de45fb44168520b2bb6b0c3b25 P 11151f37daf3472e997c6d85717cf789: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 08:40:00.881054 10920 catalog_manager.cc:4841] TS c3d88e2cde5e44d986d590a5b81ecb8e (127.8.208.195:38397): tablet 1f1586de45fb44168520b2bb6b0c3b25 (table test-table [id=176ac953f32144cda25c967ff3baf7fb]) successfully deleted
I20260807 08:40:00.881129 11658 log.cc:1196] T 1f1586de45fb44168520b2bb6b0c3b25 P 11151f37daf3472e997c6d85717cf789: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786091987266300-9027-0/minicluster-data/ts-1/wal/wals/1f1586de45fb44168520b2bb6b0c3b25
I20260807 08:40:00.881390 11658 ts_tablet_manager.cc:1939] T 1f1586de45fb44168520b2bb6b0c3b25 P 11151f37daf3472e997c6d85717cf789: Deleting consensus metadata
I20260807 08:40:00.882045 10919 catalog_manager.cc:4841] TS 11151f37daf3472e997c6d85717cf789 (127.8.208.194:44999): tablet 1f1586de45fb44168520b2bb6b0c3b25 (table test-table [id=176ac953f32144cda25c967ff3baf7fb]) successfully deleted
W20260807 08:40:00.885991 10919 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.208.193:39767 (error 108)
I20260807 08:40:00.886226 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 11169
I20260807 08:40:00.888530 11661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:00.888022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:39767 (local address 127.0.0.1:39906)
0807 08:40:00.888305 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:00.888405 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.193:39767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":86,"threads_started":1}
W20260807 08:40:00.888696 10919 catalog_manager.cc:4584] TS 08d766969a724484b9f56279645b6c1b (127.8.208.193:39767): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1f1586de45fb44168520b2bb6b0c3b25: Network error: Client connection negotiation failed: client connection to 127.8.208.193:39767: connect: Connection refused (error 111)
I20260807 08:40:00.894088 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 11328
I20260807 08:40:00.901997 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 10897
2026-08-07T08:40:00Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6716 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:40:00 dist-test-slave-6nmv krb5kdc[11665](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:40:00 dist-test-slave-6nmv krb5kdc[11665](info): set up 2 sockets
Aug 07 08:40:00 dist-test-slave-6nmv krb5kdc[11665](info): commencing operation
krb5kdc: starting...
W20260807 08:40:01.921898 9027 mini_kdc.cc:121] Time spent starting KDC: real 0.997s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:40:02 dist-test-slave-6nmv krb5kdc[11665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:40:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:40:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:40:02.043010 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:44041
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:34883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:44041
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:02.152051 11680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:02.152280 11680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:02.152319 11680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:02.156198 11680 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:40:02.156243 11680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:02.156261 11680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:02.156277 11680 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:40:02.156292 11680 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:40:02.161167 11680 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:34883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:44041
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:44041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:02.162114 11680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:02.163002 11680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 08:40:02.171310 11680 server_base.cc:1034] running on GCE node
W20260807 08:40:02.171446 11689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:02.171326 11687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:02.171339 11686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:02.172109 11680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:02.173070 11680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:02.174256 11680 hybrid_clock.cc:648] HybridClock initialized: now 1786092002174225 us; error 42 us; skew 500 ppm
Aug 07 08:40:02 dist-test-slave-6nmv krb5kdc[11665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092002, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:02.176914 11680 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:40:02.177690 11680 webserver.cc:460] Webserver started at http://127.8.208.254:46195/ using document root <none> and password file <none>
I20260807 08:40:02.178246 11680 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:02.178332 11680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:02.178584 11680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:02.180466 11680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "1b45415522b34cd5956827f2e26db80a"
format_stamp: "Formatted at 2026-08-07 08:40:02 on dist-test-slave-6nmv"
server_key: "9858fd4766a28ecc03da953065716dcd"
server_key_iv: "8ffd1199ce182249d047341fda9baaf3"
server_key_version: "encryptionkey@0"
I20260807 08:40:02.180998 11680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "1b45415522b34cd5956827f2e26db80a"
format_stamp: "Formatted at 2026-08-07 08:40:02 on dist-test-slave-6nmv"
server_key: "9858fd4766a28ecc03da953065716dcd"
server_key_iv: "8ffd1199ce182249d047341fda9baaf3"
server_key_version: "encryptionkey@0"
I20260807 08:40:02.184393 11680 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 08:40:02.186618 11697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:02.187707 11680 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:40:02.187851 11680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "1b45415522b34cd5956827f2e26db80a"
format_stamp: "Formatted at 2026-08-07 08:40:02 on dist-test-slave-6nmv"
server_key: "9858fd4766a28ecc03da953065716dcd"
server_key_iv: "8ffd1199ce182249d047341fda9baaf3"
server_key_version: "encryptionkey@0"
I20260807 08:40:02.187953 11680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:02.196076 11680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:02.198868 11680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:02.199045 11680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:02.205425 11680 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:44041
I20260807 08:40:02.205495 11753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:44041 every 8 connection(s)
I20260807 08:40:02.206332 11680 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:40:02.208729 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 11680
I20260807 08:40:02.208869 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:40:02.208961 11754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:02.209179 9027 external_mini_cluster.cc:1428] Setting key b272d76d4c88a4e629f0bf1a4f5b47e7
I20260807 08:40:02.215998 11754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b45415522b34cd5956827f2e26db80a: Bootstrap starting.
Aug 07 08:40:02 dist-test-slave-6nmv krb5kdc[11665](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:02.218333 11754 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b45415522b34cd5956827f2e26db80a: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:02.219063 11754 log.cc:824] T 00000000000000000000000000000000 P 1b45415522b34cd5956827f2e26db80a: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:02.221328 11754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b45415522b34cd5956827f2e26db80a: No bootstrap required, opened a new log
I20260807 08:40:02.223840 11757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:02.210581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53134 (local address 127.8.208.254:44041)
0807 08:40:02.211005 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:02.211023 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:02.211064 (+ 41us) server_negotiation.cc:407] Connection header received
0807 08:40:02.211752 (+ 688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:02.211776 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:02.212170 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:02.212535 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:02.213205 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:02.214723 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:02.215600 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:02.216212 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:02.216355 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:02.218944 (+ 2589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:02.218952 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:02.218967 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:02.218994 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:02.220919 (+ 1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:02.221554 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:02.221559 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:02.221563 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:02.221694 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:02.222025 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:02.222030 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:02.222033 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:02.222415 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:02.222645 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:02.222881 (+ 236us) server_negotiation.cc:299] Negotiation successful
0807 08:40:02.223162 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":106,"threads_started":1}
I20260807 08:40:02.226347 11754 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b45415522b34cd5956827f2e26db80a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b45415522b34cd5956827f2e26db80a" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 44041 } }
I20260807 08:40:02.226548 11754 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1b45415522b34cd5956827f2e26db80a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:02.226629 11754 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b45415522b34cd5956827f2e26db80a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b45415522b34cd5956827f2e26db80a, State: Initialized, Role: FOLLOWER
I20260807 08:40:02.227029 11754 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b45415522b34cd5956827f2e26db80a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b45415522b34cd5956827f2e26db80a" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 44041 } }
I20260807 08:40:02.227177 11754 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b45415522b34cd5956827f2e26db80a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:40:02.227243 11754 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b45415522b34cd5956827f2e26db80a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:40:02.227344 11754 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b45415522b34cd5956827f2e26db80a [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:02.228230 11754 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b45415522b34cd5956827f2e26db80a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b45415522b34cd5956827f2e26db80a" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 44041 } }
I20260807 08:40:02.228569 11754 leader_election.cc:302] T 00000000000000000000000000000000 P 1b45415522b34cd5956827f2e26db80a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b45415522b34cd5956827f2e26db80a; no voters:
I20260807 08:40:02.228906 11754 leader_election.cc:288] T 00000000000000000000000000000000 P 1b45415522b34cd5956827f2e26db80a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:40:02.229056 11759 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b45415522b34cd5956827f2e26db80a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:02.229543 11759 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b45415522b34cd5956827f2e26db80a [term 1 LEADER]: Becoming Leader. State: Replica: 1b45415522b34cd5956827f2e26db80a, State: Running, Role: LEADER
I20260807 08:40:02.229913 11759 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b45415522b34cd5956827f2e26db80a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b45415522b34cd5956827f2e26db80a" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 44041 } }
I20260807 08:40:02.230230 11754 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b45415522b34cd5956827f2e26db80a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:40:02.231654 11761 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b45415522b34cd5956827f2e26db80a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b45415522b34cd5956827f2e26db80a. Latest consensus state: current_term: 1 leader_uuid: "1b45415522b34cd5956827f2e26db80a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b45415522b34cd5956827f2e26db80a" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 44041 } } }
I20260807 08:40:02.231700 11760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b45415522b34cd5956827f2e26db80a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b45415522b34cd5956827f2e26db80a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b45415522b34cd5956827f2e26db80a" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 44041 } } }
I20260807 08:40:02.231875 11760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b45415522b34cd5956827f2e26db80a [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:02.231866 11761 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b45415522b34cd5956827f2e26db80a [sys.catalog]: This master's current role is: LEADER
W20260807 08:40:02.234956 11774 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1b45415522b34cd5956827f2e26db80a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:40:02.235046 11774 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:40:02.235146 11771 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:40:02.235828 11771 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:40:02.241184 11771 catalog_manager.cc:1347] Generated new cluster ID: f334d1f43cfa4fe58d3f97674ceb79b8
I20260807 08:40:02.241250 11771 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:40:02.250072 11771 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:40:02.251219 11771 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:40:02.259168 11771 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1b45415522b34cd5956827f2e26db80a: Generated new TSK 0
I20260807 08:40:02.259837 11771 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.208.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
I20260807 08:40:02.298871 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:44041
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:34883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:02.409220 11781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:02.409431 11781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:02.409467 11781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:02.413142 11781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:02.413187 11781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:02.413233 11781 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:40:02.417834 11781 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:34883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:44041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11781
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:02.418706 11781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:02.419610 11781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:02.428799 11787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:02.428830 11789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:02.428764 11786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:02.428957 11781 server_base.cc:1034] running on GCE node
I20260807 08:40:02.429407 11781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:02.430025 11781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:02.431209 11781 hybrid_clock.cc:648] HybridClock initialized: now 1786092002431156 us; error 64 us; skew 500 ppm
Aug 07 08:40:02 dist-test-slave-6nmv krb5kdc[11665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092002, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:02.434103 11781 init.cc:377] Logged in from keytab as kudu/127.8.208.193@KRBTEST.COM (short username kudu)
I20260807 08:40:02.434964 11781 webserver.cc:460] Webserver started at http://127.8.208.193:44521/ using document root <none> and password file <none>
I20260807 08:40:02.435508 11781 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:02.435611 11781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:02.435847 11781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:02.437659 11781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "c528c4451cdf401ea55031cdc6089981"
format_stamp: "Formatted at 2026-08-07 08:40:02 on dist-test-slave-6nmv"
server_key: "e75b78b73a38ab7b1298fbe59845ca26"
server_key_iv: "c19661543ab08f364ebc1ce08372cf4b"
server_key_version: "encryptionkey@0"
I20260807 08:40:02.438226 11781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "c528c4451cdf401ea55031cdc6089981"
format_stamp: "Formatted at 2026-08-07 08:40:02 on dist-test-slave-6nmv"
server_key: "e75b78b73a38ab7b1298fbe59845ca26"
server_key_iv: "c19661543ab08f364ebc1ce08372cf4b"
server_key_version: "encryptionkey@0"
I20260807 08:40:02.441733 11781 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 08:40:02.444085 11796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:02.445210 11781 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:02.445338 11781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "c528c4451cdf401ea55031cdc6089981"
format_stamp: "Formatted at 2026-08-07 08:40:02 on dist-test-slave-6nmv"
server_key: "e75b78b73a38ab7b1298fbe59845ca26"
server_key_iv: "c19661543ab08f364ebc1ce08372cf4b"
server_key_version: "encryptionkey@0"
I20260807 08:40:02.445439 11781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:02.459427 11781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:02.462610 11781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:02.462807 11781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:02.463358 11781 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:02.464144 11781 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:02.464217 11781 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:02.464288 11781 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:02.464334 11781 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:02.473320 11781 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:35461
I20260807 08:40:02.473358 11919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:35461 every 8 connection(s)
I20260807 08:40:02.474160 11781 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:40:02.475274 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 11781
I20260807 08:40:02.475358 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
I20260807 08:40:02.475636 9027 external_mini_cluster.cc:1428] Setting key cd71529d1012815138b2d1cfb26fe00c
Aug 07 08:40:02 dist-test-slave-6nmv krb5kdc[11665](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092002, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.208.194@KRBTEST.COM; defaulting to no policy
I20260807 08:40:02.488469 11757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:02.475799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:36715 (local address 127.8.208.254:44041)
0807 08:40:02.475957 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:02.475962 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:02.476856 (+ 894us) server_negotiation.cc:407] Connection header received
0807 08:40:02.478181 (+ 1325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:02.478187 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:02.478248 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:02.478337 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:02.479680 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:02.480169 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:02.481890 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:02.482120 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:02.482200 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:02.485103 (+ 2903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:02.485109 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:02.485112 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:02.485141 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:02.486599 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:02.487159 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:02.487161 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:02.487163 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:02.487237 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:02.487529 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:02.487531 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:02.487532 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:02.487688 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:02.487757 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:02.488234 (+ 477us) server_negotiation.cc:299] Negotiation successful
0807 08:40:02.488328 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.194@KRBTEST.COM" created.
I20260807 08:40:02.489357 11922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:02.476253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:44041 (local address 127.8.208.193:36715)
0807 08:40:02.476716 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:02.476764 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:02.477991 (+ 1227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:02.478495 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:02.478501 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:02.478882 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:02.479530 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:02.479550 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:02.480293 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:02.480300 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:02.481706 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:02.481719 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:02.482284 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:02.482290 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:02.482520 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:02.483089 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:02.483113 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:02.484912 (+ 1799us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:02.486723 (+ 1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:02.486728 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:02.486738 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:02.487063 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:02.487316 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:02.487318 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:02.487319 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:02.487443 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:02.487776 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:02.487781 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:02.488033 (+ 252us) client_negotiation.cc:769] Sending connection context
0807 08:40:02.488187 (+ 154us) client_negotiation.cc:240] Negotiation successful
0807 08:40:02.488428 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":135,"threads_started":1}
I20260807 08:40:02.490717 11920 heartbeater.cc:347] Connected to a master server at 127.8.208.254:44041
I20260807 08:40:02.490972 11920 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:02.491586 11920 heartbeater.cc:511] Master 127.8.208.254:44041 requested a full tablet report, sending...
I20260807 08:40:02.493333 11716 ts_manager.cc:194] Registered new tserver with Master: c528c4451cdf401ea55031cdc6089981 (127.8.208.193:35461)
I20260807 08:40:02.495096 11716 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.193@KRBTEST.COM'} at 127.8.208.193:36715
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
I20260807 08:40:02.505091 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:44041
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:34883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:02.611078 11926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:02.611289 11926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:02.611327 11926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:02.615170 11926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:02.615213 11926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:02.615289 11926 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:40:02.620039 11926 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:34883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:44041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11926
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:02.621156 11926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:02.622188 11926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:02.631340 11934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:02.631415 11936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:02.631431 11932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:02.631568 11926 server_base.cc:1034] running on GCE node
I20260807 08:40:02.632015 11926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:02.632652 11926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:02.633842 11926 hybrid_clock.cc:648] HybridClock initialized: now 1786092002633784 us; error 38 us; skew 500 ppm
Aug 07 08:40:02 dist-test-slave-6nmv krb5kdc[11665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092002, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:02.636461 11926 init.cc:377] Logged in from keytab as kudu/127.8.208.194@KRBTEST.COM (short username kudu)
I20260807 08:40:02.637142 11926 webserver.cc:460] Webserver started at http://127.8.208.194:38175/ using document root <none> and password file <none>
I20260807 08:40:02.637576 11926 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:02.637638 11926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:02.637778 11926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:02.639603 11926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "f266ecc7a2564c5b96724c75ab55b1c6"
format_stamp: "Formatted at 2026-08-07 08:40:02 on dist-test-slave-6nmv"
server_key: "a126bf38b6e60f56437e96cb6e9c867d"
server_key_iv: "921d3c6428f31ca09a6b968c723479b7"
server_key_version: "encryptionkey@0"
I20260807 08:40:02.640178 11926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "f266ecc7a2564c5b96724c75ab55b1c6"
format_stamp: "Formatted at 2026-08-07 08:40:02 on dist-test-slave-6nmv"
server_key: "a126bf38b6e60f56437e96cb6e9c867d"
server_key_iv: "921d3c6428f31ca09a6b968c723479b7"
server_key_version: "encryptionkey@0"
I20260807 08:40:02.643435 11926 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 08:40:02.645596 11943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:02.646704 11926 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:40:02.646790 11926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "f266ecc7a2564c5b96724c75ab55b1c6"
format_stamp: "Formatted at 2026-08-07 08:40:02 on dist-test-slave-6nmv"
server_key: "a126bf38b6e60f56437e96cb6e9c867d"
server_key_iv: "921d3c6428f31ca09a6b968c723479b7"
server_key_version: "encryptionkey@0"
I20260807 08:40:02.646857 11926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:02.664108 11926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:02.667214 11926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:02.667352 11926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:02.667838 11926 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:02.668537 11926 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:02.668598 11926 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:02.668635 11926 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:02.668656 11926 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:02.676890 11926 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:45571
I20260807 08:40:02.676918 12063 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:45571 every 8 connection(s)
I20260807 08:40:02.677711 11926 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:40:02.680665 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 11926
I20260807 08:40:02.680775 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:40:02.681061 9027 external_mini_cluster.cc:1428] Setting key 8b0c95129ccc257c6954bce144b6ac57
Aug 07 08:40:02 dist-test-slave-6nmv krb5kdc[11665](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092002, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.208.195@KRBTEST.COM; defaulting to no policy
I20260807 08:40:02.691943 11757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:02.679318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:38371 (local address 127.8.208.254:44041)
0807 08:40:02.679459 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:02.679464 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:02.680392 (+ 928us) server_negotiation.cc:407] Connection header received
0807 08:40:02.681479 (+ 1087us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:02.681482 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:02.681537 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:02.681624 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:02.683296 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:02.683803 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:02.685254 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:02.685472 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:02.685577 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:02.688078 (+ 2501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:02.688084 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:02.688090 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:02.688123 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:02.689710 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:02.690244 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:02.690249 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:02.690254 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:02.690338 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:02.690736 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:02.690739 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:02.690741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:02.690997 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:02.691115 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:02.691655 (+ 540us) server_negotiation.cc:299] Negotiation successful
0807 08:40:02.691795 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 08:40:02.692694 12066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:02.679699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:44041 (local address 127.8.208.194:38371)
0807 08:40:02.680266 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:02.680302 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:02.681260 (+ 958us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:02.681999 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:02.682006 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:02.682503 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:02.683145 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:02.683167 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:02.683929 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:02.683935 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:02.685107 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:02.685118 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:02.685630 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:02.685634 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:02.685784 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:02.686366 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:02.686380 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:02.687932 (+ 1552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:02.689858 (+ 1926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:02.689863 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:02.689875 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:02.690117 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:02.690473 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:02.690476 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:02.690478 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:02.690604 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:02.691133 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:02.691138 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:02.691338 (+ 200us) client_negotiation.cc:769] Sending connection context
0807 08:40:02.691477 (+ 139us) client_negotiation.cc:240] Negotiation successful
0807 08:40:02.691780 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":103,"threads_started":1}
I20260807 08:40:02.693763 12064 heartbeater.cc:347] Connected to a master server at 127.8.208.254:44041
I20260807 08:40:02.694053 12064 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.195@KRBTEST.COM" created.
I20260807 08:40:02.694576 12064 heartbeater.cc:511] Master 127.8.208.254:44041 requested a full tablet report, sending...
I20260807 08:40:02.695672 11716 ts_manager.cc:194] Registered new tserver with Master: f266ecc7a2564c5b96724c75ab55b1c6 (127.8.208.194:45571)
I20260807 08:40:02.696223 11716 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.194@KRBTEST.COM'} at 127.8.208.194:38371
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
I20260807 08:40:02.706601 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:44041
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:34883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:02.810531 12070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:02.810776 12070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:02.810866 12070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:02.814604 12070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:02.814647 12070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:02.814700 12070 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:40:02.819393 12070 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:34883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:44041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12070
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:02.820230 12070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:02.821201 12070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:02.830291 12075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:02.830374 12070 server_base.cc:1034] running on GCE node
W20260807 08:40:02.830348 12078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:02.830566 12076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:02.830979 12070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:02.831663 12070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:02.832819 12070 hybrid_clock.cc:648] HybridClock initialized: now 1786092002832799 us; error 34 us; skew 500 ppm
Aug 07 08:40:02 dist-test-slave-6nmv krb5kdc[11665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092002, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:02.835530 12070 init.cc:377] Logged in from keytab as kudu/127.8.208.195@KRBTEST.COM (short username kudu)
I20260807 08:40:02.836321 12070 webserver.cc:460] Webserver started at http://127.8.208.195:33165/ using document root <none> and password file <none>
I20260807 08:40:02.836815 12070 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:02.836869 12070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:02.837069 12070 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:02.838985 12070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "3fb503060aaa468990873fe1eba570a8"
format_stamp: "Formatted at 2026-08-07 08:40:02 on dist-test-slave-6nmv"
server_key: "b9e2c42d2348a2a4ef553c466fa577e4"
server_key_iv: "6a262727769909934b1348f75cb4cdf5"
server_key_version: "encryptionkey@0"
I20260807 08:40:02.839548 12070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "3fb503060aaa468990873fe1eba570a8"
format_stamp: "Formatted at 2026-08-07 08:40:02 on dist-test-slave-6nmv"
server_key: "b9e2c42d2348a2a4ef553c466fa577e4"
server_key_iv: "6a262727769909934b1348f75cb4cdf5"
server_key_version: "encryptionkey@0"
I20260807 08:40:02.843012 12070 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 08:40:02.845314 12086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:02.846552 12070 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:40:02.846658 12070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "3fb503060aaa468990873fe1eba570a8"
format_stamp: "Formatted at 2026-08-07 08:40:02 on dist-test-slave-6nmv"
server_key: "b9e2c42d2348a2a4ef553c466fa577e4"
server_key_iv: "6a262727769909934b1348f75cb4cdf5"
server_key_version: "encryptionkey@0"
I20260807 08:40:02.846751 12070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:02.869028 12070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:02.871682 12070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:02.871865 12070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:02.872418 12070 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:02.873180 12070 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:02.873229 12070 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:02.873288 12070 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:02.873320 12070 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:02.881982 12070 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:39175
I20260807 08:40:02.882052 12210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:39175 every 8 connection(s)
I20260807 08:40:02.883080 12070 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:40:02.892041 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 12070
Aug 07 08:40:02 dist-test-slave-6nmv krb5kdc[11665](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092002, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:02.892189 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:40:02.892468 9027 external_mini_cluster.cc:1428] Setting key 93c8ee070962888ec57f166c458f5dce
I20260807 08:40:02.896406 11757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:02.885156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:46079 (local address 127.8.208.254:44041)
0807 08:40:02.885309 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:02.885325 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:02.886414 (+ 1089us) server_negotiation.cc:407] Connection header received
0807 08:40:02.887199 (+ 785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:02.887201 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:02.887246 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:02.887315 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:02.888370 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:02.888875 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:02.889997 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:02.890201 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:02.890323 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:02.892755 (+ 2432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:02.892760 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:02.892766 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:02.892797 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:02.894659 (+ 1862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:02.895148 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:02.895151 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:02.895152 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:02.895231 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:02.895526 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:02.895528 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:02.895529 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:02.895688 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:02.895762 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:02.896179 (+ 417us) server_negotiation.cc:299] Negotiation successful
0807 08:40:02.896286 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 08:40:02.897068 12213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:02.885554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:44041 (local address 127.8.208.195:46079)
0807 08:40:02.886272 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:02.886310 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:02.887020 (+ 710us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:02.887491 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:02.887497 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:02.887804 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:02.888251 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:02.888262 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:02.889007 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:02.889010 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:02.889880 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:02.889890 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:02.890350 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:02.890353 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:02.890494 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:02.891090 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:02.891104 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:02.892593 (+ 1489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:02.894789 (+ 2196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:02.894793 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:02.894803 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:02.895059 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:02.895328 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:02.895330 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:02.895331 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:02.895449 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:02.895771 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:02.895775 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:02.895979 (+ 204us) client_negotiation.cc:769] Sending connection context
0807 08:40:02.896121 (+ 142us) client_negotiation.cc:240] Negotiation successful
0807 08:40:02.896342 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":123,"threads_started":1}
I20260807 08:40:02.898084 12211 heartbeater.cc:347] Connected to a master server at 127.8.208.254:44041
I20260807 08:40:02.898285 12211 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:02.898694 12211 heartbeater.cc:511] Master 127.8.208.254:44041 requested a full tablet report, sending...
I20260807 08:40:02.899588 11716 ts_manager.cc:194] Registered new tserver with Master: 3fb503060aaa468990873fe1eba570a8 (127.8.208.195:39175)
I20260807 08:40:02.900063 11716 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.195@KRBTEST.COM'} at 127.8.208.195:46079
I20260807 08:40:02.906153 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 08:40:02.920010 11757 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:02.918918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53148 (local address 127.8.208.254:44041)
0807 08:40:02.919036 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:02.919039 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:02.919204 (+ 165us) server_negotiation.cc:407] Connection header received
0807 08:40:02.919281 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:02.919282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:02.919313 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:02.919370 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:02.919923 (+ 553us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53148: BlockingRecv error: recv got EOF from 127.0.0.1:53148 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 08:40:02.920898 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 11781
I20260807 08:40:02.929281 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 11926
I20260807 08:40:02.936367 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 12070
I20260807 08:40:02.942107 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 11680
2026-08-07T08:40:02Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2038 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:40:03 dist-test-slave-6nmv krb5kdc[12223](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:40:03 dist-test-slave-6nmv krb5kdc[12223](info): set up 2 sockets
Aug 07 08:40:03 dist-test-slave-6nmv krb5kdc[12223](info): commencing operation
krb5kdc: starting...
W20260807 08:40:03.971437 9027 mini_kdc.cc:121] Time spent starting KDC: real 1.007s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:40:04 dist-test-slave-6nmv krb5kdc[12223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:40:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:40:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:40:04.094172 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:40971
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:40021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:40971
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:04.199869 12238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:04.200075 12238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:04.200107 12238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:04.203483 12238 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:40:04.203524 12238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:04.203540 12238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:04.203554 12238 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:40:04.203588 12238 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:40:04.208231 12238 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:40021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:40971
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:40971
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12238
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:04.209101 12238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:04.210047 12238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:04.217774 12243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:04.217779 12246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:04.217830 12244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:04.217941 12238 server_base.cc:1034] running on GCE node
I20260807 08:40:04.218554 12238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:04.219468 12238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:04.220643 12238 hybrid_clock.cc:648] HybridClock initialized: now 1786092004220621 us; error 36 us; skew 500 ppm
Aug 07 08:40:04 dist-test-slave-6nmv krb5kdc[12223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092004, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:04.228312 12238 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:40:04.229176 12238 webserver.cc:460] Webserver started at http://127.8.208.254:38179/ using document root <none> and password file <none>
I20260807 08:40:04.229683 12238 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:04.229773 12238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:04.230023 12238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:04.231971 12238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "c540095351fa4153842fefddded7ffd2"
format_stamp: "Formatted at 2026-08-07 08:40:04 on dist-test-slave-6nmv"
server_key: "ec167baf3c8b7b5e859be19e093128d6"
server_key_iv: "02ee6b3986fe5bcbebe08d856b892a99"
server_key_version: "encryptionkey@0"
I20260807 08:40:04.232520 12238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "c540095351fa4153842fefddded7ffd2"
format_stamp: "Formatted at 2026-08-07 08:40:04 on dist-test-slave-6nmv"
server_key: "ec167baf3c8b7b5e859be19e093128d6"
server_key_iv: "02ee6b3986fe5bcbebe08d856b892a99"
server_key_version: "encryptionkey@0"
I20260807 08:40:04.236060 12238 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260807 08:40:04.238278 12253 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:04.239396 12238 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:40:04.239542 12238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "c540095351fa4153842fefddded7ffd2"
format_stamp: "Formatted at 2026-08-07 08:40:04 on dist-test-slave-6nmv"
server_key: "ec167baf3c8b7b5e859be19e093128d6"
server_key_iv: "02ee6b3986fe5bcbebe08d856b892a99"
server_key_version: "encryptionkey@0"
I20260807 08:40:04.239647 12238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:04.258121 12238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:04.260778 12238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:04.260987 12238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:04.267689 12238 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:40971
I20260807 08:40:04.267959 12309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:40971 every 8 connection(s)
I20260807 08:40:04.268534 12238 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:40:04.269671 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 12238
I20260807 08:40:04.269793 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:40:04.270076 9027 external_mini_cluster.cc:1428] Setting key c63c518516a15174afb1cbb4231b02fc
I20260807 08:40:04.271297 12310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:04.277768 12310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c540095351fa4153842fefddded7ffd2: Bootstrap starting.
Aug 07 08:40:04 dist-test-slave-6nmv krb5kdc[12223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:04.280151 12310 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c540095351fa4153842fefddded7ffd2: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:04.280961 12310 log.cc:824] T 00000000000000000000000000000000 P c540095351fa4153842fefddded7ffd2: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:04.282941 12310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c540095351fa4153842fefddded7ffd2: No bootstrap required, opened a new log
I20260807 08:40:04.283774 12313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:04.271275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59468 (local address 127.8.208.254:40971)
0807 08:40:04.271679 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:04.271692 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:04.271742 (+ 50us) server_negotiation.cc:407] Connection header received
0807 08:40:04.272481 (+ 739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:04.272504 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:04.272928 (+ 424us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:04.273291 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:04.274286 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:04.275232 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:04.276392 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:04.276800 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:04.276939 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:04.279575 (+ 2636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:04.279579 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:04.279590 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:04.279613 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:04.281322 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:04.281724 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:04.281728 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:04.281731 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:04.281867 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:04.282122 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:04.282124 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:04.282125 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:04.282430 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:04.282553 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:04.282841 (+ 288us) server_negotiation.cc:299] Negotiation successful
0807 08:40:04.283123 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":129,"threads_started":1}
I20260807 08:40:04.286535 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 08:40:04.286784 12310 raft_consensus.cc:348] T 00000000000000000000000000000000 P c540095351fa4153842fefddded7ffd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c540095351fa4153842fefddded7ffd2" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40971 } }
I20260807 08:40:04.287031 12310 raft_consensus.cc:374] T 00000000000000000000000000000000 P c540095351fa4153842fefddded7ffd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:04.287101 12310 raft_consensus.cc:729] T 00000000000000000000000000000000 P c540095351fa4153842fefddded7ffd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c540095351fa4153842fefddded7ffd2, State: Initialized, Role: FOLLOWER
I20260807 08:40:04.287513 12310 consensus_queue.cc:260] T 00000000000000000000000000000000 P c540095351fa4153842fefddded7ffd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c540095351fa4153842fefddded7ffd2" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40971 } }
I20260807 08:40:04.287680 12310 raft_consensus.cc:388] T 00000000000000000000000000000000 P c540095351fa4153842fefddded7ffd2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:40:04.287753 12310 raft_consensus.cc:482] T 00000000000000000000000000000000 P c540095351fa4153842fefddded7ffd2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:40:04.287851 12310 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c540095351fa4153842fefddded7ffd2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:04.289079 12310 raft_consensus.cc:504] T 00000000000000000000000000000000 P c540095351fa4153842fefddded7ffd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c540095351fa4153842fefddded7ffd2" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40971 } }
I20260807 08:40:04.289425 12310 leader_election.cc:302] T 00000000000000000000000000000000 P c540095351fa4153842fefddded7ffd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c540095351fa4153842fefddded7ffd2; no voters:
I20260807 08:40:04.289708 12310 leader_election.cc:288] T 00000000000000000000000000000000 P c540095351fa4153842fefddded7ffd2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:40:04.289776 12316 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c540095351fa4153842fefddded7ffd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:04.290012 12316 raft_consensus.cc:686] T 00000000000000000000000000000000 P c540095351fa4153842fefddded7ffd2 [term 1 LEADER]: Becoming Leader. State: Replica: c540095351fa4153842fefddded7ffd2, State: Running, Role: LEADER
I20260807 08:40:04.290306 12316 consensus_queue.cc:237] T 00000000000000000000000000000000 P c540095351fa4153842fefddded7ffd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c540095351fa4153842fefddded7ffd2" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40971 } }
I20260807 08:40:04.290793 12310 sys_catalog.cc:564] T 00000000000000000000000000000000 P c540095351fa4153842fefddded7ffd2 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:40:04.291277 12316 sys_catalog.cc:455] T 00000000000000000000000000000000 P c540095351fa4153842fefddded7ffd2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c540095351fa4153842fefddded7ffd2. Latest consensus state: current_term: 1 leader_uuid: "c540095351fa4153842fefddded7ffd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c540095351fa4153842fefddded7ffd2" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40971 } } }
I20260807 08:40:04.292074 12316 sys_catalog.cc:458] T 00000000000000000000000000000000 P c540095351fa4153842fefddded7ffd2 [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:04.291956 12318 sys_catalog.cc:455] T 00000000000000000000000000000000 P c540095351fa4153842fefddded7ffd2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c540095351fa4153842fefddded7ffd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c540095351fa4153842fefddded7ffd2" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40971 } } }
I20260807 08:40:04.292383 12318 sys_catalog.cc:458] T 00000000000000000000000000000000 P c540095351fa4153842fefddded7ffd2 [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:04.293141 12326 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:40:04.295944 12326 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:40:04.301438 12326 catalog_manager.cc:1347] Generated new cluster ID: 1719fafbb1e0427abd1caa8000fc4ca7
I20260807 08:40:04.301504 12326 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:40:04.307126 12313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:04.301897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59482 (local address 127.8.208.254:40971)
0807 08:40:04.302021 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:04.302025 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:04.302365 (+ 340us) server_negotiation.cc:407] Connection header received
0807 08:40:04.302462 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:04.302464 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:04.302509 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:04.302590 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:04.303044 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:04.303825 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:04.304944 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:04.305348 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:04.305443 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:04.306271 (+ 828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:04.306274 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:04.306277 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:40:04.306717 (+ 440us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:04.306746 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:40:04.306763 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:04.306844 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:04.306939 (+ 95us) server_negotiation.cc:299] Negotiation successful
0807 08:40:04.306997 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":56}
I20260807 08:40:04.312206 12326 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:40:04.313027 12326 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:40:04.316970 12326 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c540095351fa4153842fefddded7ffd2: Generated new TSK 0
I20260807 08:40:04.317520 12326 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:40:04.324352 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 12238
2026-08-07T08:40:04Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1382 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:40:04 dist-test-slave-6nmv krb5kdc[12344](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:40:04 dist-test-slave-6nmv krb5kdc[12344](info): set up 2 sockets
Aug 07 08:40:04 dist-test-slave-6nmv krb5kdc[12344](info): commencing operation
krb5kdc: starting...
W20260807 08:40:05.339507 9027 mini_kdc.cc:121] Time spent starting KDC: real 0.993s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:40:05 dist-test-slave-6nmv krb5kdc[12344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:40:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:40:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:40:05.446512 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:43057
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:34373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:43057
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:05.546833 12358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:05.547024 12358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:05.547072 12358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:05.550637 12358 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:40:05.550683 12358 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:05.550701 12358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:05.550716 12358 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:40:05.550730 12358 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:40:05.555608 12358 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:34373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:43057
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:43057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12358
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:05.556357 12358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:05.557319 12358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:05.564949 12364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:05.564949 12363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:05.564985 12366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:05.565253 12358 server_base.cc:1034] running on GCE node
I20260807 08:40:05.565737 12358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:05.566821 12358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:05.567981 12358 hybrid_clock.cc:648] HybridClock initialized: now 1786092005567964 us; error 27 us; skew 500 ppm
Aug 07 08:40:05 dist-test-slave-6nmv krb5kdc[12344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092005, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:05.570551 12358 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:40:05.571327 12358 webserver.cc:460] Webserver started at http://127.8.208.254:39753/ using document root <none> and password file <none>
I20260807 08:40:05.571892 12358 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:05.571985 12358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:05.572206 12358 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:05.574136 12358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "8cf14afd36684a7b881b3b96f0463659"
format_stamp: "Formatted at 2026-08-07 08:40:05 on dist-test-slave-6nmv"
server_key: "ac69f035597c5a0bdced22b8b091645b"
server_key_iv: "499fc2b90d14900bd8cb986ffd85ab6e"
server_key_version: "encryptionkey@0"
I20260807 08:40:05.574694 12358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "8cf14afd36684a7b881b3b96f0463659"
format_stamp: "Formatted at 2026-08-07 08:40:05 on dist-test-slave-6nmv"
server_key: "ac69f035597c5a0bdced22b8b091645b"
server_key_iv: "499fc2b90d14900bd8cb986ffd85ab6e"
server_key_version: "encryptionkey@0"
I20260807 08:40:05.578071 12358 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 08:40:05.580255 12373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:05.581254 12358 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:05.581380 12358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "8cf14afd36684a7b881b3b96f0463659"
format_stamp: "Formatted at 2026-08-07 08:40:05 on dist-test-slave-6nmv"
server_key: "ac69f035597c5a0bdced22b8b091645b"
server_key_iv: "499fc2b90d14900bd8cb986ffd85ab6e"
server_key_version: "encryptionkey@0"
I20260807 08:40:05.581483 12358 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:05.590196 12358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:05.592669 12358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:05.592873 12358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:05.599306 12358 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:43057
I20260807 08:40:05.599574 12428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:43057 every 8 connection(s)
I20260807 08:40:05.600308 12358 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:40:05.601200 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 12358
I20260807 08:40:05.601320 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:40:05.601590 9027 external_mini_cluster.cc:1428] Setting key 8643da1f73567021f6c708929abb4e71
I20260807 08:40:05.603406 12429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:05.609766 12429 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cf14afd36684a7b881b3b96f0463659: Bootstrap starting.
Aug 07 08:40:05 dist-test-slave-6nmv krb5kdc[12344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:05.612313 12429 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8cf14afd36684a7b881b3b96f0463659: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:05.613196 12429 log.cc:824] T 00000000000000000000000000000000 P 8cf14afd36684a7b881b3b96f0463659: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:05.615018 12429 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cf14afd36684a7b881b3b96f0463659: No bootstrap required, opened a new log
I20260807 08:40:05.615626 12432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:05.603131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46830 (local address 127.8.208.254:43057)
0807 08:40:05.603579 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:05.603594 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:05.603627 (+ 33us) server_negotiation.cc:407] Connection header received
0807 08:40:05.604238 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:05.604256 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:05.604555 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:05.604809 (+ 254us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:05.605730 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:05.606715 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:05.607842 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:05.608242 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:05.608341 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:05.610999 (+ 2658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:05.611005 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:05.611019 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:05.611056 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:05.612974 (+ 1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:05.613381 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:05.613386 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:05.613390 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:05.613501 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:05.613761 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:05.613764 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:05.613766 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:05.614153 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:05.614367 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:05.614656 (+ 289us) server_negotiation.cc:299] Negotiation successful
0807 08:40:05.614913 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":126,"threads_started":1}
I20260807 08:40:05.618217 12429 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8cf14afd36684a7b881b3b96f0463659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cf14afd36684a7b881b3b96f0463659" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43057 } }
I20260807 08:40:05.618428 12429 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8cf14afd36684a7b881b3b96f0463659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:05.618505 12429 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8cf14afd36684a7b881b3b96f0463659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cf14afd36684a7b881b3b96f0463659, State: Initialized, Role: FOLLOWER
I20260807 08:40:05.618877 12429 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8cf14afd36684a7b881b3b96f0463659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cf14afd36684a7b881b3b96f0463659" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43057 } }
I20260807 08:40:05.619021 12429 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8cf14afd36684a7b881b3b96f0463659 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:40:05.619098 12429 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8cf14afd36684a7b881b3b96f0463659 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:40:05.619182 12429 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8cf14afd36684a7b881b3b96f0463659 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:05.619906 12429 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8cf14afd36684a7b881b3b96f0463659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cf14afd36684a7b881b3b96f0463659" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43057 } }
I20260807 08:40:05.620217 12429 leader_election.cc:302] T 00000000000000000000000000000000 P 8cf14afd36684a7b881b3b96f0463659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8cf14afd36684a7b881b3b96f0463659; no voters:
I20260807 08:40:05.620498 12429 leader_election.cc:288] T 00000000000000000000000000000000 P 8cf14afd36684a7b881b3b96f0463659 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:40:05.620637 12434 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8cf14afd36684a7b881b3b96f0463659 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:05.620834 12434 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8cf14afd36684a7b881b3b96f0463659 [term 1 LEADER]: Becoming Leader. State: Replica: 8cf14afd36684a7b881b3b96f0463659, State: Running, Role: LEADER
I20260807 08:40:05.621168 12434 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8cf14afd36684a7b881b3b96f0463659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cf14afd36684a7b881b3b96f0463659" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43057 } }
I20260807 08:40:05.621613 12429 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8cf14afd36684a7b881b3b96f0463659 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:40:05.622833 12435 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cf14afd36684a7b881b3b96f0463659 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8cf14afd36684a7b881b3b96f0463659" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cf14afd36684a7b881b3b96f0463659" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43057 } } }
I20260807 08:40:05.622833 12436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cf14afd36684a7b881b3b96f0463659 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8cf14afd36684a7b881b3b96f0463659. Latest consensus state: current_term: 1 leader_uuid: "8cf14afd36684a7b881b3b96f0463659" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cf14afd36684a7b881b3b96f0463659" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43057 } } }
I20260807 08:40:05.622989 12435 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cf14afd36684a7b881b3b96f0463659 [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:05.623064 12436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cf14afd36684a7b881b3b96f0463659 [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:05.623404 12443 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:40:05.626605 12443 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:40:05.630873 12443 catalog_manager.cc:1347] Generated new cluster ID: 15eb3a3717e9442c888735058899ade2
I20260807 08:40:05.630936 12443 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:40:05.640115 12443 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:40:05.640851 12443 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:40:05.645454 12443 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8cf14afd36684a7b881b3b96f0463659: Generated new TSK 0
I20260807 08:40:05.646054 12443 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.208.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
I20260807 08:40:05.678005 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:43057
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:34373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:05.781667 12455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:05.782020 12455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:05.782074 12455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:05.785930 12455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:05.785974 12455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:05.786022 12455 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:40:05.790488 12455 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:34373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:43057
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:05.791311 12455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:05.792308 12455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:05.801589 12464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:05.801647 12462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:05.801695 12455 server_base.cc:1034] running on GCE node
W20260807 08:40:05.801647 12461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:05.802273 12455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:05.802901 12455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:05.804100 12455 hybrid_clock.cc:648] HybridClock initialized: now 1786092005804087 us; error 24 us; skew 500 ppm
Aug 07 08:40:05 dist-test-slave-6nmv krb5kdc[12344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092005, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:05.807047 12455 init.cc:377] Logged in from keytab as kudu/127.8.208.193@KRBTEST.COM (short username kudu)
I20260807 08:40:05.807894 12455 webserver.cc:460] Webserver started at http://127.8.208.193:37685/ using document root <none> and password file <none>
I20260807 08:40:05.808497 12455 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:05.808562 12455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:05.808787 12455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:05.811092 12455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "053478dc0a8d4ef4874d18ceb2a23c64"
format_stamp: "Formatted at 2026-08-07 08:40:05 on dist-test-slave-6nmv"
server_key: "83480075e9bab557d22114c497b1dd60"
server_key_iv: "6695fc9263e5bbb7bd243630aa060b71"
server_key_version: "encryptionkey@0"
I20260807 08:40:05.811733 12455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "053478dc0a8d4ef4874d18ceb2a23c64"
format_stamp: "Formatted at 2026-08-07 08:40:05 on dist-test-slave-6nmv"
server_key: "83480075e9bab557d22114c497b1dd60"
server_key_iv: "6695fc9263e5bbb7bd243630aa060b71"
server_key_version: "encryptionkey@0"
I20260807 08:40:05.816690 12455 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 08:40:05.820377 12471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:05.822528 12455 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 08:40:05.822791 12455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "053478dc0a8d4ef4874d18ceb2a23c64"
format_stamp: "Formatted at 2026-08-07 08:40:05 on dist-test-slave-6nmv"
server_key: "83480075e9bab557d22114c497b1dd60"
server_key_iv: "6695fc9263e5bbb7bd243630aa060b71"
server_key_version: "encryptionkey@0"
I20260807 08:40:05.822973 12455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:05.860498 12455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:05.863715 12455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:05.863922 12455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:05.864555 12455 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:05.865388 12455 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:05.865460 12455 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:05.865541 12455 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:05.865600 12455 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:05.874154 12455 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:40119
I20260807 08:40:05.874202 12597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:40119 every 8 connection(s)
I20260807 08:40:05.875061 12455 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:40:05.883858 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 12455
I20260807 08:40:05.883996 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
I20260807 08:40:05.884431 9027 external_mini_cluster.cc:1428] Setting key a9622a5fc3909f7df80b3eeebd9bf74a
Aug 07 08:40:05 dist-test-slave-6nmv krb5kdc[12344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092005, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:05.891280 12432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:05.876813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:33997 (local address 127.8.208.254:43057)
0807 08:40:05.876950 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:05.876954 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:05.877716 (+ 762us) server_negotiation.cc:407] Connection header received
0807 08:40:05.879076 (+ 1360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:05.879079 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:05.879144 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:05.879250 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:05.880507 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:05.881055 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:05.882306 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:05.882590 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:05.882715 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:05.885550 (+ 2835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:05.885554 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:05.885557 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:05.885584 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:05.889004 (+ 3420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:05.889625 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:05.889628 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:05.889629 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:05.889712 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:05.890115 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:05.890118 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:05.890119 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:05.890299 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:05.890392 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:05.891058 (+ 666us) server_negotiation.cc:299] Negotiation successful
0807 08:40:05.891167 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 08:40:05.892441 12601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:05.877168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43057 (local address 127.8.208.193:33997)
0807 08:40:05.877582 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:05.877621 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:05.878868 (+ 1247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:05.879420 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:05.879426 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:05.879760 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:05.880334 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:05.880349 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:05.881197 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:05.881208 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:05.882168 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:05.882178 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:05.882756 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:05.882760 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:05.882935 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:05.883450 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:05.883466 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:05.885373 (+ 1907us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:05.889126 (+ 3753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:05.889135 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:05.889150 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:05.889525 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:05.889806 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:05.889832 (+ 26us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:05.889835 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:05.890016 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:05.890424 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:05.890433 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:05.890760 (+ 327us) client_negotiation.cc:769] Sending connection context
0807 08:40:05.890966 (+ 206us) client_negotiation.cc:240] Negotiation successful
0807 08:40:05.891304 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":91,"threads_started":1}
I20260807 08:40:05.894160 12598 heartbeater.cc:347] Connected to a master server at 127.8.208.254:43057
I20260807 08:40:05.894451 12598 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:05.895008 12598 heartbeater.cc:511] Master 127.8.208.254:43057 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.8.208.194@KRBTEST.COM; defaulting to no policy
I20260807 08:40:05.896682 12392 ts_manager.cc:194] Registered new tserver with Master: 053478dc0a8d4ef4874d18ceb2a23c64 (127.8.208.193:40119)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.194@KRBTEST.COM" created.
I20260807 08:40:05.897953 12392 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.193@KRBTEST.COM'} at 127.8.208.193:33997
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
I20260807 08:40:05.912720 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:43057
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:34373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:06.014004 12604 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:06.014258 12604 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:06.014335 12604 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:06.018234 12604 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:06.018312 12604 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:06.018391 12604 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:40:06.023486 12604 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:34373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:43057
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12604
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:06.024492 12604 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:06.025458 12604 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:06.034795 12611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:06.034801 12613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:06.034860 12610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:06.035169 12604 server_base.cc:1034] running on GCE node
I20260807 08:40:06.035591 12604 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:06.036237 12604 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:06.037451 12604 hybrid_clock.cc:648] HybridClock initialized: now 1786092006037436 us; error 26 us; skew 500 ppm
Aug 07 08:40:06 dist-test-slave-6nmv krb5kdc[12344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092006, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:06.040302 12604 init.cc:377] Logged in from keytab as kudu/127.8.208.194@KRBTEST.COM (short username kudu)
I20260807 08:40:06.041136 12604 webserver.cc:460] Webserver started at http://127.8.208.194:40799/ using document root <none> and password file <none>
I20260807 08:40:06.041608 12604 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:06.041663 12604 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:06.041875 12604 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:06.043777 12604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "188c2589736d4ac49d5b9d1fcc3c1f3e"
format_stamp: "Formatted at 2026-08-07 08:40:06 on dist-test-slave-6nmv"
server_key: "c0292c59c880f3dd00ae95b095a16acd"
server_key_iv: "a4ed907b2578abb195966233fbf28eab"
server_key_version: "encryptionkey@0"
I20260807 08:40:06.044275 12604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "188c2589736d4ac49d5b9d1fcc3c1f3e"
format_stamp: "Formatted at 2026-08-07 08:40:06 on dist-test-slave-6nmv"
server_key: "c0292c59c880f3dd00ae95b095a16acd"
server_key_iv: "a4ed907b2578abb195966233fbf28eab"
server_key_version: "encryptionkey@0"
I20260807 08:40:06.047789 12604 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 08:40:06.050127 12620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:06.051311 12604 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 08:40:06.051402 12604 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "188c2589736d4ac49d5b9d1fcc3c1f3e"
format_stamp: "Formatted at 2026-08-07 08:40:06 on dist-test-slave-6nmv"
server_key: "c0292c59c880f3dd00ae95b095a16acd"
server_key_iv: "a4ed907b2578abb195966233fbf28eab"
server_key_version: "encryptionkey@0"
I20260807 08:40:06.051529 12604 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:06.077675 12604 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:06.081718 12604 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:06.082006 12604 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:06.082656 12604 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:06.083532 12604 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:06.083612 12604 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:06.083704 12604 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:06.083760 12604 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:06.093398 12604 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:40407
I20260807 08:40:06.093462 12740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:40407 every 8 connection(s)
I20260807 08:40:06.094405 12604 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:40:06.098469 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 12604
I20260807 08:40:06.098628 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:40:06.099048 9027 external_mini_cluster.cc:1428] Setting key ea030673e2aad9f72a84bf9abf8b40e7
Aug 07 08:40:06 dist-test-slave-6nmv krb5kdc[12344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092006, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:06.110549 12432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:06.096230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:57771 (local address 127.8.208.254:43057)
0807 08:40:06.096371 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:06.096374 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:06.097141 (+ 767us) server_negotiation.cc:407] Connection header received
0807 08:40:06.098733 (+ 1592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:06.098737 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:06.098797 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:06.098870 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:06.100331 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:06.100901 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:06.102591 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:06.103167 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:06.103305 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:06.106223 (+ 2918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:06.106229 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:06.106237 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:06.106273 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:06.108192 (+ 1919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:06.108720 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:06.108724 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:06.108726 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:06.108842 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:06.109195 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:06.109199 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:06.109201 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:06.109493 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:06.109613 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:06.110137 (+ 524us) server_negotiation.cc:299] Negotiation successful
0807 08:40:06.110279 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
WARNING: no policy specified for kudu/127.8.208.195@KRBTEST.COM; defaulting to no policy
I20260807 08:40:06.111148 12743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:06.096519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43057 (local address 127.8.208.194:57771)
0807 08:40:06.096976 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:06.097020 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:06.098458 (+ 1438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:06.099094 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:06.099104 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:06.099587 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:06.100179 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:06.100198 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:06.101027 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:06.101043 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:06.102452 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:06.102464 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:06.103385 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:06.103393 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:06.103633 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:06.104282 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:06.104305 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:06.106003 (+ 1698us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:06.108317 (+ 2314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:06.108322 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:06.108332 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:06.108595 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:06.108946 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:06.108948 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:06.108949 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:06.109078 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:06.109597 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:06.109601 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:06.109800 (+ 199us) client_negotiation.cc:769] Sending connection context
0807 08:40:06.110018 (+ 218us) client_negotiation.cc:240] Negotiation successful
0807 08:40:06.110254 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":105,"threads_started":1}
I20260807 08:40:06.112402 12741 heartbeater.cc:347] Connected to a master server at 127.8.208.254:43057
I20260807 08:40:06.112651 12741 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:06.113133 12741 heartbeater.cc:511] Master 127.8.208.254:43057 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.195@KRBTEST.COM" created.
I20260807 08:40:06.114287 12392 ts_manager.cc:194] Registered new tserver with Master: 188c2589736d4ac49d5b9d1fcc3c1f3e (127.8.208.194:40407)
I20260807 08:40:06.115247 12392 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.194@KRBTEST.COM'} at 127.8.208.194:57771
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
I20260807 08:40:06.130509 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:43057
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:34373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:06.238267 12747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:06.238483 12747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:06.238521 12747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:06.242264 12747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:06.242309 12747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:06.242359 12747 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:40:06.247195 12747 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:34373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:43057
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12747
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:06.248029 12747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:06.248879 12747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:06.257931 12753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:06.257941 12755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:06.258009 12747 server_base.cc:1034] running on GCE node
W20260807 08:40:06.257965 12752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:06.258582 12747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:06.259137 12747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:06.260290 12747 hybrid_clock.cc:648] HybridClock initialized: now 1786092006260278 us; error 22 us; skew 500 ppm
Aug 07 08:40:06 dist-test-slave-6nmv krb5kdc[12344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092006, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:06.262996 12747 init.cc:377] Logged in from keytab as kudu/127.8.208.195@KRBTEST.COM (short username kudu)
I20260807 08:40:06.263815 12747 webserver.cc:460] Webserver started at http://127.8.208.195:36261/ using document root <none> and password file <none>
I20260807 08:40:06.264331 12747 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:06.264447 12747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:06.264663 12747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:06.266620 12747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "45c691c0b8974af9907951731ff64068"
format_stamp: "Formatted at 2026-08-07 08:40:06 on dist-test-slave-6nmv"
server_key: "36a9987d1fe0843589064513ec81b289"
server_key_iv: "d56b728ff1d185b0207569cdce138108"
server_key_version: "encryptionkey@0"
I20260807 08:40:06.267115 12747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "45c691c0b8974af9907951731ff64068"
format_stamp: "Formatted at 2026-08-07 08:40:06 on dist-test-slave-6nmv"
server_key: "36a9987d1fe0843589064513ec81b289"
server_key_iv: "d56b728ff1d185b0207569cdce138108"
server_key_version: "encryptionkey@0"
I20260807 08:40:06.270457 12747 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 08:40:06.272637 12763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:06.273710 12747 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:06.273849 12747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "45c691c0b8974af9907951731ff64068"
format_stamp: "Formatted at 2026-08-07 08:40:06 on dist-test-slave-6nmv"
server_key: "36a9987d1fe0843589064513ec81b289"
server_key_iv: "d56b728ff1d185b0207569cdce138108"
server_key_version: "encryptionkey@0"
I20260807 08:40:06.273969 12747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:06.287496 12747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:06.290310 12747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:06.290483 12747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:06.290975 12747 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:06.291679 12747 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:06.291747 12747 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:06.291812 12747 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:06.291859 12747 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:06.300660 12747 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:46239
I20260807 08:40:06.300701 12885 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:46239 every 8 connection(s)
I20260807 08:40:06.301376 12747 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:40:06.306479 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 12747
I20260807 08:40:06.306618 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:40:06.306931 9027 external_mini_cluster.cc:1428] Setting key 1c83b25735caae1fa32c6f39c6ab98a3
Aug 07 08:40:06 dist-test-slave-6nmv krb5kdc[12344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092006, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:06.314066 12432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:06.302893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:35111 (local address 127.8.208.254:43057)
0807 08:40:06.303015 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:06.303018 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:06.303824 (+ 806us) server_negotiation.cc:407] Connection header received
0807 08:40:06.305181 (+ 1357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:06.305186 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:06.305250 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:06.305379 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:06.306734 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:06.307312 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:06.308395 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:06.308617 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:06.308736 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:06.311076 (+ 2340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:06.311079 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:06.311081 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:06.311103 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:06.312373 (+ 1270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:06.312821 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:06.312824 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:06.312825 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:06.312918 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:06.313182 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:06.313184 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:06.313185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:06.313338 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:06.313423 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:06.313853 (+ 430us) server_negotiation.cc:299] Negotiation successful
0807 08:40:06.313957 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 08:40:06.314805 12888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:06.303179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43057 (local address 127.8.208.195:35111)
0807 08:40:06.303669 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:06.303710 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:06.304963 (+ 1253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:06.305561 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:06.305567 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:06.305953 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:06.306513 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:06.306535 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:06.307441 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:06.307444 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:06.308269 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:06.308278 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:06.308770 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:06.308773 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:06.308946 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:06.309496 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:06.309510 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:06.310933 (+ 1423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:06.312482 (+ 1549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:06.312486 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:06.312495 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:06.312722 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:06.312994 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:06.312995 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:06.312996 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:06.313110 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:06.313427 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:06.313431 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:06.313633 (+ 202us) client_negotiation.cc:769] Sending connection context
0807 08:40:06.313763 (+ 130us) client_negotiation.cc:240] Negotiation successful
0807 08:40:06.314029 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":95,"threads_started":1}
I20260807 08:40:06.315907 12886 heartbeater.cc:347] Connected to a master server at 127.8.208.254:43057
I20260807 08:40:06.316110 12886 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:06.316516 12886 heartbeater.cc:511] Master 127.8.208.254:43057 requested a full tablet report, sending...
I20260807 08:40:06.317476 12392 ts_manager.cc:194] Registered new tserver with Master: 45c691c0b8974af9907951731ff64068 (127.8.208.195:46239)
I20260807 08:40:06.318102 12392 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.195@KRBTEST.COM'} at 127.8.208.195:35111
I20260807 08:40:06.320664 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 08:40:06 dist-test-slave-6nmv krb5kdc[12344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092006, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 07 08:40:06 dist-test-slave-6nmv krb5kdc[12344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092006, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:06.346916 12432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:06.338434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46844 (local address 127.8.208.254:43057)
0807 08:40:06.338602 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:06.338607 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:06.338769 (+ 162us) server_negotiation.cc:407] Connection header received
0807 08:40:06.338979 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:06.338982 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:06.339023 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:06.339103 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:06.339797 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:06.340359 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:06.341234 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:06.341449 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:06.341554 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:06.343970 (+ 2416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:06.343973 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:06.343975 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:06.343997 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:06.345341 (+ 1344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:06.345761 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:06.345764 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:06.345765 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:06.345904 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:06.346142 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:06.346144 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:06.346145 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:06.346345 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:06.346452 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:06.346640 (+ 188us) server_negotiation.cc:299] Negotiation successful
0807 08:40:06.346725 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
W20260807 08:40:06.347319 12392 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:46844
I20260807 08:40:06.348181 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 12455
I20260807 08:40:06.359725 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 12604
I20260807 08:40:06.366524 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 12747
I20260807 08:40:06.374254 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 12358
2026-08-07T08:40:06Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2051 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:40:06 dist-test-slave-6nmv krb5kdc[12899](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:40:06 dist-test-slave-6nmv krb5kdc[12899](info): set up 2 sockets
Aug 07 08:40:06 dist-test-slave-6nmv krb5kdc[12899](info): commencing operation
krb5kdc: starting...
W20260807 08:40:07.452908 9027 mini_kdc.cc:121] Time spent starting KDC: real 1.055s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:40:07 dist-test-slave-6nmv krb5kdc[12899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092007, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:40:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:40:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:40:07.572950 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:41533
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:37409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:41533
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:07.682356 12912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:07.682614 12912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:07.682693 12912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:07.686448 12912 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:40:07.686538 12912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:07.686578 12912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:07.686645 12912 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:40:07.686682 12912 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:40:07.691157 12912 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:37409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:41533
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:41533
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12912
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:07.692147 12912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:07.693095 12912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:07.700994 12918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:07.701022 12919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:07.701413 12912 server_base.cc:1034] running on GCE node
W20260807 08:40:07.701076 12921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:07.706413 12912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:07.707425 12912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:07.708643 12912 hybrid_clock.cc:648] HybridClock initialized: now 1786092007708618 us; error 38 us; skew 500 ppm
Aug 07 08:40:07 dist-test-slave-6nmv krb5kdc[12899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092007, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:07.711475 12912 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:40:07.712390 12912 webserver.cc:460] Webserver started at http://127.8.208.254:39249/ using document root <none> and password file <none>
I20260807 08:40:07.712939 12912 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:07.713032 12912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:07.713269 12912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:07.715296 12912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "c3a16c77d5424ce48584ae9020192a50"
format_stamp: "Formatted at 2026-08-07 08:40:07 on dist-test-slave-6nmv"
server_key: "08bef071210572f08da0a89ed8dc50c5"
server_key_iv: "bfdab85739a2b2de09a54804db264081"
server_key_version: "encryptionkey@0"
I20260807 08:40:07.715848 12912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "c3a16c77d5424ce48584ae9020192a50"
format_stamp: "Formatted at 2026-08-07 08:40:07 on dist-test-slave-6nmv"
server_key: "08bef071210572f08da0a89ed8dc50c5"
server_key_iv: "bfdab85739a2b2de09a54804db264081"
server_key_version: "encryptionkey@0"
I20260807 08:40:07.719470 12912 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 08:40:07.721549 12929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:07.722695 12912 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:40:07.722842 12912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "c3a16c77d5424ce48584ae9020192a50"
format_stamp: "Formatted at 2026-08-07 08:40:07 on dist-test-slave-6nmv"
server_key: "08bef071210572f08da0a89ed8dc50c5"
server_key_iv: "bfdab85739a2b2de09a54804db264081"
server_key_version: "encryptionkey@0"
I20260807 08:40:07.722962 12912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:07.742399 12912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:07.745013 12912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:07.745154 12912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:07.751521 12912 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:41533
I20260807 08:40:07.751534 12984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:41533 every 8 connection(s)
I20260807 08:40:07.752424 12912 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:40:07.754987 12985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:07.758605 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 12912
I20260807 08:40:07.758739 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:40:07.759027 9027 external_mini_cluster.cc:1428] Setting key 2294da5b0b2f58daa78a82b4f2f67aef
I20260807 08:40:07.760070 12985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3a16c77d5424ce48584ae9020192a50: Bootstrap starting.
I20260807 08:40:07.762353 12985 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3a16c77d5424ce48584ae9020192a50: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:07.763057 12985 log.cc:824] T 00000000000000000000000000000000 P c3a16c77d5424ce48584ae9020192a50: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:07.764830 12985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3a16c77d5424ce48584ae9020192a50: No bootstrap required, opened a new log
Aug 07 08:40:07 dist-test-slave-6nmv krb5kdc[12899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092007, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:07.768697 12985 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3a16c77d5424ce48584ae9020192a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3a16c77d5424ce48584ae9020192a50" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 41533 } }
I20260807 08:40:07.768944 12985 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3a16c77d5424ce48584ae9020192a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:07.769035 12985 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3a16c77d5424ce48584ae9020192a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3a16c77d5424ce48584ae9020192a50, State: Initialized, Role: FOLLOWER
I20260807 08:40:07.769542 12985 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3a16c77d5424ce48584ae9020192a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3a16c77d5424ce48584ae9020192a50" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 41533 } }
I20260807 08:40:07.769711 12985 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3a16c77d5424ce48584ae9020192a50 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:40:07.769783 12985 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3a16c77d5424ce48584ae9020192a50 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:40:07.769894 12985 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3a16c77d5424ce48584ae9020192a50 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:07.771027 12985 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3a16c77d5424ce48584ae9020192a50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3a16c77d5424ce48584ae9020192a50" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 41533 } }
I20260807 08:40:07.771370 12985 leader_election.cc:302] T 00000000000000000000000000000000 P c3a16c77d5424ce48584ae9020192a50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3a16c77d5424ce48584ae9020192a50; no voters:
I20260807 08:40:07.771764 12985 leader_election.cc:288] T 00000000000000000000000000000000 P c3a16c77d5424ce48584ae9020192a50 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:40:07.771924 12990 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3a16c77d5424ce48584ae9020192a50 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:07.772194 12990 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3a16c77d5424ce48584ae9020192a50 [term 1 LEADER]: Becoming Leader. State: Replica: c3a16c77d5424ce48584ae9020192a50, State: Running, Role: LEADER
I20260807 08:40:07.772507 12990 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3a16c77d5424ce48584ae9020192a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3a16c77d5424ce48584ae9020192a50" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 41533 } }
I20260807 08:40:07.773051 12985 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3a16c77d5424ce48584ae9020192a50 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:40:07.774202 12991 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3a16c77d5424ce48584ae9020192a50 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3a16c77d5424ce48584ae9020192a50" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3a16c77d5424ce48584ae9020192a50" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 41533 } } }
I20260807 08:40:07.774336 12988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:07.760327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53246 (local address 127.8.208.254:41533)
0807 08:40:07.760749 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:07.760762 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:07.760795 (+ 33us) server_negotiation.cc:407] Connection header received
0807 08:40:07.761371 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:07.761387 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:07.761745 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:07.762152 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:07.762964 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:07.763945 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:07.764814 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:07.765344 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:07.765518 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:07.768347 (+ 2829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:07.768353 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:07.768366 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:07.768393 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:07.770498 (+ 2105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:07.770987 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:07.770993 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:07.771000 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:07.771147 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:07.771447 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:07.771450 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:07.771451 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:07.771989 (+ 538us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:07.772863 (+ 874us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:07.773014 (+ 151us) server_negotiation.cc:299] Negotiation successful
0807 08:40:07.773292 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":117,"threads_started":1}
I20260807 08:40:07.774360 12991 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3a16c77d5424ce48584ae9020192a50 [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:07.774695 12992 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3a16c77d5424ce48584ae9020192a50 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3a16c77d5424ce48584ae9020192a50. Latest consensus state: current_term: 1 leader_uuid: "c3a16c77d5424ce48584ae9020192a50" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3a16c77d5424ce48584ae9020192a50" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 41533 } } }
I20260807 08:40:07.774804 12992 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3a16c77d5424ce48584ae9020192a50 [sys.catalog]: This master's current role is: LEADER
W20260807 08:40:07.777752 13006 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c3a16c77d5424ce48584ae9020192a50: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:40:07.777880 13006 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:40:07.777997 13000 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:40:07.778762 13000 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:40:07.783782 13000 catalog_manager.cc:1347] Generated new cluster ID: 3bd70e16b0c94c40a8cd59fd9ccf40bc
I20260807 08:40:07.783838 13000 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:40:07.801072 13000 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:40:07.802019 13000 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:40:07.808087 13000 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3a16c77d5424ce48584ae9020192a50: Generated new TSK 0
I20260807 08:40:07.808676 13000 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.208.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
I20260807 08:40:07.844995 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:41533
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:37409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:07.954361 13012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:07.954605 13012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:07.954671 13012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:07.958611 13012 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:07.958655 13012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:07.958746 13012 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:40:07.963666 13012 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:37409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:41533
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13012
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:07.964643 13012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:07.965629 13012 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:07.975121 13020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:07.975137 13017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:07.975132 13018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:07.975380 13012 server_base.cc:1034] running on GCE node
I20260807 08:40:07.975854 13012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:07.976473 13012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:07.977711 13012 hybrid_clock.cc:648] HybridClock initialized: now 1786092007977692 us; error 33 us; skew 500 ppm
Aug 07 08:40:07 dist-test-slave-6nmv krb5kdc[12899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092007, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:07.980500 13012 init.cc:377] Logged in from keytab as kudu/127.8.208.193@KRBTEST.COM (short username kudu)
I20260807 08:40:07.981330 13012 webserver.cc:460] Webserver started at http://127.8.208.193:33175/ using document root <none> and password file <none>
I20260807 08:40:07.981938 13012 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:07.982033 13012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:07.982257 13012 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:07.984216 13012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "5ded8c9987954da085d9a148fbffdf7c"
format_stamp: "Formatted at 2026-08-07 08:40:07 on dist-test-slave-6nmv"
server_key: "0fa788e137d27efcfbc0bb1cbc15f3ce"
server_key_iv: "2f5578375cf9680e7a7b805610967361"
server_key_version: "encryptionkey@0"
I20260807 08:40:07.984793 13012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "5ded8c9987954da085d9a148fbffdf7c"
format_stamp: "Formatted at 2026-08-07 08:40:07 on dist-test-slave-6nmv"
server_key: "0fa788e137d27efcfbc0bb1cbc15f3ce"
server_key_iv: "2f5578375cf9680e7a7b805610967361"
server_key_version: "encryptionkey@0"
I20260807 08:40:07.988920 13012 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 08:40:07.991335 13027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:07.992518 13012 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260807 08:40:07.992648 13012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "5ded8c9987954da085d9a148fbffdf7c"
format_stamp: "Formatted at 2026-08-07 08:40:07 on dist-test-slave-6nmv"
server_key: "0fa788e137d27efcfbc0bb1cbc15f3ce"
server_key_iv: "2f5578375cf9680e7a7b805610967361"
server_key_version: "encryptionkey@0"
I20260807 08:40:07.992754 13012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:08.007331 13012 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:08.010488 13012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:08.010679 13012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:08.011226 13012 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:08.012048 13012 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:08.012118 13012 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:08.012188 13012 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:08.012230 13012 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:08.021008 13012 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:43603
I20260807 08:40:08.021040 13151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:43603 every 8 connection(s)
I20260807 08:40:08.021898 13012 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:40:08.031339 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 13012
I20260807 08:40:08.031481 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
I20260807 08:40:08.031850 9027 external_mini_cluster.cc:1428] Setting key 258da2cb1df854d6d1ea9136963fd9e4
Aug 07 08:40:08 dist-test-slave-6nmv krb5kdc[12899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092007, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:08.038938 12988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:08.023623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:59023 (local address 127.8.208.254:41533)
0807 08:40:08.023790 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:08.023795 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:08.025128 (+ 1333us) server_negotiation.cc:407] Connection header received
0807 08:40:08.027122 (+ 1994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:08.027125 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:08.027209 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:08.027314 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:08.028870 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:08.029732 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:08.031331 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:08.031597 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:08.031753 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:08.034968 (+ 3215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:08.034970 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:08.034972 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:08.034995 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:08.036840 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:08.037319 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:08.037322 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:08.037323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:08.037410 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:08.037732 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:08.037736 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:08.037737 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:08.038001 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:08.038108 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:08.038655 (+ 547us) server_negotiation.cc:299] Negotiation successful
0807 08:40:08.038776 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 08:40:08.039649 13154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:08.024017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:41533 (local address 127.8.208.193:59023)
0807 08:40:08.024976 (+ 959us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:08.025033 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:08.026867 (+ 1834us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:08.027509 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:08.027518 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:08.028036 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:08.028702 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:08.028724 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:08.029893 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:08.029897 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:08.031213 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:08.031222 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:08.031933 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:08.031936 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:08.032152 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:08.032805 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:08.032823 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:08.034789 (+ 1966us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:08.036973 (+ 2184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:08.036977 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:08.036986 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:08.037209 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:08.037507 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:08.037510 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:08.037512 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:08.037641 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:08.038105 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:08.038111 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:08.038420 (+ 309us) client_negotiation.cc:769] Sending connection context
0807 08:40:08.038602 (+ 182us) client_negotiation.cc:240] Negotiation successful
0807 08:40:08.038893 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":735,"thread_start_us":166,"threads_started":1}
I20260807 08:40:08.040823 13152 heartbeater.cc:347] Connected to a master server at 127.8.208.254:41533
I20260807 08:40:08.041072 13152 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:08.041512 13152 heartbeater.cc:511] Master 127.8.208.254:41533 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.8.208.194@KRBTEST.COM; defaulting to no policy
I20260807 08:40:08.043002 12946 ts_manager.cc:194] Registered new tserver with Master: 5ded8c9987954da085d9a148fbffdf7c (127.8.208.193:43603)
I20260807 08:40:08.044076 12946 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.193@KRBTEST.COM'} at 127.8.208.193:59023
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
I20260807 08:40:08.060704 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:41533
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:37409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:08.170850 13157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:08.171195 13157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:08.171253 13157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:08.175501 13157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:08.175550 13157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:08.175606 13157 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:40:08.180721 13157 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:37409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:41533
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:08.181614 13157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:08.182590 13157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:08.191699 13163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:08.191799 13157 server_base.cc:1034] running on GCE node
W20260807 08:40:08.191756 13164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:08.191752 13166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:08.192320 13157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:08.192871 13157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:08.194064 13157 hybrid_clock.cc:648] HybridClock initialized: now 1786092008194050 us; error 32 us; skew 500 ppm
Aug 07 08:40:08 dist-test-slave-6nmv krb5kdc[12899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092008, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:08.196745 13157 init.cc:377] Logged in from keytab as kudu/127.8.208.194@KRBTEST.COM (short username kudu)
I20260807 08:40:08.197575 13157 webserver.cc:460] Webserver started at http://127.8.208.194:42523/ using document root <none> and password file <none>
I20260807 08:40:08.198171 13157 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:08.198261 13157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:08.198447 13157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:08.200418 13157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "5b753d1af9144bd29b2d6def202bdd11"
format_stamp: "Formatted at 2026-08-07 08:40:08 on dist-test-slave-6nmv"
server_key: "3bb4fdcb2c4667b8ebea37199d01b03b"
server_key_iv: "a765691fda4f15b1ba5959d24b53cb94"
server_key_version: "encryptionkey@0"
I20260807 08:40:08.200950 13157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "5b753d1af9144bd29b2d6def202bdd11"
format_stamp: "Formatted at 2026-08-07 08:40:08 on dist-test-slave-6nmv"
server_key: "3bb4fdcb2c4667b8ebea37199d01b03b"
server_key_iv: "a765691fda4f15b1ba5959d24b53cb94"
server_key_version: "encryptionkey@0"
I20260807 08:40:08.204423 13157 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260807 08:40:08.206817 13174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:08.207856 13157 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260807 08:40:08.207991 13157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "5b753d1af9144bd29b2d6def202bdd11"
format_stamp: "Formatted at 2026-08-07 08:40:08 on dist-test-slave-6nmv"
server_key: "3bb4fdcb2c4667b8ebea37199d01b03b"
server_key_iv: "a765691fda4f15b1ba5959d24b53cb94"
server_key_version: "encryptionkey@0"
I20260807 08:40:08.208105 13157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:08.222225 13157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:08.224555 13157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:08.224750 13157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:08.225303 13157 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:08.226147 13157 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:08.226233 13157 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:08.226294 13157 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:08.226362 13157 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:08.234717 13157 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:33803
I20260807 08:40:08.234750 13297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:33803 every 8 connection(s)
I20260807 08:40:08.235539 13157 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:40:08.237001 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 13157
I20260807 08:40:08.237139 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:40:08.237440 9027 external_mini_cluster.cc:1428] Setting key 119ed7e1066c4d92c1c01d33b72b9a11
Aug 07 08:40:08 dist-test-slave-6nmv krb5kdc[12899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092008, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.208.195@KRBTEST.COM; defaulting to no policy
I20260807 08:40:08.249555 12988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:08.237259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:42909 (local address 127.8.208.254:41533)
0807 08:40:08.237400 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:08.237404 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:08.238351 (+ 947us) server_negotiation.cc:407] Connection header received
0807 08:40:08.239769 (+ 1418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:08.239774 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:08.239829 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:08.239905 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:08.241127 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:08.241600 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:08.242764 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:08.243160 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:08.243308 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:08.246053 (+ 2745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:08.246056 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:08.246058 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:08.246079 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:08.247670 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:08.248111 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:08.248114 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:08.248115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:08.248186 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:08.248523 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:08.248528 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:08.248531 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:08.248731 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:08.248829 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:08.249286 (+ 457us) server_negotiation.cc:299] Negotiation successful
0807 08:40:08.249412 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.195@KRBTEST.COM" created.
I20260807 08:40:08.250495 13300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:08.237689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:41533 (local address 127.8.208.194:42909)
0807 08:40:08.238185 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:08.238253 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:08.239576 (+ 1323us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:08.240088 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:08.240094 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:08.240400 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:08.240969 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:08.240991 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:08.241725 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:08.241731 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:08.242634 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:08.242644 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:08.243341 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:08.243344 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:08.243483 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:08.244064 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:08.244078 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:08.245888 (+ 1810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:08.247776 (+ 1888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:08.247781 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:08.247793 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:08.248021 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:08.248258 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:08.248260 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:08.248261 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:08.248409 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:08.248872 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:08.248876 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:08.249083 (+ 207us) client_negotiation.cc:769] Sending connection context
0807 08:40:08.249222 (+ 139us) client_negotiation.cc:240] Negotiation successful
0807 08:40:08.249540 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":150,"threads_started":1}
I20260807 08:40:08.251518 13298 heartbeater.cc:347] Connected to a master server at 127.8.208.254:41533
I20260807 08:40:08.251766 13298 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:08.252240 13298 heartbeater.cc:511] Master 127.8.208.254:41533 requested a full tablet report, sending...
I20260807 08:40:08.253207 12946 ts_manager.cc:194] Registered new tserver with Master: 5b753d1af9144bd29b2d6def202bdd11 (127.8.208.194:33803)
I20260807 08:40:08.253749 12946 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.194@KRBTEST.COM'} at 127.8.208.194:42909
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
I20260807 08:40:08.264257 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:41533
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:37409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:08.380921 13304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:08.381125 13304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:08.381161 13304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:08.385090 13304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:08.385140 13304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:08.385236 13304 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:40:08.390067 13304 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:37409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:41533
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13304
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:08.390899 13304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:08.391811 13304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:08.401034 13310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:08.401038 13309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:08.401108 13304 server_base.cc:1034] running on GCE node
W20260807 08:40:08.401140 13312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:08.401618 13304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:08.402216 13304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:08.403383 13304 hybrid_clock.cc:648] HybridClock initialized: now 1786092008403370 us; error 22 us; skew 500 ppm
Aug 07 08:40:08 dist-test-slave-6nmv krb5kdc[12899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092008, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:08.405958 13304 init.cc:377] Logged in from keytab as kudu/127.8.208.195@KRBTEST.COM (short username kudu)
I20260807 08:40:08.406719 13304 webserver.cc:460] Webserver started at http://127.8.208.195:39627/ using document root <none> and password file <none>
I20260807 08:40:08.407213 13304 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:08.407296 13304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:08.407508 13304 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:08.409440 13304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "bc932912e6bc465a8b2eeb25040877e5"
format_stamp: "Formatted at 2026-08-07 08:40:08 on dist-test-slave-6nmv"
server_key: "496065a2ea3af95032b5eadf9100053c"
server_key_iv: "e25b502ebd85e0a39bf23b8646c6a572"
server_key_version: "encryptionkey@0"
I20260807 08:40:08.410048 13304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "bc932912e6bc465a8b2eeb25040877e5"
format_stamp: "Formatted at 2026-08-07 08:40:08 on dist-test-slave-6nmv"
server_key: "496065a2ea3af95032b5eadf9100053c"
server_key_iv: "e25b502ebd85e0a39bf23b8646c6a572"
server_key_version: "encryptionkey@0"
I20260807 08:40:08.413667 13304 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 08:40:08.415983 13320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:08.417047 13304 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:08.417165 13304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "bc932912e6bc465a8b2eeb25040877e5"
format_stamp: "Formatted at 2026-08-07 08:40:08 on dist-test-slave-6nmv"
server_key: "496065a2ea3af95032b5eadf9100053c"
server_key_iv: "e25b502ebd85e0a39bf23b8646c6a572"
server_key_version: "encryptionkey@0"
I20260807 08:40:08.417259 13304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:08.432215 13304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:08.434716 13304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:08.434918 13304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:08.435459 13304 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:08.436233 13304 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:08.436318 13304 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:08.436404 13304 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:08.436458 13304 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:08.444973 13304 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:39279
I20260807 08:40:08.445010 13439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:39279 every 8 connection(s)
I20260807 08:40:08.445783 13304 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
Aug 07 08:40:08 dist-test-slave-6nmv krb5kdc[12899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092008, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:08.455962 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 13304
I20260807 08:40:08.456092 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:40:08.456362 9027 external_mini_cluster.cc:1428] Setting key 634a4f88c010d37a189fc0f5bb2a2f16
I20260807 08:40:08.458204 12988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:08.447439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:36661 (local address 127.8.208.254:41533)
0807 08:40:08.447570 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:08.447574 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:08.448334 (+ 760us) server_negotiation.cc:407] Connection header received
0807 08:40:08.449618 (+ 1284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:08.449620 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:08.449664 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:08.449732 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:08.450758 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:08.451220 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:08.452243 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:08.452456 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:08.452534 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:08.454747 (+ 2213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:08.454750 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:08.454752 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:08.454776 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:08.456008 (+ 1232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:08.456523 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:08.456527 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:08.456529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:08.456626 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:08.457093 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:08.457095 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:08.457096 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:08.457306 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:08.457379 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:08.457957 (+ 578us) server_negotiation.cc:299] Negotiation successful
0807 08:40:08.458060 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 08:40:08.458899 13442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:08.447810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:41533 (local address 127.8.208.195:36661)
0807 08:40:08.448201 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:08.448238 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:08.449447 (+ 1209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:08.449931 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:08.449937 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:08.450241 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:08.450638 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:08.450649 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:08.451311 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:08.451313 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:08.452134 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:08.452143 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:08.452579 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:08.452581 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:08.452708 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:08.453259 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:08.453273 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:08.454605 (+ 1332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:08.456127 (+ 1522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:08.456132 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:08.456145 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:08.456420 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:08.456723 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:08.456725 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:08.456726 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:08.456894 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:08.457410 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:08.457416 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:08.457686 (+ 270us) client_negotiation.cc:769] Sending connection context
0807 08:40:08.457901 (+ 215us) client_negotiation.cc:240] Negotiation successful
0807 08:40:08.458123 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":100,"threads_started":1}
I20260807 08:40:08.459776 13440 heartbeater.cc:347] Connected to a master server at 127.8.208.254:41533
I20260807 08:40:08.459991 13440 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:08.460412 13440 heartbeater.cc:511] Master 127.8.208.254:41533 requested a full tablet report, sending...
I20260807 08:40:08.461220 12946 ts_manager.cc:194] Registered new tserver with Master: bc932912e6bc465a8b2eeb25040877e5 (127.8.208.195:39279)
I20260807 08:40:08.461724 12946 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.195@KRBTEST.COM'} at 127.8.208.195:36661
I20260807 08:40:08.470036 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 08:40:08 dist-test-slave-6nmv krb5kdc[12899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 08:40:08 dist-test-slave-6nmv krb5kdc[12899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.193@KRBTEST.COM
I20260807 08:40:08.496008 13448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:08.486933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52266 (local address 127.8.208.193:43603)
0807 08:40:08.487298 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:08.487307 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:08.487329 (+ 22us) server_negotiation.cc:407] Connection header received
0807 08:40:08.487374 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:08.487379 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:08.487557 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:08.487672 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:08.488338 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:08.489095 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:08.489965 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:08.490304 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:08.490382 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:08.492604 (+ 2222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:08.492612 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:08.492623 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:08.492647 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:08.494256 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:08.494633 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:08.494638 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:08.494639 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:08.494714 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:08.495001 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:08.495004 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:08.495008 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:08.495265 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:08.495412 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:08.495634 (+ 222us) server_negotiation.cc:299] Negotiation successful
0807 08:40:08.495810 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":158,"threads_started":1}
Aug 07 08:40:08 dist-test-slave-6nmv krb5kdc[12899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:08.506315 12988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:08.498769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53260 (local address 127.8.208.254:41533)
0807 08:40:08.498889 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:08.498895 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:08.498925 (+ 30us) server_negotiation.cc:407] Connection header received
0807 08:40:08.499033 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:08.499036 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:08.499084 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:08.499181 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:08.499730 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:08.500255 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:08.501015 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:08.501209 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:08.501303 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:08.503510 (+ 2207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:08.503513 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:08.503514 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:08.503538 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:08.504697 (+ 1159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:08.505119 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:08.505123 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:08.505125 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:08.505206 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:08.505476 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:08.505480 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:08.505482 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:08.505684 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:08.505864 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:08.506116 (+ 252us) server_negotiation.cc:299] Negotiation successful
0807 08:40:08.506213 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260807 08:40:08.506657 12946 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53260
I20260807 08:40:08.507220 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 13012
I20260807 08:40:08.515013 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 13157
I20260807 08:40:08.521963 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 13304
I20260807 08:40:08.527886 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 12912
2026-08-07T08:40:08Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2152 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:40:08 dist-test-slave-6nmv krb5kdc[13454](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:40:08 dist-test-slave-6nmv krb5kdc[13454](info): set up 2 sockets
Aug 07 08:40:08 dist-test-slave-6nmv krb5kdc[13454](info): commencing operation
krb5kdc: starting...
W20260807 08:40:09.582401 9027 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:40:09 dist-test-slave-6nmv krb5kdc[13454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092009, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:40:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:40:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:40:09.706676 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:36235
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:35295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:36235
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:09.812798 13468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:09.813040 13468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:09.813081 13468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:09.816977 13468 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:40:09.817027 13468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:09.817046 13468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:09.817063 13468 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:40:09.817077 13468 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:40:09.822124 13468 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:35295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:36235
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:36235
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:09.823179 13468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:09.824288 13468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:09.832695 13474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:09.832866 13468 server_base.cc:1034] running on GCE node
W20260807 08:40:09.832779 13473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:09.832690 13476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:09.833585 13468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:09.834728 13468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:09.835886 13468 hybrid_clock.cc:648] HybridClock initialized: now 1786092009835866 us; error 38 us; skew 500 ppm
Aug 07 08:40:09 dist-test-slave-6nmv krb5kdc[13454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092009, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:09.843367 13468 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:40:09.844251 13468 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:09.844347 13468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:09.844605 13468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:09.846824 13468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "a73a794866f341c18aab71f53b3e8a7c"
format_stamp: "Formatted at 2026-08-07 08:40:09 on dist-test-slave-6nmv"
server_key: "75971475fba74d0e4ad54aeef2ea3627"
server_key_iv: "e06d5c64aad05de749297684f481bddd"
server_key_version: "encryptionkey@0"
I20260807 08:40:09.847380 13468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "a73a794866f341c18aab71f53b3e8a7c"
format_stamp: "Formatted at 2026-08-07 08:40:09 on dist-test-slave-6nmv"
server_key: "75971475fba74d0e4ad54aeef2ea3627"
server_key_iv: "e06d5c64aad05de749297684f481bddd"
server_key_version: "encryptionkey@0"
I20260807 08:40:09.851043 13468 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 08:40:09.853444 13482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:09.854784 13468 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:40:09.854962 13468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "a73a794866f341c18aab71f53b3e8a7c"
format_stamp: "Formatted at 2026-08-07 08:40:09 on dist-test-slave-6nmv"
server_key: "75971475fba74d0e4ad54aeef2ea3627"
server_key_iv: "e06d5c64aad05de749297684f481bddd"
server_key_version: "encryptionkey@0"
I20260807 08:40:09.855075 13468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:09.876533 13468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:09.879501 13468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:09.879699 13468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:09.886399 13468 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:36235
I20260807 08:40:09.886669 13536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:36235 every 8 connection(s)
I20260807 08:40:09.887097 13468 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:40:09.890260 13537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:09.892819 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 13468
I20260807 08:40:09.892976 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:40:09.893317 9027 external_mini_cluster.cc:1428] Setting key 5fbd3e5fd18d672460ff60c4d8c01c0d
I20260807 08:40:09.896154 13537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a73a794866f341c18aab71f53b3e8a7c: Bootstrap starting.
I20260807 08:40:09.898226 13537 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a73a794866f341c18aab71f53b3e8a7c: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:09.898897 13537 log.cc:824] T 00000000000000000000000000000000 P a73a794866f341c18aab71f53b3e8a7c: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:09.900751 13537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a73a794866f341c18aab71f53b3e8a7c: No bootstrap required, opened a new log
Aug 07 08:40:09 dist-test-slave-6nmv krb5kdc[13454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092009, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:09.904079 13537 raft_consensus.cc:348] T 00000000000000000000000000000000 P a73a794866f341c18aab71f53b3e8a7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a73a794866f341c18aab71f53b3e8a7c" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36235 } }
I20260807 08:40:09.904287 13537 raft_consensus.cc:374] T 00000000000000000000000000000000 P a73a794866f341c18aab71f53b3e8a7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:09.904350 13537 raft_consensus.cc:729] T 00000000000000000000000000000000 P a73a794866f341c18aab71f53b3e8a7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a73a794866f341c18aab71f53b3e8a7c, State: Initialized, Role: FOLLOWER
I20260807 08:40:09.904790 13537 consensus_queue.cc:260] T 00000000000000000000000000000000 P a73a794866f341c18aab71f53b3e8a7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a73a794866f341c18aab71f53b3e8a7c" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36235 } }
I20260807 08:40:09.904915 13537 raft_consensus.cc:388] T 00000000000000000000000000000000 P a73a794866f341c18aab71f53b3e8a7c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:40:09.905023 13537 raft_consensus.cc:482] T 00000000000000000000000000000000 P a73a794866f341c18aab71f53b3e8a7c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:40:09.905135 13537 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a73a794866f341c18aab71f53b3e8a7c [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:09.906273 13537 raft_consensus.cc:504] T 00000000000000000000000000000000 P a73a794866f341c18aab71f53b3e8a7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a73a794866f341c18aab71f53b3e8a7c" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36235 } }
I20260807 08:40:09.906651 13537 leader_election.cc:302] T 00000000000000000000000000000000 P a73a794866f341c18aab71f53b3e8a7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a73a794866f341c18aab71f53b3e8a7c; no voters:
I20260807 08:40:09.906996 13537 leader_election.cc:288] T 00000000000000000000000000000000 P a73a794866f341c18aab71f53b3e8a7c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:40:09.907073 13542 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a73a794866f341c18aab71f53b3e8a7c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:09.907341 13542 raft_consensus.cc:686] T 00000000000000000000000000000000 P a73a794866f341c18aab71f53b3e8a7c [term 1 LEADER]: Becoming Leader. State: Replica: a73a794866f341c18aab71f53b3e8a7c, State: Running, Role: LEADER
I20260807 08:40:09.907699 13542 consensus_queue.cc:237] T 00000000000000000000000000000000 P a73a794866f341c18aab71f53b3e8a7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a73a794866f341c18aab71f53b3e8a7c" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36235 } }
I20260807 08:40:09.908175 13537 sys_catalog.cc:564] T 00000000000000000000000000000000 P a73a794866f341c18aab71f53b3e8a7c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:40:09.908469 13540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:09.894696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52944 (local address 127.8.208.254:36235)
0807 08:40:09.895135 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:09.895148 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:09.895182 (+ 34us) server_negotiation.cc:407] Connection header received
0807 08:40:09.895765 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:09.895779 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:09.896107 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:09.896444 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:09.897216 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:09.898229 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:09.899047 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:09.899650 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:09.899804 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:09.902408 (+ 2604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:09.902413 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:09.902424 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:09.902455 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:09.904860 (+ 2405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:09.905458 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:09.905465 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:09.905471 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:09.905622 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:09.906074 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:09.906079 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:09.906081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:09.906660 (+ 579us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:09.906873 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:09.907128 (+ 255us) server_negotiation.cc:299] Negotiation successful
0807 08:40:09.907561 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":118,"threads_started":1}
I20260807 08:40:09.908810 13542 sys_catalog.cc:455] T 00000000000000000000000000000000 P a73a794866f341c18aab71f53b3e8a7c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a73a794866f341c18aab71f53b3e8a7c. Latest consensus state: current_term: 1 leader_uuid: "a73a794866f341c18aab71f53b3e8a7c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a73a794866f341c18aab71f53b3e8a7c" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36235 } } }
I20260807 08:40:09.908977 13542 sys_catalog.cc:458] T 00000000000000000000000000000000 P a73a794866f341c18aab71f53b3e8a7c [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:09.909394 13551 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:40:09.911378 13543 sys_catalog.cc:455] T 00000000000000000000000000000000 P a73a794866f341c18aab71f53b3e8a7c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a73a794866f341c18aab71f53b3e8a7c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a73a794866f341c18aab71f53b3e8a7c" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36235 } } }
I20260807 08:40:09.911696 13543 sys_catalog.cc:458] T 00000000000000000000000000000000 P a73a794866f341c18aab71f53b3e8a7c [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:09.912679 13551 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:40:09.918540 13551 catalog_manager.cc:1347] Generated new cluster ID: 48aaca4193b04e949eb8bed7da9c79b1
I20260807 08:40:09.918598 13551 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:40:09.927058 13551 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:40:09.927933 13551 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:40:09.934964 13551 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a73a794866f341c18aab71f53b3e8a7c: Generated new TSK 0
I20260807 08:40:09.935546 13551 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.208.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
I20260807 08:40:09.969290 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:36235
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:35295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:10.100199 13564 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:10.100442 13564 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:10.100488 13564 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:10.104423 13564 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:10.104475 13564 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:10.104532 13564 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:40:10.109849 13564 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:35295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:36235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13564
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:10.110788 13564 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:10.111758 13564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:10.121232 13570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:10.121330 13564 server_base.cc:1034] running on GCE node
W20260807 08:40:10.121248 13574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:10.121232 13572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:10.122071 13564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:10.122632 13564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:10.123791 13564 hybrid_clock.cc:648] HybridClock initialized: now 1786092010123771 us; error 31 us; skew 500 ppm
Aug 07 08:40:10 dist-test-slave-6nmv krb5kdc[13454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092010, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:10.126593 13564 init.cc:377] Logged in from keytab as kudu/127.8.208.193@KRBTEST.COM (short username kudu)
I20260807 08:40:10.127297 13564 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:10.127413 13564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:10.127645 13564 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:10.129634 13564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "05b758cdbf504538a50e4e1a314d2656"
format_stamp: "Formatted at 2026-08-07 08:40:10 on dist-test-slave-6nmv"
server_key: "fcc93f247f40a5dd6a5b7c9f65568a1d"
server_key_iv: "88244d3637813e1be09e97e87607e2c8"
server_key_version: "encryptionkey@0"
I20260807 08:40:10.130275 13564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "05b758cdbf504538a50e4e1a314d2656"
format_stamp: "Formatted at 2026-08-07 08:40:10 on dist-test-slave-6nmv"
server_key: "fcc93f247f40a5dd6a5b7c9f65568a1d"
server_key_iv: "88244d3637813e1be09e97e87607e2c8"
server_key_version: "encryptionkey@0"
I20260807 08:40:10.134189 13564 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 08:40:10.136713 13580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:10.137969 13564 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:40:10.138098 13564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "05b758cdbf504538a50e4e1a314d2656"
format_stamp: "Formatted at 2026-08-07 08:40:10 on dist-test-slave-6nmv"
server_key: "fcc93f247f40a5dd6a5b7c9f65568a1d"
server_key_iv: "88244d3637813e1be09e97e87607e2c8"
server_key_version: "encryptionkey@0"
I20260807 08:40:10.138203 13564 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:10.148465 13564 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:10.151814 13564 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:10.152026 13564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:10.152550 13564 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:10.153330 13564 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:10.153376 13564 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:10.153415 13564 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:10.153472 13564 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:10.161531 13564 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:43843
I20260807 08:40:10.161589 13698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:43843 every 8 connection(s)
I20260807 08:40:10.162137 13564 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:40:10.166891 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 13564
I20260807 08:40:10.167034 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
I20260807 08:40:10.167333 9027 external_mini_cluster.cc:1428] Setting key d6e3150e556a8ff7407156b54f7ca037
Aug 07 08:40:10 dist-test-slave-6nmv krb5kdc[13454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092010, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:10.176400 13540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:10.163821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:39569 (local address 127.8.208.254:36235)
0807 08:40:10.163991 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:10.163994 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:10.165129 (+ 1135us) server_negotiation.cc:407] Connection header received
0807 08:40:10.166046 (+ 917us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:10.166049 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:10.166109 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:10.166190 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:10.167613 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.168260 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.169485 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.169719 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.169864 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:10.172749 (+ 2885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:10.172759 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:10.172762 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:10.172786 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:10.174353 (+ 1567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:10.174882 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:10.174887 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:10.174888 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:10.174984 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:10.175340 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:10.175343 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:10.175345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:10.175528 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:10.175635 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:10.176107 (+ 472us) server_negotiation.cc:299] Negotiation successful
0807 08:40:10.176228 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":57}
WARNING: no policy specified for kudu/127.8.208.194@KRBTEST.COM; defaulting to no policy
I20260807 08:40:10.177165 13701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:10.164179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36235 (local address 127.8.208.193:39569)
0807 08:40:10.164966 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:10.165013 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:10.165791 (+ 778us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:10.166353 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:10.166360 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:10.166868 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:10.167438 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:10.167456 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.168408 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.168412 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:10.169347 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:10.169357 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.169902 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.169906 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:10.170072 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:10.170704 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:10.170730 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:10.172588 (+ 1858us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:10.174479 (+ 1891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:10.174485 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:10.174497 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:10.174772 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:10.175088 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:10.175091 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:10.175093 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:10.175234 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:10.175646 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:10.175654 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:10.175870 (+ 216us) client_negotiation.cc:769] Sending connection context
0807 08:40:10.176064 (+ 194us) client_negotiation.cc:240] Negotiation successful
0807 08:40:10.176350 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":116,"threads_started":1}
I20260807 08:40:10.178450 13699 heartbeater.cc:347] Connected to a master server at 127.8.208.254:36235
I20260807 08:40:10.178632 13699 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:10.178999 13699 heartbeater.cc:511] Master 127.8.208.254:36235 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.194@KRBTEST.COM" created.
I20260807 08:40:10.180568 13499 ts_manager.cc:194] Registered new tserver with Master: 05b758cdbf504538a50e4e1a314d2656 (127.8.208.193:43843)
I20260807 08:40:10.181756 13499 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.193@KRBTEST.COM'} at 127.8.208.193:39569
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
I20260807 08:40:10.196702 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:36235
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:35295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:10.298671 13704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:10.298887 13704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:10.298926 13704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:10.302681 13704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:10.302726 13704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:10.302814 13704 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:40:10.307798 13704 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:35295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:36235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13704
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:10.308705 13704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:10.309638 13704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:10.318336 13712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:10.318341 13710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:10.318368 13709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:10.318760 13704 server_base.cc:1034] running on GCE node
I20260807 08:40:10.319114 13704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:10.319701 13704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:10.320852 13704 hybrid_clock.cc:648] HybridClock initialized: now 1786092010320840 us; error 32 us; skew 500 ppm
Aug 07 08:40:10 dist-test-slave-6nmv krb5kdc[13454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092010, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:10.323529 13704 init.cc:377] Logged in from keytab as kudu/127.8.208.194@KRBTEST.COM (short username kudu)
I20260807 08:40:10.324187 13704 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:10.324249 13704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:10.324397 13704 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:10.326365 13704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "c77bd4856be24d778c6dd92f5dd3093b"
format_stamp: "Formatted at 2026-08-07 08:40:10 on dist-test-slave-6nmv"
server_key: "73d4939064c01be769768fedafb8fba1"
server_key_iv: "f2963d013ca5a157cf0346baaf3a3849"
server_key_version: "encryptionkey@0"
I20260807 08:40:10.326856 13704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "c77bd4856be24d778c6dd92f5dd3093b"
format_stamp: "Formatted at 2026-08-07 08:40:10 on dist-test-slave-6nmv"
server_key: "73d4939064c01be769768fedafb8fba1"
server_key_iv: "f2963d013ca5a157cf0346baaf3a3849"
server_key_version: "encryptionkey@0"
I20260807 08:40:10.330159 13704 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 08:40:10.332334 13718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:10.333453 13704 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:10.333567 13704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "c77bd4856be24d778c6dd92f5dd3093b"
format_stamp: "Formatted at 2026-08-07 08:40:10 on dist-test-slave-6nmv"
server_key: "73d4939064c01be769768fedafb8fba1"
server_key_iv: "f2963d013ca5a157cf0346baaf3a3849"
server_key_version: "encryptionkey@0"
I20260807 08:40:10.333664 13704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:10.342473 13704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:10.345474 13704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:10.345661 13704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:10.346244 13704 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:10.347018 13704 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:10.347090 13704 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:10.347155 13704 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:10.347206 13704 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:10.355752 13704 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:34635
I20260807 08:40:10.355775 13839 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:34635 every 8 connection(s)
I20260807 08:40:10.356261 13704 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:40:10.362109 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 13704
I20260807 08:40:10.362252 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:40:10.362561 9027 external_mini_cluster.cc:1428] Setting key 59feb9ba4eea31cd435ca5c78592d18b
Aug 07 08:40:10 dist-test-slave-6nmv krb5kdc[13454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092010, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:10.370159 13540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:10.357897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:49545 (local address 127.8.208.254:36235)
0807 08:40:10.358057 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:10.358061 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:10.359231 (+ 1170us) server_negotiation.cc:407] Connection header received
0807 08:40:10.360113 (+ 882us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:10.360116 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:10.360175 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:10.360274 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:10.361354 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.361904 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.363162 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.363435 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.363529 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:10.366359 (+ 2830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:10.366363 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:10.366368 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:10.366406 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:10.368065 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:10.368547 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:10.368553 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:10.368557 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:10.368645 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:10.368938 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:10.368943 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:10.368947 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:10.369181 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:10.369283 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:10.369733 (+ 450us) server_negotiation.cc:299] Negotiation successful
0807 08:40:10.369897 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 08:40:10.370730 13842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:10.358161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36235 (local address 127.8.208.194:49545)
0807 08:40:10.359070 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:10.359120 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:10.359908 (+ 788us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:10.360440 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:10.360446 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:10.360761 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:10.361221 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:10.361232 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.362018 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.362021 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:10.363037 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:10.363048 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.363597 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.363600 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:10.363766 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:10.364346 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:10.364360 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:10.366177 (+ 1817us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:10.368203 (+ 2026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:10.368207 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:10.368216 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:10.368451 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:10.368729 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:10.368732 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:10.368733 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:10.368845 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:10.369283 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:10.369287 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:10.369503 (+ 216us) client_negotiation.cc:769] Sending connection context
0807 08:40:10.369640 (+ 137us) client_negotiation.cc:240] Negotiation successful
0807 08:40:10.369945 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":106,"threads_started":1}
I20260807 08:40:10.371757 13840 heartbeater.cc:347] Connected to a master server at 127.8.208.254:36235
I20260807 08:40:10.371994 13840 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:10.372391 13840 heartbeater.cc:511] Master 127.8.208.254:36235 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.8.208.195@KRBTEST.COM; defaulting to no policy
I20260807 08:40:10.373337 13499 ts_manager.cc:194] Registered new tserver with Master: c77bd4856be24d778c6dd92f5dd3093b (127.8.208.194:34635)
I20260807 08:40:10.373952 13499 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.194@KRBTEST.COM'} at 127.8.208.194:49545
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
I20260807 08:40:10.390790 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:36235
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:35295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:10.500121 13845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:10.500401 13845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:10.500479 13845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:10.504376 13845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:10.504462 13845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:10.504550 13845 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:40:10.509575 13845 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:35295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:36235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13845
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:10.510567 13845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:10.511569 13845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:10.520714 13852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:10.520715 13851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:10.520715 13854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:10.521057 13845 server_base.cc:1034] running on GCE node
I20260807 08:40:10.521508 13845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:10.522131 13845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:10.523300 13845 hybrid_clock.cc:648] HybridClock initialized: now 1786092010523277 us; error 43 us; skew 500 ppm
Aug 07 08:40:10 dist-test-slave-6nmv krb5kdc[13454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092010, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:10.526026 13845 init.cc:377] Logged in from keytab as kudu/127.8.208.195@KRBTEST.COM (short username kudu)
I20260807 08:40:10.526633 13845 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:10.526690 13845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:10.526830 13845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:10.528635 13845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "21ab9d4a761e4ed8bc5c93ba05206125"
format_stamp: "Formatted at 2026-08-07 08:40:10 on dist-test-slave-6nmv"
server_key: "85a72577d7dbc26507c7583c1401e0ea"
server_key_iv: "0c501ed9dee439f12f8f1dfe307bbbb9"
server_key_version: "encryptionkey@0"
I20260807 08:40:10.529165 13845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "21ab9d4a761e4ed8bc5c93ba05206125"
format_stamp: "Formatted at 2026-08-07 08:40:10 on dist-test-slave-6nmv"
server_key: "85a72577d7dbc26507c7583c1401e0ea"
server_key_iv: "0c501ed9dee439f12f8f1dfe307bbbb9"
server_key_version: "encryptionkey@0"
I20260807 08:40:10.532586 13845 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 08:40:10.534931 13860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:10.536180 13845 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:40:10.536298 13845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "21ab9d4a761e4ed8bc5c93ba05206125"
format_stamp: "Formatted at 2026-08-07 08:40:10 on dist-test-slave-6nmv"
server_key: "85a72577d7dbc26507c7583c1401e0ea"
server_key_iv: "0c501ed9dee439f12f8f1dfe307bbbb9"
server_key_version: "encryptionkey@0"
I20260807 08:40:10.536396 13845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:10.555656 13845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:10.558857 13845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:10.559089 13845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:10.559715 13845 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:10.560588 13845 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:10.560636 13845 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:10.560688 13845 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:10.560786 13845 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:10.569803 13845 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:34445
I20260807 08:40:10.569857 13982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:34445 every 8 connection(s)
I20260807 08:40:10.570415 13845 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:40:10.576882 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 13845
I20260807 08:40:10.576982 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:40:10.577332 9027 external_mini_cluster.cc:1428] Setting key af8d0f5dfdf1e84f2ded72163e2bcac0
Aug 07 08:40:10 dist-test-slave-6nmv krb5kdc[13454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092010, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:10.583544 13540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:10.572196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:49871 (local address 127.8.208.254:36235)
0807 08:40:10.572344 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:10.572347 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:10.573501 (+ 1154us) server_negotiation.cc:407] Connection header received
0807 08:40:10.574440 (+ 939us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:10.574443 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:10.574501 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:10.574582 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:10.575720 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.576271 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.577525 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.577751 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.577918 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:10.580259 (+ 2341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:10.580263 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:10.580266 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:10.580290 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:10.581538 (+ 1248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:10.582120 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:10.582125 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:10.582127 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:10.582212 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:10.582567 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:10.582570 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:10.582572 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:10.582746 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:10.582853 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:10.583287 (+ 434us) server_negotiation.cc:299] Negotiation successful
0807 08:40:10.583393 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 08:40:10.584244 13985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:10.572569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36235 (local address 127.8.208.195:49871)
0807 08:40:10.573348 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:10.573387 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:10.574233 (+ 846us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:10.574746 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:10.574753 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:10.575100 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:10.575573 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:10.575586 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.576401 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.576409 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:10.577389 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:10.577404 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.577967 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.577971 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:10.578151 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:10.578756 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:10.578771 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:10.580112 (+ 1341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:10.581655 (+ 1543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:10.581660 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:10.581673 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:10.582021 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:10.582324 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:10.582327 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:10.582329 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:10.582467 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:10.582851 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:10.582857 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:10.583079 (+ 222us) client_negotiation.cc:769] Sending connection context
0807 08:40:10.583247 (+ 168us) client_negotiation.cc:240] Negotiation successful
0807 08:40:10.583527 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":116,"threads_started":1}
I20260807 08:40:10.585208 13983 heartbeater.cc:347] Connected to a master server at 127.8.208.254:36235
I20260807 08:40:10.585441 13983 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:10.585880 13983 heartbeater.cc:511] Master 127.8.208.254:36235 requested a full tablet report, sending...
I20260807 08:40:10.586874 13499 ts_manager.cc:194] Registered new tserver with Master: 21ab9d4a761e4ed8bc5c93ba05206125 (127.8.208.195:34445)
I20260807 08:40:10.587420 13499 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.195@KRBTEST.COM'} at 127.8.208.195:49871
I20260807 08:40:10.591012 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 08:40:10.599517 13540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:10.593086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52958 (local address 127.8.208.254:36235)
0807 08:40:10.593213 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:10.593217 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:10.593413 (+ 196us) server_negotiation.cc:407] Connection header received
0807 08:40:10.593494 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:10.593496 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:10.593529 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:10.593607 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:10.594270 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.594749 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.595516 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.595711 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.595787 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:10.596951 (+ 1164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:10.596953 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:10.596955 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:10.596974 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:10.598214 (+ 1240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:10.598578 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:10.598581 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:10.598582 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:10.598650 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:10.598874 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:10.598876 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:10.598878 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:10.599052 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:10.599145 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:10.599321 (+ 176us) server_negotiation.cc:299] Negotiation successful
0807 08:40:10.599409 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 08:40:10.602319 13499 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52958:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 08:40:10.606689 13499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:40:10.620900 14001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:10.615334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37736 (local address 127.8.208.195:34445)
0807 08:40:10.616186 (+ 852us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:10.616198 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:10.616219 (+ 21us) server_negotiation.cc:407] Connection header received
0807 08:40:10.616289 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:10.616295 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:10.616514 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:10.616651 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:10.617099 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.618206 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.619343 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.620191 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.620320 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:10.620488 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:10.620620 (+ 132us) server_negotiation.cc:299] Negotiation successful
0807 08:40:10.620719 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":751,"thread_start_us":161,"threads_started":1}
I20260807 08:40:10.620918 13996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:10.614651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:34635 (local address 127.0.0.1:53800)
0807 08:40:10.615390 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:10.615439 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:10.615558 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:10.616157 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:10.616162 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:10.616187 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:10.616325 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:10.616332 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.618078 (+ 1746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.618081 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:10.619467 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:10.619477 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.620501 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.620507 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:10.620620 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:10.620647 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 08:40:10.620701 (+ 54us) client_negotiation.cc:240] Negotiation successful
0807 08:40:10.620766 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"mutex_wait_us":102,"thread_start_us":81,"threads_started":1}
I20260807 08:40:10.620833 13997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:10.614908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:34445 (local address 127.0.0.1:37736)
0807 08:40:10.615775 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:10.615791 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:10.615917 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:10.616805 (+ 888us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:10.616808 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:10.616826 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:10.616952 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:10.616959 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.618341 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.618344 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:10.619213 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:10.619223 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.620325 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.620328 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:10.620438 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:10.620474 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 08:40:10.620579 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 08:40:10.620685 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":803,"mutex_wait_us":1,"thread_start_us":91,"threads_started":1}
I20260807 08:40:10.621398 13999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:10.614913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53800 (local address 127.8.208.194:34635)
0807 08:40:10.615494 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:10.615510 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:10.615540 (+ 30us) server_negotiation.cc:407] Connection header received
0807 08:40:10.615741 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:10.615748 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:10.615958 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:10.616534 (+ 576us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:10.616710 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.617901 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.619588 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.620338 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.620929 (+ 591us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:10.621088 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:10.621135 (+ 47us) server_negotiation.cc:299] Negotiation successful
0807 08:40:10.621214 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":156,"threads_started":1}
I20260807 08:40:10.621686 14002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:10.615796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35152 (local address 127.8.208.193:43843)
0807 08:40:10.616087 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:10.616098 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:10.616491 (+ 393us) server_negotiation.cc:407] Connection header received
0807 08:40:10.616574 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:10.616580 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:10.616758 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:10.616915 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:10.617128 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.617899 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.620042 (+ 2143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.620736 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.620825 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:10.620956 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:10.621474 (+ 518us) server_negotiation.cc:299] Negotiation successful
0807 08:40:10.621557 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":102,"threads_started":1}
I20260807 08:40:10.621951 14000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:10.615387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:43843 (local address 127.0.0.1:35152)
0807 08:40:10.616257 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:10.616271 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:10.616366 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:10.616895 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:10.616898 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:10.616915 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:10.617035 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:10.617044 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.618036 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.618040 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:10.619932 (+ 1892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:10.619939 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.621019 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.621022 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:10.621112 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:10.621137 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 08:40:10.621199 (+ 62us) client_negotiation.cc:240] Negotiation successful
0807 08:40:10.621277 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":806,"mutex_wait_us":67,"thread_start_us":104,"threads_started":1}
I20260807 08:40:10.624308 13771 tablet_service.cc:1467] Processing CreateTablet for tablet f82e05dd1b7e4f1188a340f8b2075f1c (DEFAULT_TABLE table=test-table [id=29c95b84ac9f41eb9da78c388ac46147]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:10.624308 13912 tablet_service.cc:1467] Processing CreateTablet for tablet f82e05dd1b7e4f1188a340f8b2075f1c (DEFAULT_TABLE table=test-table [id=29c95b84ac9f41eb9da78c388ac46147]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:10.625458 13771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f82e05dd1b7e4f1188a340f8b2075f1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:10.625463 13912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f82e05dd1b7e4f1188a340f8b2075f1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:10.627310 13629 tablet_service.cc:1467] Processing CreateTablet for tablet f82e05dd1b7e4f1188a340f8b2075f1c (DEFAULT_TABLE table=test-table [id=29c95b84ac9f41eb9da78c388ac46147]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:10.628108 13629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f82e05dd1b7e4f1188a340f8b2075f1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:10.632654 14004 tablet_bootstrap.cc:492] T f82e05dd1b7e4f1188a340f8b2075f1c P 21ab9d4a761e4ed8bc5c93ba05206125: Bootstrap starting.
I20260807 08:40:10.633085 14003 tablet_bootstrap.cc:492] T f82e05dd1b7e4f1188a340f8b2075f1c P c77bd4856be24d778c6dd92f5dd3093b: Bootstrap starting.
I20260807 08:40:10.633761 14005 tablet_bootstrap.cc:492] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656: Bootstrap starting.
I20260807 08:40:10.635349 14003 tablet_bootstrap.cc:654] T f82e05dd1b7e4f1188a340f8b2075f1c P c77bd4856be24d778c6dd92f5dd3093b: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:10.635841 14005 tablet_bootstrap.cc:654] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:10.636329 14004 tablet_bootstrap.cc:654] T f82e05dd1b7e4f1188a340f8b2075f1c P 21ab9d4a761e4ed8bc5c93ba05206125: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:10.636548 14003 log.cc:824] T f82e05dd1b7e4f1188a340f8b2075f1c P c77bd4856be24d778c6dd92f5dd3093b: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:10.636976 14005 log.cc:824] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:10.637372 14004 log.cc:824] T f82e05dd1b7e4f1188a340f8b2075f1c P 21ab9d4a761e4ed8bc5c93ba05206125: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:10.638653 14003 tablet_bootstrap.cc:492] T f82e05dd1b7e4f1188a340f8b2075f1c P c77bd4856be24d778c6dd92f5dd3093b: No bootstrap required, opened a new log
I20260807 08:40:10.638823 14003 ts_tablet_manager.cc:1397] T f82e05dd1b7e4f1188a340f8b2075f1c P c77bd4856be24d778c6dd92f5dd3093b: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260807 08:40:10.639192 14004 tablet_bootstrap.cc:492] T f82e05dd1b7e4f1188a340f8b2075f1c P 21ab9d4a761e4ed8bc5c93ba05206125: No bootstrap required, opened a new log
I20260807 08:40:10.639366 14004 ts_tablet_manager.cc:1397] T f82e05dd1b7e4f1188a340f8b2075f1c P 21ab9d4a761e4ed8bc5c93ba05206125: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 08:40:10.642742 14003 raft_consensus.cc:348] T f82e05dd1b7e4f1188a340f8b2075f1c P c77bd4856be24d778c6dd92f5dd3093b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bd4856be24d778c6dd92f5dd3093b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 34635 } } peers { permanent_uuid: "21ab9d4a761e4ed8bc5c93ba05206125" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34445 } } peers { permanent_uuid: "05b758cdbf504538a50e4e1a314d2656" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43843 } }
I20260807 08:40:10.643040 14003 raft_consensus.cc:374] T f82e05dd1b7e4f1188a340f8b2075f1c P c77bd4856be24d778c6dd92f5dd3093b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:10.643116 14003 raft_consensus.cc:729] T f82e05dd1b7e4f1188a340f8b2075f1c P c77bd4856be24d778c6dd92f5dd3093b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c77bd4856be24d778c6dd92f5dd3093b, State: Initialized, Role: FOLLOWER
I20260807 08:40:10.642987 14004 raft_consensus.cc:348] T f82e05dd1b7e4f1188a340f8b2075f1c P 21ab9d4a761e4ed8bc5c93ba05206125 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bd4856be24d778c6dd92f5dd3093b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 34635 } } peers { permanent_uuid: "21ab9d4a761e4ed8bc5c93ba05206125" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34445 } } peers { permanent_uuid: "05b758cdbf504538a50e4e1a314d2656" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43843 } }
I20260807 08:40:10.643159 14005 tablet_bootstrap.cc:492] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656: No bootstrap required, opened a new log
I20260807 08:40:10.643209 14004 raft_consensus.cc:374] T f82e05dd1b7e4f1188a340f8b2075f1c P 21ab9d4a761e4ed8bc5c93ba05206125 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:10.643299 14004 raft_consensus.cc:729] T f82e05dd1b7e4f1188a340f8b2075f1c P 21ab9d4a761e4ed8bc5c93ba05206125 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21ab9d4a761e4ed8bc5c93ba05206125, State: Initialized, Role: FOLLOWER
I20260807 08:40:10.643327 14005 ts_tablet_manager.cc:1397] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.004s
I20260807 08:40:10.643546 14003 consensus_queue.cc:260] T f82e05dd1b7e4f1188a340f8b2075f1c P c77bd4856be24d778c6dd92f5dd3093b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bd4856be24d778c6dd92f5dd3093b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 34635 } } peers { permanent_uuid: "21ab9d4a761e4ed8bc5c93ba05206125" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34445 } } peers { permanent_uuid: "05b758cdbf504538a50e4e1a314d2656" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43843 } }
I20260807 08:40:10.643733 14004 consensus_queue.cc:260] T f82e05dd1b7e4f1188a340f8b2075f1c P 21ab9d4a761e4ed8bc5c93ba05206125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bd4856be24d778c6dd92f5dd3093b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 34635 } } peers { permanent_uuid: "21ab9d4a761e4ed8bc5c93ba05206125" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34445 } } peers { permanent_uuid: "05b758cdbf504538a50e4e1a314d2656" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43843 } }
I20260807 08:40:10.644234 13840 heartbeater.cc:503] Master 127.8.208.254:36235 was elected leader, sending a full tablet report...
I20260807 08:40:10.644580 14003 ts_tablet_manager.cc:1428] T f82e05dd1b7e4f1188a340f8b2075f1c P c77bd4856be24d778c6dd92f5dd3093b: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 08:40:10.644731 14004 ts_tablet_manager.cc:1428] T f82e05dd1b7e4f1188a340f8b2075f1c P 21ab9d4a761e4ed8bc5c93ba05206125: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 08:40:10.645071 13983 heartbeater.cc:503] Master 127.8.208.254:36235 was elected leader, sending a full tablet report...
I20260807 08:40:10.647106 14005 raft_consensus.cc:348] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bd4856be24d778c6dd92f5dd3093b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 34635 } } peers { permanent_uuid: "21ab9d4a761e4ed8bc5c93ba05206125" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34445 } } peers { permanent_uuid: "05b758cdbf504538a50e4e1a314d2656" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43843 } }
I20260807 08:40:10.647403 14005 raft_consensus.cc:374] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:10.647487 14005 raft_consensus.cc:729] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05b758cdbf504538a50e4e1a314d2656, State: Initialized, Role: FOLLOWER
I20260807 08:40:10.647897 14005 consensus_queue.cc:260] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bd4856be24d778c6dd92f5dd3093b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 34635 } } peers { permanent_uuid: "21ab9d4a761e4ed8bc5c93ba05206125" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34445 } } peers { permanent_uuid: "05b758cdbf504538a50e4e1a314d2656" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43843 } }
I20260807 08:40:10.648911 14005 ts_tablet_manager.cc:1428] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260807 08:40:10.648980 13699 heartbeater.cc:503] Master 127.8.208.254:36235 was elected leader, sending a full tablet report...
W20260807 08:40:10.663178 13700 tablet.cc:2369] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 08:40:10.821408 13984 tablet.cc:2369] T f82e05dd1b7e4f1188a340f8b2075f1c P 21ab9d4a761e4ed8bc5c93ba05206125: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 08:40:10.857364 13841 tablet.cc:2369] T f82e05dd1b7e4f1188a340f8b2075f1c P c77bd4856be24d778c6dd92f5dd3093b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 08:40:10.886582 14011 raft_consensus.cc:482] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:40:10.886783 14011 raft_consensus.cc:504] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bd4856be24d778c6dd92f5dd3093b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 34635 } } peers { permanent_uuid: "21ab9d4a761e4ed8bc5c93ba05206125" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34445 } } peers { permanent_uuid: "05b758cdbf504538a50e4e1a314d2656" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43843 } }
I20260807 08:40:10.887890 14011 leader_election.cc:288] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c77bd4856be24d778c6dd92f5dd3093b (127.8.208.194:34635), 21ab9d4a761e4ed8bc5c93ba05206125 (127.8.208.195:34445)
I20260807 08:40:10.892273 13999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:10.888476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:58457 (local address 127.8.208.194:34635)
0807 08:40:10.888587 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:10.888591 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:10.888605 (+ 14us) server_negotiation.cc:407] Connection header received
0807 08:40:10.888656 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:10.888659 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:10.888703 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:10.888782 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:10.889088 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.889705 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.891065 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.891655 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.891787 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:10.891844 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:10.892093 (+ 249us) server_negotiation.cc:299] Negotiation successful
0807 08:40:10.892170 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 08:40:10.892288 14012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:10.888116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:34635 (local address 127.8.208.193:58457)
0807 08:40:10.888377 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:10.888392 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:10.888512 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:10.888826 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:10.888829 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:10.888845 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:10.888972 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:10.888977 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.889834 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.889838 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:10.890924 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:10.890935 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.891809 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.891813 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:10.891930 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:10.891957 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 08:40:10.892071 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 08:40:10.892144 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":97,"threads_started":1}
I20260807 08:40:10.892418 14001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:10.888850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:35885 (local address 127.8.208.195:34445)
0807 08:40:10.888974 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:10.888979 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:10.888991 (+ 12us) server_negotiation.cc:407] Connection header received
0807 08:40:10.889033 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:10.889035 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:10.889073 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:10.889135 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:10.889384 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.890126 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.891355 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.891847 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.891958 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:10.892017 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:10.892230 (+ 213us) server_negotiation.cc:299] Negotiation successful
0807 08:40:10.892303 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 08:40:10.892839 14013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:10.888164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:34445 (local address 127.8.208.193:35885)
0807 08:40:10.888576 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:10.888590 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:10.888660 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:10.889152 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:10.889154 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:10.889170 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:10.889277 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:10.889282 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.890242 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.890246 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:10.891235 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:10.891241 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.891973 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.891977 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:10.892095 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:10.892119 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 08:40:10.892599 (+ 480us) client_negotiation.cc:240] Negotiation successful
0807 08:40:10.892679 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":130,"threads_started":1}
I20260807 08:40:10.893338 13792 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f82e05dd1b7e4f1188a340f8b2075f1c" candidate_uuid: "05b758cdbf504538a50e4e1a314d2656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c77bd4856be24d778c6dd92f5dd3093b" is_pre_election: true
I20260807 08:40:10.893416 13933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f82e05dd1b7e4f1188a340f8b2075f1c" candidate_uuid: "05b758cdbf504538a50e4e1a314d2656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21ab9d4a761e4ed8bc5c93ba05206125" is_pre_election: true
I20260807 08:40:10.893636 13792 raft_consensus.cc:2454] T f82e05dd1b7e4f1188a340f8b2075f1c P c77bd4856be24d778c6dd92f5dd3093b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05b758cdbf504538a50e4e1a314d2656 in term 0.
I20260807 08:40:10.893704 13933 raft_consensus.cc:2454] T f82e05dd1b7e4f1188a340f8b2075f1c P 21ab9d4a761e4ed8bc5c93ba05206125 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05b758cdbf504538a50e4e1a314d2656 in term 0.
I20260807 08:40:10.894138 13584 leader_election.cc:302] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 05b758cdbf504538a50e4e1a314d2656, 21ab9d4a761e4ed8bc5c93ba05206125, c77bd4856be24d778c6dd92f5dd3093b; no voters:
I20260807 08:40:10.894379 14011 raft_consensus.cc:2781] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:40:10.894470 14011 raft_consensus.cc:482] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:40:10.894517 14011 raft_consensus.cc:3037] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:10.895752 14011 raft_consensus.cc:504] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bd4856be24d778c6dd92f5dd3093b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 34635 } } peers { permanent_uuid: "21ab9d4a761e4ed8bc5c93ba05206125" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34445 } } peers { permanent_uuid: "05b758cdbf504538a50e4e1a314d2656" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43843 } }
I20260807 08:40:10.896081 14011 leader_election.cc:288] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656 [CANDIDATE]: Term 1 election: Requested vote from peers c77bd4856be24d778c6dd92f5dd3093b (127.8.208.194:34635), 21ab9d4a761e4ed8bc5c93ba05206125 (127.8.208.195:34445)
I20260807 08:40:10.896636 13933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f82e05dd1b7e4f1188a340f8b2075f1c" candidate_uuid: "05b758cdbf504538a50e4e1a314d2656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21ab9d4a761e4ed8bc5c93ba05206125"
I20260807 08:40:10.896651 13792 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f82e05dd1b7e4f1188a340f8b2075f1c" candidate_uuid: "05b758cdbf504538a50e4e1a314d2656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c77bd4856be24d778c6dd92f5dd3093b"
I20260807 08:40:10.896768 13792 raft_consensus.cc:3037] T f82e05dd1b7e4f1188a340f8b2075f1c P c77bd4856be24d778c6dd92f5dd3093b [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:10.896772 13933 raft_consensus.cc:3037] T f82e05dd1b7e4f1188a340f8b2075f1c P 21ab9d4a761e4ed8bc5c93ba05206125 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:10.897795 13933 raft_consensus.cc:2454] T f82e05dd1b7e4f1188a340f8b2075f1c P 21ab9d4a761e4ed8bc5c93ba05206125 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05b758cdbf504538a50e4e1a314d2656 in term 1.
I20260807 08:40:10.897960 13792 raft_consensus.cc:2454] T f82e05dd1b7e4f1188a340f8b2075f1c P c77bd4856be24d778c6dd92f5dd3093b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05b758cdbf504538a50e4e1a314d2656 in term 1.
I20260807 08:40:10.898281 13582 leader_election.cc:302] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05b758cdbf504538a50e4e1a314d2656, 21ab9d4a761e4ed8bc5c93ba05206125; no voters:
I20260807 08:40:10.898455 14011 raft_consensus.cc:2781] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:10.898671 14011 raft_consensus.cc:686] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656 [term 1 LEADER]: Becoming Leader. State: Replica: 05b758cdbf504538a50e4e1a314d2656, State: Running, Role: LEADER
I20260807 08:40:10.898980 14011 consensus_queue.cc:237] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bd4856be24d778c6dd92f5dd3093b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 34635 } } peers { permanent_uuid: "21ab9d4a761e4ed8bc5c93ba05206125" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34445 } } peers { permanent_uuid: "05b758cdbf504538a50e4e1a314d2656" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43843 } }
I20260807 08:40:10.902122 13499 catalog_manager.cc:5495] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05b758cdbf504538a50e4e1a314d2656 (127.8.208.193). New cstate: current_term: 1 leader_uuid: "05b758cdbf504538a50e4e1a314d2656" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c77bd4856be24d778c6dd92f5dd3093b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21ab9d4a761e4ed8bc5c93ba05206125" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05b758cdbf504538a50e4e1a314d2656" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43843 } health_report { overall_health: HEALTHY } } }
I20260807 08:40:10.912283 14002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:10.908952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35162 (local address 127.8.208.193:43843)
0807 08:40:10.909051 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:10.909056 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:10.909124 (+ 68us) server_negotiation.cc:407] Connection header received
0807 08:40:10.909276 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:10.909284 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:10.909372 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:10.909476 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:40:10.909692 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.910182 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.910948 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:10.911141 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:10.911243 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:10.911541 (+ 298us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:40:10.911910 (+ 369us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:40:10.912044 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:10.912109 (+ 65us) server_negotiation.cc:299] Negotiation successful
0807 08:40:10.912159 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 08:40:10.918630 13933 raft_consensus.cc:1261] T f82e05dd1b7e4f1188a340f8b2075f1c P 21ab9d4a761e4ed8bc5c93ba05206125 [term 1 FOLLOWER]: Refusing update from remote peer 05b758cdbf504538a50e4e1a314d2656: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:40:10.918740 13792 raft_consensus.cc:1261] T f82e05dd1b7e4f1188a340f8b2075f1c P c77bd4856be24d778c6dd92f5dd3093b [term 1 FOLLOWER]: Refusing update from remote peer 05b758cdbf504538a50e4e1a314d2656: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:40:10.919302 14011 consensus_queue.cc:1035] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c77bd4856be24d778c6dd92f5dd3093b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:40:10.919435 14014 consensus_queue.cc:1035] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21ab9d4a761e4ed8bc5c93ba05206125" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:40:10.927640 14019 mvcc.cc:205] Tried to move back new op lower bound from 7315832876715999232 to 7315832876644564992. Current Snapshot: MvccSnapshot[applied={T|T < 7315832876715999232}]
I20260807 08:40:10.928929 14018 mvcc.cc:205] Tried to move back new op lower bound from 7315832876715999232 to 7315832876644564992. Current Snapshot: MvccSnapshot[applied={T|T < 7315832876715999232}]
I20260807 08:40:10.934607 13498 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52958:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:40:10.934737 13498 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52958:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:40:10.936904 13498 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a73a794866f341c18aab71f53b3e8a7c: Sending DeleteTablet for 3 replicas of tablet f82e05dd1b7e4f1188a340f8b2075f1c
I20260807 08:40:10.937608 13771 tablet_service.cc:1514] Processing DeleteTablet for tablet f82e05dd1b7e4f1188a340f8b2075f1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:10 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:53800
I20260807 08:40:10.937738 13629 tablet_service.cc:1514] Processing DeleteTablet for tablet f82e05dd1b7e4f1188a340f8b2075f1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:10 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:35152
I20260807 08:40:10.937740 13912 tablet_service.cc:1514] Processing DeleteTablet for tablet f82e05dd1b7e4f1188a340f8b2075f1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:10 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:37736
I20260807 08:40:10.938198 14030 tablet_replica.cc:330] T f82e05dd1b7e4f1188a340f8b2075f1c P 21ab9d4a761e4ed8bc5c93ba05206125: stopping tablet replica
I20260807 08:40:10.938289 14029 tablet_replica.cc:330] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656: stopping tablet replica
I20260807 08:40:10.938534 14030 raft_consensus.cc:2229] T f82e05dd1b7e4f1188a340f8b2075f1c P 21ab9d4a761e4ed8bc5c93ba05206125 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:40:10.938591 14029 raft_consensus.cc:2229] T f82e05dd1b7e4f1188a340f8b2075f1c P 05b758cdbf504538a50e4e1a314d2656 [term 1 LEADER]: Raft consensus shutting down.
I20260807 08:40:10.938849 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 13564
I20260807 08:40:10.938896 14030 raft_consensus.cc:2258] T f82e05dd1b7e4f1188a340f8b2075f1c P 21ab9d4a761e4ed8bc5c93ba05206125 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:10.940352 14028 tablet_replica.cc:330] T f82e05dd1b7e4f1188a340f8b2075f1c P c77bd4856be24d778c6dd92f5dd3093b: stopping tablet replica
I20260807 08:40:10.940594 14028 raft_consensus.cc:2229] T f82e05dd1b7e4f1188a340f8b2075f1c P c77bd4856be24d778c6dd92f5dd3093b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:40:10.940855 14028 raft_consensus.cc:2258] T f82e05dd1b7e4f1188a340f8b2075f1c P c77bd4856be24d778c6dd92f5dd3093b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:10.942158 14030 ts_tablet_manager.cc:1905] T f82e05dd1b7e4f1188a340f8b2075f1c P 21ab9d4a761e4ed8bc5c93ba05206125: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:10.942363 14028 ts_tablet_manager.cc:1905] T f82e05dd1b7e4f1188a340f8b2075f1c P c77bd4856be24d778c6dd92f5dd3093b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:10.944423 14028 ts_tablet_manager.cc:1918] T f82e05dd1b7e4f1188a340f8b2075f1c P c77bd4856be24d778c6dd92f5dd3093b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:40:10.944527 14028 log.cc:1196] T f82e05dd1b7e4f1188a340f8b2075f1c P c77bd4856be24d778c6dd92f5dd3093b: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-1/wal/wals/f82e05dd1b7e4f1188a340f8b2075f1c
I20260807 08:40:10.944866 14028 ts_tablet_manager.cc:1939] T f82e05dd1b7e4f1188a340f8b2075f1c P c77bd4856be24d778c6dd92f5dd3093b: Deleting consensus metadata
I20260807 08:40:10.945436 14030 ts_tablet_manager.cc:1918] T f82e05dd1b7e4f1188a340f8b2075f1c P 21ab9d4a761e4ed8bc5c93ba05206125: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:40:10.945534 14030 log.cc:1196] T f82e05dd1b7e4f1188a340f8b2075f1c P 21ab9d4a761e4ed8bc5c93ba05206125: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/f82e05dd1b7e4f1188a340f8b2075f1c
I20260807 08:40:10.945951 14030 ts_tablet_manager.cc:1939] T f82e05dd1b7e4f1188a340f8b2075f1c P 21ab9d4a761e4ed8bc5c93ba05206125: Deleting consensus metadata
I20260807 08:40:10.945977 13486 catalog_manager.cc:4841] TS c77bd4856be24d778c6dd92f5dd3093b (127.8.208.194:34635): tablet f82e05dd1b7e4f1188a340f8b2075f1c (table test-table [id=29c95b84ac9f41eb9da78c388ac46147]) successfully deleted
I20260807 08:40:10.946977 13484 catalog_manager.cc:4841] TS 21ab9d4a761e4ed8bc5c93ba05206125 (127.8.208.195:34445): tablet f82e05dd1b7e4f1188a340f8b2075f1c (table test-table [id=29c95b84ac9f41eb9da78c388ac46147]) successfully deleted
W20260807 08:40:10.948092 13484 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.208.193:43843 (error 108)
I20260807 08:40:10.948367 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 13704
I20260807 08:40:10.949358 14000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:10.949104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:43843 (local address 127.0.0.1:35168)
0807 08:40:10.949229 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:10.949295 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.193:43843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 08:40:10.949527 13484 catalog_manager.cc:4584] TS 05b758cdbf504538a50e4e1a314d2656 (127.8.208.193:43843): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f82e05dd1b7e4f1188a340f8b2075f1c: Network error: Client connection negotiation failed: client connection to 127.8.208.193:43843: connect: Connection refused (error 111)
I20260807 08:40:10.954798 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 13845
I20260807 08:40:10.961069 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 13468
2026-08-07T08:40:10Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2433 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-07T08:40:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:40:10Z Disabled control of system clock
I20260807 08:40:10.992594 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:45763
--webserver_interface=127.8.208.254
--webserver_port=0
--builtin_ntp_servers=127.8.208.212:42213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:45763
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 08:40:11.099290 14035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:11.099558 14035 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:11.099596 14035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:11.103350 14035 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:40:11.103426 14035 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:11.103442 14035 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:11.103459 14035 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:40:11.103513 14035 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:40:11.108244 14035 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:42213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:45763
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:45763
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14035
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:11.109282 14035 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:11.110653 14035 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:11.118589 14044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:11.118604 14042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:11.118589 14041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:11.118854 14035 server_base.cc:1034] running on GCE node
I20260807 08:40:11.119397 14035 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:11.120400 14035 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:11.121557 14035 hybrid_clock.cc:648] HybridClock initialized: now 1786092011121533 us; error 34 us; skew 500 ppm
I20260807 08:40:11.123270 14035 webserver.cc:460] Webserver started at http://127.8.208.254:42191/ using document root <none> and password file <none>
I20260807 08:40:11.123771 14035 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:11.123826 14035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:11.124044 14035 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:11.126092 14035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "8a86a7d79918410b8dd113afc0bb9cbe"
format_stamp: "Formatted at 2026-08-07 08:40:11 on dist-test-slave-6nmv"
server_key: "b926be7160ba95289603591f19fbe583"
server_key_iv: "29da6a699b1af2c6452fbc6ded225239"
server_key_version: "encryptionkey@0"
I20260807 08:40:11.126593 14035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "8a86a7d79918410b8dd113afc0bb9cbe"
format_stamp: "Formatted at 2026-08-07 08:40:11 on dist-test-slave-6nmv"
server_key: "b926be7160ba95289603591f19fbe583"
server_key_iv: "29da6a699b1af2c6452fbc6ded225239"
server_key_version: "encryptionkey@0"
I20260807 08:40:11.129801 14035 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 08:40:11.132097 14050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:11.133306 14035 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 08:40:11.133436 14035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "8a86a7d79918410b8dd113afc0bb9cbe"
format_stamp: "Formatted at 2026-08-07 08:40:11 on dist-test-slave-6nmv"
server_key: "b926be7160ba95289603591f19fbe583"
server_key_iv: "29da6a699b1af2c6452fbc6ded225239"
server_key_version: "encryptionkey@0"
I20260807 08:40:11.133538 14035 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:11.137689 14035 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:11.138278 14035 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:11.138461 14035 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:11.144394 14035 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:45763
I20260807 08:40:11.144405 14107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:45763 every 8 connection(s)
I20260807 08:40:11.145237 14035 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:40:11.147784 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 14035
I20260807 08:40:11.147940 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:40:11.148204 9027 external_mini_cluster.cc:1428] Setting key 930c945b4a90bf02bc29733533d1cfa9
I20260807 08:40:11.148317 14108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:11.153777 14111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:11.149511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45046 (local address 127.8.208.254:45763)
0807 08:40:11.150233 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:11.150249 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:11.150289 (+ 40us) server_negotiation.cc:407] Connection header received
0807 08:40:11.151160 (+ 871us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:11.151177 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:11.151491 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:11.151857 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:11.152627 (+ 770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:11.152638 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:11.152649 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:40:11.152659 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:11.152709 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:40:11.152724 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:11.152876 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:11.152953 (+ 77us) server_negotiation.cc:299] Negotiation successful
0807 08:40:11.153162 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":131,"threads_started":1}
I20260807 08:40:11.154376 14108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a86a7d79918410b8dd113afc0bb9cbe: Bootstrap starting.
I20260807 08:40:11.156764 14108 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a86a7d79918410b8dd113afc0bb9cbe: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:11.157424 14108 log.cc:824] T 00000000000000000000000000000000 P 8a86a7d79918410b8dd113afc0bb9cbe: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:11.159313 14108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a86a7d79918410b8dd113afc0bb9cbe: No bootstrap required, opened a new log
I20260807 08:40:11.162955 14108 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a86a7d79918410b8dd113afc0bb9cbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a86a7d79918410b8dd113afc0bb9cbe" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45763 } }
I20260807 08:40:11.163153 14108 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a86a7d79918410b8dd113afc0bb9cbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:11.163185 14108 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a86a7d79918410b8dd113afc0bb9cbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a86a7d79918410b8dd113afc0bb9cbe, State: Initialized, Role: FOLLOWER
I20260807 08:40:11.163550 14108 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a86a7d79918410b8dd113afc0bb9cbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a86a7d79918410b8dd113afc0bb9cbe" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45763 } }
I20260807 08:40:11.163664 14108 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a86a7d79918410b8dd113afc0bb9cbe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:40:11.163707 14108 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a86a7d79918410b8dd113afc0bb9cbe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:40:11.163772 14108 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a86a7d79918410b8dd113afc0bb9cbe [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:11.164494 14108 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a86a7d79918410b8dd113afc0bb9cbe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a86a7d79918410b8dd113afc0bb9cbe" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45763 } }
I20260807 08:40:11.164757 14108 leader_election.cc:302] T 00000000000000000000000000000000 P 8a86a7d79918410b8dd113afc0bb9cbe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a86a7d79918410b8dd113afc0bb9cbe; no voters:
I20260807 08:40:11.165019 14108 leader_election.cc:288] T 00000000000000000000000000000000 P 8a86a7d79918410b8dd113afc0bb9cbe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:40:11.165156 14113 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a86a7d79918410b8dd113afc0bb9cbe [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:11.165395 14113 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a86a7d79918410b8dd113afc0bb9cbe [term 1 LEADER]: Becoming Leader. State: Replica: 8a86a7d79918410b8dd113afc0bb9cbe, State: Running, Role: LEADER
I20260807 08:40:11.165715 14113 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a86a7d79918410b8dd113afc0bb9cbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a86a7d79918410b8dd113afc0bb9cbe" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45763 } }
I20260807 08:40:11.166180 14108 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a86a7d79918410b8dd113afc0bb9cbe [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:40:11.168805 14114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a86a7d79918410b8dd113afc0bb9cbe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a86a7d79918410b8dd113afc0bb9cbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a86a7d79918410b8dd113afc0bb9cbe" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45763 } } }
I20260807 08:40:11.168943 14114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a86a7d79918410b8dd113afc0bb9cbe [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:11.169230 14115 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a86a7d79918410b8dd113afc0bb9cbe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a86a7d79918410b8dd113afc0bb9cbe. Latest consensus state: current_term: 1 leader_uuid: "8a86a7d79918410b8dd113afc0bb9cbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a86a7d79918410b8dd113afc0bb9cbe" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45763 } } }
I20260807 08:40:11.169343 14115 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a86a7d79918410b8dd113afc0bb9cbe [sys.catalog]: This master's current role is: LEADER
W20260807 08:40:11.171355 14127 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8a86a7d79918410b8dd113afc0bb9cbe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:40:11.171452 14127 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:40:11.171533 14129 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:40:11.172322 14129 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:40:11.177304 14129 catalog_manager.cc:1347] Generated new cluster ID: a64449d5cbcf4155a411c54137eb49e6
I20260807 08:40:11.177366 14129 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:40:11.201596 14129 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:40:11.201930 14129 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:40:11.205842 14129 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a86a7d79918410b8dd113afc0bb9cbe: Generated new TSK 0
I20260807 08:40:11.206519 14129 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:40:11.210640 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:45763
--builtin_ntp_servers=127.8.208.212:42213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 08:40:11.317317 14133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:11.317538 14133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:11.317595 14133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:11.321472 14133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:11.321545 14133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:11.321630 14133 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:40:11.326169 14133 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:42213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:45763
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14133
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:11.327139 14133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:11.328441 14133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:11.337719 14139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:11.337692 14140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:11.337915 14133 server_base.cc:1034] running on GCE node
W20260807 08:40:11.338042 14142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:11.338443 14133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:11.339022 14133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:11.340176 14133 hybrid_clock.cc:648] HybridClock initialized: now 1786092011340159 us; error 28 us; skew 500 ppm
I20260807 08:40:11.341958 14133 webserver.cc:460] Webserver started at http://127.8.208.193:33733/ using document root <none> and password file <none>
I20260807 08:40:11.342449 14133 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:11.342507 14133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:11.342658 14133 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:11.344486 14133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "f0bf65b4b4c44343988cfd718fac0102"
format_stamp: "Formatted at 2026-08-07 08:40:11 on dist-test-slave-6nmv"
server_key: "dbf5d82167e43f76fa0bd5c1ccc06da7"
server_key_iv: "a431f77ca1a423abb5fb35070741d0a2"
server_key_version: "encryptionkey@0"
I20260807 08:40:11.345034 14133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "f0bf65b4b4c44343988cfd718fac0102"
format_stamp: "Formatted at 2026-08-07 08:40:11 on dist-test-slave-6nmv"
server_key: "dbf5d82167e43f76fa0bd5c1ccc06da7"
server_key_iv: "a431f77ca1a423abb5fb35070741d0a2"
server_key_version: "encryptionkey@0"
I20260807 08:40:11.348439 14133 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260807 08:40:11.350700 14148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:11.351866 14133 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260807 08:40:11.352000 14133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "f0bf65b4b4c44343988cfd718fac0102"
format_stamp: "Formatted at 2026-08-07 08:40:11 on dist-test-slave-6nmv"
server_key: "dbf5d82167e43f76fa0bd5c1ccc06da7"
server_key_iv: "a431f77ca1a423abb5fb35070741d0a2"
server_key_version: "encryptionkey@0"
I20260807 08:40:11.352100 14133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:11.356308 14133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:11.356829 14133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:11.356993 14133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:11.357507 14133 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:11.358402 14133 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:11.358445 14133 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:11.358505 14133 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:11.358534 14133 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:11.366780 14133 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:44791
I20260807 08:40:11.366838 14267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:44791 every 8 connection(s)
I20260807 08:40:11.367707 14133 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:40:11.373723 14111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:11.369472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:58231 (local address 127.8.208.254:45763)
0807 08:40:11.369604 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:11.369607 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:11.370604 (+ 997us) server_negotiation.cc:407] Connection header received
0807 08:40:11.372038 (+ 1434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:11.372042 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:11.372091 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:11.372203 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:11.373249 (+ 1046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:11.373253 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:11.373255 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:40:11.373268 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:11.373289 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:40:11.373304 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:11.373399 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:11.373548 (+ 149us) server_negotiation.cc:299] Negotiation successful
0807 08:40:11.373594 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 08:40:11.374502 14270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:11.369751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:45763 (local address 127.8.208.193:58231)
0807 08:40:11.370452 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:11.370490 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:11.371793 (+ 1303us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:11.372366 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:11.372373 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:11.372463 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:11.373003 (+ 540us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 08:40:11.373004 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:11.373038 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 08:40:11.373099 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:11.373383 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:11.373392 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:11.373397 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 08:40:11.373588 (+ 191us) client_negotiation.cc:240] Negotiation successful
0807 08:40:11.373803 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":114,"threads_started":1}
I20260807 08:40:11.375643 14268 heartbeater.cc:347] Connected to a master server at 127.8.208.254:45763
I20260807 08:40:11.375856 14268 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:11.376240 14268 heartbeater.cc:511] Master 127.8.208.254:45763 requested a full tablet report, sending...
I20260807 08:40:11.377203 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 14133
I20260807 08:40:11.377344 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
I20260807 08:40:11.377632 9027 external_mini_cluster.cc:1428] Setting key f1dff20b4dce155cd021ffebe6ea478d
I20260807 08:40:11.377784 14068 ts_manager.cc:194] Registered new tserver with Master: f0bf65b4b4c44343988cfd718fac0102 (127.8.208.193:44791)
I20260807 08:40:11.379580 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:45763
--builtin_ntp_servers=127.8.208.212:42213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 08:40:11.483337 14271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:11.483543 14271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:11.483577 14271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:11.487251 14271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:11.487293 14271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:11.487337 14271 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:40:11.491354 14271 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:42213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:45763
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14271
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:11.492231 14271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:11.493432 14271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:11.501695 14276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:11.501765 14277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:11.501855 14279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:11.501736 14271 server_base.cc:1034] running on GCE node
I20260807 08:40:11.502255 14271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:11.502786 14271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:11.504035 14271 hybrid_clock.cc:648] HybridClock initialized: now 1786092011504026 us; error 26 us; skew 500 ppm
I20260807 08:40:11.505915 14271 webserver.cc:460] Webserver started at http://127.8.208.194:46003/ using document root <none> and password file <none>
I20260807 08:40:11.506464 14271 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:11.506553 14271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:11.506779 14271 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:11.508606 14271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "dc0ec69c733c4c4b9fa021062c944c11"
format_stamp: "Formatted at 2026-08-07 08:40:11 on dist-test-slave-6nmv"
server_key: "1a30bbc16434595b8f33714a41e540ff"
server_key_iv: "da6b54fcd7e5473de35eb7e14817b128"
server_key_version: "encryptionkey@0"
I20260807 08:40:11.509148 14271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "dc0ec69c733c4c4b9fa021062c944c11"
format_stamp: "Formatted at 2026-08-07 08:40:11 on dist-test-slave-6nmv"
server_key: "1a30bbc16434595b8f33714a41e540ff"
server_key_iv: "da6b54fcd7e5473de35eb7e14817b128"
server_key_version: "encryptionkey@0"
I20260807 08:40:11.512424 14271 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 08:40:11.514659 14286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:11.515889 14271 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:40:11.516047 14271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "dc0ec69c733c4c4b9fa021062c944c11"
format_stamp: "Formatted at 2026-08-07 08:40:11 on dist-test-slave-6nmv"
server_key: "1a30bbc16434595b8f33714a41e540ff"
server_key_iv: "da6b54fcd7e5473de35eb7e14817b128"
server_key_version: "encryptionkey@0"
I20260807 08:40:11.516179 14271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:11.520227 14271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:11.520726 14271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:11.520903 14271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:11.521359 14271 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:11.522183 14271 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:11.522253 14271 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:11.522308 14271 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:11.522344 14271 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:11.530371 14271 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:41759
I20260807 08:40:11.530442 14406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:41759 every 8 connection(s)
I20260807 08:40:11.531183 14271 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:40:11.535280 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 14271
I20260807 08:40:11.535437 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:40:11.535704 9027 external_mini_cluster.cc:1428] Setting key 301a91eb4e1e7371a5195b606bcf6ad5
I20260807 08:40:11.536906 14111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:11.532790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:59493 (local address 127.8.208.254:45763)
0807 08:40:11.532947 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:11.532951 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:11.533837 (+ 886us) server_negotiation.cc:407] Connection header received
0807 08:40:11.535068 (+ 1231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:11.535072 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:11.535123 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:11.535232 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:11.536497 (+ 1265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:11.536500 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:11.536503 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:40:11.536515 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:11.536537 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:40:11.536546 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:11.536631 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:11.536748 (+ 117us) server_negotiation.cc:299] Negotiation successful
0807 08:40:11.536784 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 08:40:11.537719 14409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:11.533095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:45763 (local address 127.8.208.194:59493)
0807 08:40:11.533667 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:11.533701 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:11.534843 (+ 1142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:11.535416 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:11.535426 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:11.535554 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:11.536221 (+ 667us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 08:40:11.536223 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:11.536273 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 08:40:11.536351 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:11.536629 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:11.536635 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:11.536638 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 08:40:11.536759 (+ 121us) client_negotiation.cc:240] Negotiation successful
0807 08:40:11.536962 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":108,"threads_started":1}
I20260807 08:40:11.537750 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:45763
--builtin_ntp_servers=127.8.208.212:42213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260807 08:40:11.538745 14407 heartbeater.cc:347] Connected to a master server at 127.8.208.254:45763
I20260807 08:40:11.538973 14407 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:11.539304 14407 heartbeater.cc:511] Master 127.8.208.254:45763 requested a full tablet report, sending...
I20260807 08:40:11.540176 14067 ts_manager.cc:194] Registered new tserver with Master: dc0ec69c733c4c4b9fa021062c944c11 (127.8.208.194:41759)
W20260807 08:40:11.638773 14410 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:11.638983 14410 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:11.639016 14410 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:11.642683 14410 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:11.642727 14410 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:11.642776 14410 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:40:11.647411 14410 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:42213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:45763
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14410
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:11.648228 14410 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:11.649420 14410 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 08:40:11.658732 14410 server_base.cc:1034] running on GCE node
W20260807 08:40:11.658702 14419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:11.658676 14415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:11.658685 14417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:11.659361 14410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:11.659934 14410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:11.661111 14410 hybrid_clock.cc:648] HybridClock initialized: now 1786092011661084 us; error 30 us; skew 500 ppm
I20260807 08:40:11.662882 14410 webserver.cc:460] Webserver started at http://127.8.208.195:34149/ using document root <none> and password file <none>
I20260807 08:40:11.663439 14410 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:11.663496 14410 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:11.663724 14410 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:11.665570 14410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "ff07d9c03eb54094ac2c9fc902f35caf"
format_stamp: "Formatted at 2026-08-07 08:40:11 on dist-test-slave-6nmv"
server_key: "e95d51ef4031a5cde7b0cf310d7b68dc"
server_key_iv: "7ff1c873d643c18c5546c0977c3a5d0c"
server_key_version: "encryptionkey@0"
I20260807 08:40:11.666179 14410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "ff07d9c03eb54094ac2c9fc902f35caf"
format_stamp: "Formatted at 2026-08-07 08:40:11 on dist-test-slave-6nmv"
server_key: "e95d51ef4031a5cde7b0cf310d7b68dc"
server_key_iv: "7ff1c873d643c18c5546c0977c3a5d0c"
server_key_version: "encryptionkey@0"
I20260807 08:40:11.669950 14410 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 08:40:11.672175 14425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:11.673391 14410 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:11.673480 14410 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "ff07d9c03eb54094ac2c9fc902f35caf"
format_stamp: "Formatted at 2026-08-07 08:40:11 on dist-test-slave-6nmv"
server_key: "e95d51ef4031a5cde7b0cf310d7b68dc"
server_key_iv: "7ff1c873d643c18c5546c0977c3a5d0c"
server_key_version: "encryptionkey@0"
I20260807 08:40:11.673557 14410 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:11.677585 14410 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:11.678156 14410 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:11.678282 14410 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:11.678714 14410 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:11.679454 14410 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:11.679495 14410 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:11.679533 14410 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:11.679570 14410 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:11.687696 14410 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:39403
I20260807 08:40:11.687739 14545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:39403 every 8 connection(s)
I20260807 08:40:11.688545 14410 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:40:11.693797 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 14410
I20260807 08:40:11.693946 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:40:11.694133 14111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:11.690261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:46633 (local address 127.8.208.254:45763)
0807 08:40:11.690393 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:11.690397 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:11.691324 (+ 927us) server_negotiation.cc:407] Connection header received
0807 08:40:11.692544 (+ 1220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:11.692547 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:11.692585 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:11.692670 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:11.693659 (+ 989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:11.693661 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:11.693663 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:40:11.693672 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:11.693690 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:40:11.693697 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:11.693769 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:11.693978 (+ 209us) server_negotiation.cc:299] Negotiation successful
0807 08:40:11.694026 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 08:40:11.694221 9027 external_mini_cluster.cc:1428] Setting key c3777bc56a1b8fe7cd9ae51b275142f6
I20260807 08:40:11.695070 14549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:11.690609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:45763 (local address 127.8.208.195:46633)
0807 08:40:11.691186 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:11.691221 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:11.692326 (+ 1105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:11.692802 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:11.692807 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:11.692893 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:11.693386 (+ 493us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 08:40:11.693388 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:11.693431 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 08:40:11.693492 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:11.693780 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:11.693790 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:11.693795 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 08:40:11.693990 (+ 195us) client_negotiation.cc:240] Negotiation successful
0807 08:40:11.694198 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":108,"threads_started":1}
I20260807 08:40:11.696295 14547 heartbeater.cc:347] Connected to a master server at 127.8.208.254:45763
I20260807 08:40:11.696524 14547 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:11.696903 14547 heartbeater.cc:511] Master 127.8.208.254:45763 requested a full tablet report, sending...
I20260807 08:40:11.697845 14067 ts_manager.cc:194] Registered new tserver with Master: ff07d9c03eb54094ac2c9fc902f35caf (127.8.208.195:39403)
I20260807 08:40:11.707716 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 08:40:11.710877 14111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:11.709433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45058 (local address 127.8.208.254:45763)
0807 08:40:11.709553 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:11.709556 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:11.709738 (+ 182us) server_negotiation.cc:407] Connection header received
0807 08:40:11.709878 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:11.709881 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:11.709932 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:11.709995 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:11.710657 (+ 662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:11.710659 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:11.710660 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:40:11.710667 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:11.710679 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:40:11.710685 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:11.710741 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:11.710778 (+ 37us) server_negotiation.cc:299] Negotiation successful
0807 08:40:11.710804 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 08:40:11.713372 14067 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45058:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 08:40:11.716238 14067 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:40:11.726738 14560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:11.723919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:44791 (local address 127.0.0.1:34716)
0807 08:40:11.725026 (+ 1107us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:11.725041 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:11.725137 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:11.725585 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:11.725588 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:11.725603 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:11.726017 (+ 414us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 08:40:11.726019 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:11.726027 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 08:40:11.726042 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:11.726423 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:11.726433 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:11.726438 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 08:40:11.726558 (+ 120us) client_negotiation.cc:240] Negotiation successful
0807 08:40:11.726621 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1042,"thread_start_us":81,"threads_started":1}
I20260807 08:40:11.726795 14561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:11.724104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34716 (local address 127.8.208.193:44791)
0807 08:40:11.724434 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:11.724445 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:11.725134 (+ 689us) server_negotiation.cc:407] Connection header received
0807 08:40:11.725230 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:11.725236 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:11.725417 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:11.725603 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:11.726275 (+ 672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:11.726278 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:11.726286 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:40:11.726293 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:11.726320 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:40:11.726333 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:11.726445 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:11.726582 (+ 137us) server_negotiation.cc:299] Negotiation successful
0807 08:40:11.726649 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":142,"threads_started":1}
I20260807 08:40:11.727399 14558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:11.723671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:41759 (local address 127.0.0.1:54138)
0807 08:40:11.724356 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:11.724556 (+ 200us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:11.724656 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:11.725221 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:11.725227 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:11.725300 (+ 73us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:11.725840 (+ 540us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 08:40:11.725842 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:11.725863 (+ 21us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 08:40:11.725964 (+ 101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:11.727154 (+ 1190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:11.727158 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:11.727162 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 08:40:11.727246 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 08:40:11.727281 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":63,"threads_started":1}
I20260807 08:40:11.727849 14559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:11.723807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54138 (local address 127.8.208.194:41759)
0807 08:40:11.724546 (+ 739us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:11.724560 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:11.724766 (+ 206us) server_negotiation.cc:407] Connection header received
0807 08:40:11.724827 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:11.724839 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:11.725072 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:11.725228 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:11.726438 (+ 1210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:11.726443 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:11.726453 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:40:11.726463 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:11.726500 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:40:11.726529 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:11.726652 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:11.727620 (+ 968us) server_negotiation.cc:299] Negotiation successful
0807 08:40:11.727687 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":650,"thread_start_us":124,"threads_started":1}
I20260807 08:40:11.727778 14562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:11.724312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:39403 (local address 127.0.0.1:54342)
0807 08:40:11.725361 (+ 1049us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:11.725375 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:11.725464 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:11.726535 (+ 1071us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:11.726538 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:11.726556 (+ 18us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:11.727140 (+ 584us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 08:40:11.727144 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:11.727156 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 08:40:11.727180 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:11.727554 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:11.727557 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:11.727560 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 08:40:11.727632 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 08:40:11.727665 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":971,"thread_start_us":98,"threads_started":1}
I20260807 08:40:11.728111 14563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:11.724642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54342 (local address 127.8.208.195:39403)
0807 08:40:11.725051 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:11.725065 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:11.725569 (+ 504us) server_negotiation.cc:407] Connection header received
0807 08:40:11.725624 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:11.725632 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:11.725799 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:11.725962 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:11.727303 (+ 1341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:11.727308 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:11.727318 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:40:11.727329 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:11.727366 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:40:11.727408 (+ 42us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:11.727513 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:11.727863 (+ 350us) server_negotiation.cc:299] Negotiation successful
0807 08:40:11.727931 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":98,"threads_started":1}
I20260807 08:40:11.729689 14198 tablet_service.cc:1467] Processing CreateTablet for tablet a559b589448d4e33ae3a7e6571e76dfe (DEFAULT_TABLE table=test-table [id=bf0832fc917c4407bd81521bdab3a73e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:11.730268 14336 tablet_service.cc:1467] Processing CreateTablet for tablet a559b589448d4e33ae3a7e6571e76dfe (DEFAULT_TABLE table=test-table [id=bf0832fc917c4407bd81521bdab3a73e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:11.730795 14198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a559b589448d4e33ae3a7e6571e76dfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:11.730890 14477 tablet_service.cc:1467] Processing CreateTablet for tablet a559b589448d4e33ae3a7e6571e76dfe (DEFAULT_TABLE table=test-table [id=bf0832fc917c4407bd81521bdab3a73e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:11.731374 14336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a559b589448d4e33ae3a7e6571e76dfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:11.731769 14477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a559b589448d4e33ae3a7e6571e76dfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:11.737576 14564 tablet_bootstrap.cc:492] T a559b589448d4e33ae3a7e6571e76dfe P dc0ec69c733c4c4b9fa021062c944c11: Bootstrap starting.
I20260807 08:40:11.738612 14565 tablet_bootstrap.cc:492] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102: Bootstrap starting.
I20260807 08:40:11.739761 14564 tablet_bootstrap.cc:654] T a559b589448d4e33ae3a7e6571e76dfe P dc0ec69c733c4c4b9fa021062c944c11: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:11.740370 14565 tablet_bootstrap.cc:654] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:11.740440 14564 log.cc:824] T a559b589448d4e33ae3a7e6571e76dfe P dc0ec69c733c4c4b9fa021062c944c11: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:11.741000 14565 log.cc:824] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:11.741503 14566 tablet_bootstrap.cc:492] T a559b589448d4e33ae3a7e6571e76dfe P ff07d9c03eb54094ac2c9fc902f35caf: Bootstrap starting.
I20260807 08:40:11.742229 14564 tablet_bootstrap.cc:492] T a559b589448d4e33ae3a7e6571e76dfe P dc0ec69c733c4c4b9fa021062c944c11: No bootstrap required, opened a new log
I20260807 08:40:11.742450 14564 ts_tablet_manager.cc:1397] T a559b589448d4e33ae3a7e6571e76dfe P dc0ec69c733c4c4b9fa021062c944c11: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 08:40:11.742976 14565 tablet_bootstrap.cc:492] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102: No bootstrap required, opened a new log
I20260807 08:40:11.743136 14565 ts_tablet_manager.cc:1397] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 08:40:11.743371 14566 tablet_bootstrap.cc:654] T a559b589448d4e33ae3a7e6571e76dfe P ff07d9c03eb54094ac2c9fc902f35caf: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:11.744103 14566 log.cc:824] T a559b589448d4e33ae3a7e6571e76dfe P ff07d9c03eb54094ac2c9fc902f35caf: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:11.746433 14564 raft_consensus.cc:348] T a559b589448d4e33ae3a7e6571e76dfe P dc0ec69c733c4c4b9fa021062c944c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0ec69c733c4c4b9fa021062c944c11" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 41759 } } peers { permanent_uuid: "ff07d9c03eb54094ac2c9fc902f35caf" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 39403 } } peers { permanent_uuid: "f0bf65b4b4c44343988cfd718fac0102" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 44791 } }
I20260807 08:40:11.746675 14564 raft_consensus.cc:374] T a559b589448d4e33ae3a7e6571e76dfe P dc0ec69c733c4c4b9fa021062c944c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:11.746799 14564 raft_consensus.cc:729] T a559b589448d4e33ae3a7e6571e76dfe P dc0ec69c733c4c4b9fa021062c944c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc0ec69c733c4c4b9fa021062c944c11, State: Initialized, Role: FOLLOWER
I20260807 08:40:11.747020 14565 raft_consensus.cc:348] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0ec69c733c4c4b9fa021062c944c11" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 41759 } } peers { permanent_uuid: "ff07d9c03eb54094ac2c9fc902f35caf" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 39403 } } peers { permanent_uuid: "f0bf65b4b4c44343988cfd718fac0102" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 44791 } }
I20260807 08:40:11.747255 14565 raft_consensus.cc:374] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:11.747315 14565 raft_consensus.cc:729] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0bf65b4b4c44343988cfd718fac0102, State: Initialized, Role: FOLLOWER
I20260807 08:40:11.747248 14564 consensus_queue.cc:260] T a559b589448d4e33ae3a7e6571e76dfe P dc0ec69c733c4c4b9fa021062c944c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0ec69c733c4c4b9fa021062c944c11" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 41759 } } peers { permanent_uuid: "ff07d9c03eb54094ac2c9fc902f35caf" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 39403 } } peers { permanent_uuid: "f0bf65b4b4c44343988cfd718fac0102" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 44791 } }
I20260807 08:40:11.747556 14566 tablet_bootstrap.cc:492] T a559b589448d4e33ae3a7e6571e76dfe P ff07d9c03eb54094ac2c9fc902f35caf: No bootstrap required, opened a new log
I20260807 08:40:11.747731 14566 ts_tablet_manager.cc:1397] T a559b589448d4e33ae3a7e6571e76dfe P ff07d9c03eb54094ac2c9fc902f35caf: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 08:40:11.747737 14565 consensus_queue.cc:260] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0ec69c733c4c4b9fa021062c944c11" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 41759 } } peers { permanent_uuid: "ff07d9c03eb54094ac2c9fc902f35caf" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 39403 } } peers { permanent_uuid: "f0bf65b4b4c44343988cfd718fac0102" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 44791 } }
I20260807 08:40:11.747897 14407 heartbeater.cc:503] Master 127.8.208.254:45763 was elected leader, sending a full tablet report...
I20260807 08:40:11.748248 14564 ts_tablet_manager.cc:1428] T a559b589448d4e33ae3a7e6571e76dfe P dc0ec69c733c4c4b9fa021062c944c11: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 08:40:11.748605 14565 ts_tablet_manager.cc:1428] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 08:40:11.748881 14268 heartbeater.cc:503] Master 127.8.208.254:45763 was elected leader, sending a full tablet report...
I20260807 08:40:11.751828 14566 raft_consensus.cc:348] T a559b589448d4e33ae3a7e6571e76dfe P ff07d9c03eb54094ac2c9fc902f35caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0ec69c733c4c4b9fa021062c944c11" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 41759 } } peers { permanent_uuid: "ff07d9c03eb54094ac2c9fc902f35caf" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 39403 } } peers { permanent_uuid: "f0bf65b4b4c44343988cfd718fac0102" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 44791 } }
I20260807 08:40:11.752197 14566 raft_consensus.cc:374] T a559b589448d4e33ae3a7e6571e76dfe P ff07d9c03eb54094ac2c9fc902f35caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:11.752280 14566 raft_consensus.cc:729] T a559b589448d4e33ae3a7e6571e76dfe P ff07d9c03eb54094ac2c9fc902f35caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff07d9c03eb54094ac2c9fc902f35caf, State: Initialized, Role: FOLLOWER
I20260807 08:40:11.752678 14566 consensus_queue.cc:260] T a559b589448d4e33ae3a7e6571e76dfe P ff07d9c03eb54094ac2c9fc902f35caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0ec69c733c4c4b9fa021062c944c11" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 41759 } } peers { permanent_uuid: "ff07d9c03eb54094ac2c9fc902f35caf" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 39403 } } peers { permanent_uuid: "f0bf65b4b4c44343988cfd718fac0102" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 44791 } }
I20260807 08:40:11.753237 14547 heartbeater.cc:503] Master 127.8.208.254:45763 was elected leader, sending a full tablet report...
I20260807 08:40:11.753509 14566 ts_tablet_manager.cc:1428] T a559b589448d4e33ae3a7e6571e76dfe P ff07d9c03eb54094ac2c9fc902f35caf: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20260807 08:40:11.782105 14408 tablet.cc:2369] T a559b589448d4e33ae3a7e6571e76dfe P dc0ec69c733c4c4b9fa021062c944c11: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 08:40:11.868743 14269 tablet.cc:2369] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 08:40:11.893600 14572 raft_consensus.cc:482] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:40:11.893858 14572 raft_consensus.cc:504] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0ec69c733c4c4b9fa021062c944c11" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 41759 } } peers { permanent_uuid: "ff07d9c03eb54094ac2c9fc902f35caf" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 39403 } } peers { permanent_uuid: "f0bf65b4b4c44343988cfd718fac0102" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 44791 } }
I20260807 08:40:11.895046 14572 leader_election.cc:288] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc0ec69c733c4c4b9fa021062c944c11 (127.8.208.194:41759), ff07d9c03eb54094ac2c9fc902f35caf (127.8.208.195:39403)
I20260807 08:40:11.897285 14559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:11.895446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:37877 (local address 127.8.208.194:41759)
0807 08:40:11.895606 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:11.895611 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:11.895742 (+ 131us) server_negotiation.cc:407] Connection header received
0807 08:40:11.895917 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:11.895921 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:11.895966 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:11.896068 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:11.896898 (+ 830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:11.896901 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:11.896903 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:40:11.896917 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:11.896939 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:40:11.896948 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:11.897036 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:11.897119 (+ 83us) server_negotiation.cc:299] Negotiation successful
0807 08:40:11.897160 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 08:40:11.897286 14563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:11.895890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:56081 (local address 127.8.208.195:39403)
0807 08:40:11.896071 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:11.896076 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:11.896138 (+ 62us) server_negotiation.cc:407] Connection header received
0807 08:40:11.896247 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:11.896249 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:11.896277 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:11.896465 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:11.896965 (+ 500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:11.896970 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:11.896975 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:40:11.896988 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:11.897009 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:40:11.897018 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:11.897095 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:11.897163 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 08:40:11.897196 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 08:40:11.897321 14574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:11.895346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:41759 (local address 127.8.208.193:37877)
0807 08:40:11.895638 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:11.895652 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:11.895786 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:11.896120 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:11.896126 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:11.896140 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:11.896706 (+ 566us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 08:40:11.896708 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:11.896716 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 08:40:11.896760 (+ 44us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:11.897025 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:11.897027 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:11.897029 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 08:40:11.897110 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 08:40:11.897150 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":92,"threads_started":1}
I20260807 08:40:11.897324 14575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:11.895738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:39403 (local address 127.8.208.193:56081)
0807 08:40:11.896058 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:11.896071 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:11.896151 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:11.896496 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:11.896498 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:11.896509 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:11.896798 (+ 289us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 08:40:11.896802 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:11.896811 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 08:40:11.896832 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:11.897090 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:11.897093 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:11.897096 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 08:40:11.897152 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 08:40:11.897172 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":93,"threads_started":1}
I20260807 08:40:11.898005 14356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a559b589448d4e33ae3a7e6571e76dfe" candidate_uuid: "f0bf65b4b4c44343988cfd718fac0102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc0ec69c733c4c4b9fa021062c944c11" is_pre_election: true
I20260807 08:40:11.898051 14497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a559b589448d4e33ae3a7e6571e76dfe" candidate_uuid: "f0bf65b4b4c44343988cfd718fac0102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff07d9c03eb54094ac2c9fc902f35caf" is_pre_election: true
I20260807 08:40:11.898273 14356 raft_consensus.cc:2454] T a559b589448d4e33ae3a7e6571e76dfe P dc0ec69c733c4c4b9fa021062c944c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0bf65b4b4c44343988cfd718fac0102 in term 0.
I20260807 08:40:11.898301 14497 raft_consensus.cc:2454] T a559b589448d4e33ae3a7e6571e76dfe P ff07d9c03eb54094ac2c9fc902f35caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0bf65b4b4c44343988cfd718fac0102 in term 0.
I20260807 08:40:11.898728 14149 leader_election.cc:302] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0bf65b4b4c44343988cfd718fac0102, ff07d9c03eb54094ac2c9fc902f35caf; no voters:
I20260807 08:40:11.898981 14572 raft_consensus.cc:2781] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:40:11.899052 14572 raft_consensus.cc:482] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:40:11.899077 14572 raft_consensus.cc:3037] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:11.900044 14572 raft_consensus.cc:504] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0ec69c733c4c4b9fa021062c944c11" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 41759 } } peers { permanent_uuid: "ff07d9c03eb54094ac2c9fc902f35caf" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 39403 } } peers { permanent_uuid: "f0bf65b4b4c44343988cfd718fac0102" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 44791 } }
I20260807 08:40:11.900348 14572 leader_election.cc:288] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102 [CANDIDATE]: Term 1 election: Requested vote from peers dc0ec69c733c4c4b9fa021062c944c11 (127.8.208.194:41759), ff07d9c03eb54094ac2c9fc902f35caf (127.8.208.195:39403)
I20260807 08:40:11.900657 14356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a559b589448d4e33ae3a7e6571e76dfe" candidate_uuid: "f0bf65b4b4c44343988cfd718fac0102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc0ec69c733c4c4b9fa021062c944c11"
I20260807 08:40:11.900732 14497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a559b589448d4e33ae3a7e6571e76dfe" candidate_uuid: "f0bf65b4b4c44343988cfd718fac0102" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff07d9c03eb54094ac2c9fc902f35caf"
I20260807 08:40:11.900777 14356 raft_consensus.cc:3037] T a559b589448d4e33ae3a7e6571e76dfe P dc0ec69c733c4c4b9fa021062c944c11 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:11.900870 14497 raft_consensus.cc:3037] T a559b589448d4e33ae3a7e6571e76dfe P ff07d9c03eb54094ac2c9fc902f35caf [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:11.901758 14356 raft_consensus.cc:2454] T a559b589448d4e33ae3a7e6571e76dfe P dc0ec69c733c4c4b9fa021062c944c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0bf65b4b4c44343988cfd718fac0102 in term 1.
I20260807 08:40:11.901767 14497 raft_consensus.cc:2454] T a559b589448d4e33ae3a7e6571e76dfe P ff07d9c03eb54094ac2c9fc902f35caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0bf65b4b4c44343988cfd718fac0102 in term 1.
I20260807 08:40:11.902065 14149 leader_election.cc:302] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f0bf65b4b4c44343988cfd718fac0102, ff07d9c03eb54094ac2c9fc902f35caf; no voters:
I20260807 08:40:11.902268 14572 raft_consensus.cc:2781] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:11.902493 14572 raft_consensus.cc:686] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102 [term 1 LEADER]: Becoming Leader. State: Replica: f0bf65b4b4c44343988cfd718fac0102, State: Running, Role: LEADER
I20260807 08:40:11.902827 14572 consensus_queue.cc:237] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0ec69c733c4c4b9fa021062c944c11" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 41759 } } peers { permanent_uuid: "ff07d9c03eb54094ac2c9fc902f35caf" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 39403 } } peers { permanent_uuid: "f0bf65b4b4c44343988cfd718fac0102" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 44791 } }
I20260807 08:40:11.906083 14065 catalog_manager.cc:5495] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0bf65b4b4c44343988cfd718fac0102 (127.8.208.193). New cstate: current_term: 1 leader_uuid: "f0bf65b4b4c44343988cfd718fac0102" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc0ec69c733c4c4b9fa021062c944c11" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 41759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff07d9c03eb54094ac2c9fc902f35caf" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 39403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0bf65b4b4c44343988cfd718fac0102" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 44791 } health_report { overall_health: HEALTHY } } }
W20260807 08:40:11.939487 14548 tablet.cc:2369] T a559b589448d4e33ae3a7e6571e76dfe P ff07d9c03eb54094ac2c9fc902f35caf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 08:40:11.959481 14561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:11.958028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34720 (local address 127.8.208.193:44791)
0807 08:40:11.958170 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:11.958174 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:11.958190 (+ 16us) server_negotiation.cc:407] Connection header received
0807 08:40:11.958314 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:11.958317 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:11.958377 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:11.958449 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:11.959078 (+ 629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:11.959081 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:11.959083 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:40:11.959093 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:11.959130 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:40:11.959138 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:11.959213 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:11.959269 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 08:40:11.959301 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 08:40:11.965020 14497 raft_consensus.cc:1261] T a559b589448d4e33ae3a7e6571e76dfe P ff07d9c03eb54094ac2c9fc902f35caf [term 1 FOLLOWER]: Refusing update from remote peer f0bf65b4b4c44343988cfd718fac0102: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:40:11.965041 14356 raft_consensus.cc:1261] T a559b589448d4e33ae3a7e6571e76dfe P dc0ec69c733c4c4b9fa021062c944c11 [term 1 FOLLOWER]: Refusing update from remote peer f0bf65b4b4c44343988cfd718fac0102: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:40:11.965744 14576 consensus_queue.cc:1035] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff07d9c03eb54094ac2c9fc902f35caf" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 39403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:40:11.965945 14572 consensus_queue.cc:1035] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc0ec69c733c4c4b9fa021062c944c11" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 41759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:40:11.973809 14581 mvcc.cc:205] Tried to move back new op lower bound from 7315832881002131456 to 7315832880756748288. Current Snapshot: MvccSnapshot[applied={T|T < 7315832881002131456}]
I20260807 08:40:11.974056 14580 mvcc.cc:205] Tried to move back new op lower bound from 7315832881002131456 to 7315832880756748288. Current Snapshot: MvccSnapshot[applied={T|T < 7315832881002131456}]
I20260807 08:40:11.980446 14065 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45058:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:40:11.980589 14065 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45058:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:40:11.982719 14065 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8a86a7d79918410b8dd113afc0bb9cbe: Sending DeleteTablet for 3 replicas of tablet a559b589448d4e33ae3a7e6571e76dfe
I20260807 08:40:11.983382 14198 tablet_service.cc:1514] Processing DeleteTablet for tablet a559b589448d4e33ae3a7e6571e76dfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:11 UTC) from {username='slave'} at 127.0.0.1:34716
I20260807 08:40:11.983423 14336 tablet_service.cc:1514] Processing DeleteTablet for tablet a559b589448d4e33ae3a7e6571e76dfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:11 UTC) from {username='slave'} at 127.0.0.1:54138
I20260807 08:40:11.983714 14477 tablet_service.cc:1514] Processing DeleteTablet for tablet a559b589448d4e33ae3a7e6571e76dfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:11 UTC) from {username='slave'} at 127.0.0.1:54342
I20260807 08:40:11.983795 14589 tablet_replica.cc:330] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102: stopping tablet replica
I20260807 08:40:11.983837 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 14133
I20260807 08:40:11.984072 14589 raft_consensus.cc:2229] T a559b589448d4e33ae3a7e6571e76dfe P f0bf65b4b4c44343988cfd718fac0102 [term 1 LEADER]: Raft consensus shutting down.
I20260807 08:40:11.986294 14591 tablet_replica.cc:330] T a559b589448d4e33ae3a7e6571e76dfe P ff07d9c03eb54094ac2c9fc902f35caf: stopping tablet replica
I20260807 08:40:11.986558 14591 raft_consensus.cc:2229] T a559b589448d4e33ae3a7e6571e76dfe P ff07d9c03eb54094ac2c9fc902f35caf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:40:11.986799 14591 raft_consensus.cc:2258] T a559b589448d4e33ae3a7e6571e76dfe P ff07d9c03eb54094ac2c9fc902f35caf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:11.987128 14590 tablet_replica.cc:330] T a559b589448d4e33ae3a7e6571e76dfe P dc0ec69c733c4c4b9fa021062c944c11: stopping tablet replica
I20260807 08:40:11.987413 14590 raft_consensus.cc:2229] T a559b589448d4e33ae3a7e6571e76dfe P dc0ec69c733c4c4b9fa021062c944c11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:40:11.987720 14590 raft_consensus.cc:2258] T a559b589448d4e33ae3a7e6571e76dfe P dc0ec69c733c4c4b9fa021062c944c11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:11.988162 14591 ts_tablet_manager.cc:1905] T a559b589448d4e33ae3a7e6571e76dfe P ff07d9c03eb54094ac2c9fc902f35caf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:11.989068 14590 ts_tablet_manager.cc:1905] T a559b589448d4e33ae3a7e6571e76dfe P dc0ec69c733c4c4b9fa021062c944c11: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:11.990932 14591 ts_tablet_manager.cc:1918] T a559b589448d4e33ae3a7e6571e76dfe P ff07d9c03eb54094ac2c9fc902f35caf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:40:11.991022 14591 log.cc:1196] T a559b589448d4e33ae3a7e6571e76dfe P ff07d9c03eb54094ac2c9fc902f35caf: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/a559b589448d4e33ae3a7e6571e76dfe
I20260807 08:40:11.991329 14591 ts_tablet_manager.cc:1939] T a559b589448d4e33ae3a7e6571e76dfe P ff07d9c03eb54094ac2c9fc902f35caf: Deleting consensus metadata
W20260807 08:40:11.991752 14054 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.208.193:44791 (error 108)
I20260807 08:40:11.991997 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 14271
I20260807 08:40:11.992434 14590 ts_tablet_manager.cc:1918] T a559b589448d4e33ae3a7e6571e76dfe P dc0ec69c733c4c4b9fa021062c944c11: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:40:11.992806 14558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:11.992463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:44791 (local address 127.0.0.1:34726)
0807 08:40:11.992642 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:11.992711 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.193:44791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
W20260807 08:40:11.992985 14054 catalog_manager.cc:4584] TS f0bf65b4b4c44343988cfd718fac0102 (127.8.208.193:44791): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a559b589448d4e33ae3a7e6571e76dfe: Network error: Client connection negotiation failed: client connection to 127.8.208.193:44791: connect: Connection refused (error 111)
I20260807 08:40:11.995340 14051 catalog_manager.cc:4841] TS ff07d9c03eb54094ac2c9fc902f35caf (127.8.208.195:39403): tablet a559b589448d4e33ae3a7e6571e76dfe (table test-table [id=bf0832fc917c4407bd81521bdab3a73e]) successfully deleted
I20260807 08:40:11.999249 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 14410
I20260807 08:40:11.999616 14558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:11.999285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:41759 (local address 127.0.0.1:54142)
0807 08:40:11.999489 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:11.999539 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.194:41759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260807 08:40:12.006762 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 14035
2026-08-07T08:40:12Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1045 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260807 08:40:12.029331 9027 mini_oidc.cc:152] Starting JWKS server
I20260807 08:40:12.030987 9027 webserver.cc:460] Webserver started at https://127.0.0.1:41123/ using document root <none> and password file <none>
I20260807 08:40:12.031112 9027 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 08:40:12.031316 9027 webserver.cc:460] Webserver started at http://127.0.0.1:32859/ using document root <none> and password file <none>
2026-08-07T08:40:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:40:12Z Disabled control of system clock
I20260807 08:40:12.039959 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:36191
--webserver_interface=127.8.208.254
--webserver_port=0
--builtin_ntp_servers=127.8.208.212:44901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:36191
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41123/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786091987266300-9027-0/testchainca.cert with env {}
W20260807 08:40:12.140277 14600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:12.140524 14600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:12.140573 14600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:12.144430 14600 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:40:12.144480 14600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:12.144495 14600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:12.144511 14600 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:40:12.144526 14600 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 08:40:12.144542 14600 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 08:40:12.144562 14600 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41123/jwks.json
I20260807 08:40:12.149739 14600 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:44901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:36191
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:36191
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41123/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786091987266300-9027-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14600
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:12.150700 14600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:12.151683 14600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:12.160130 14606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:12.160137 14607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:12.160264 14600 server_base.cc:1034] running on GCE node
W20260807 08:40:12.160137 14609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:12.160979 14600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:12.162052 14600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:12.163213 14600 hybrid_clock.cc:648] HybridClock initialized: now 1786092012163183 us; error 40 us; skew 500 ppm
I20260807 08:40:12.164999 14600 webserver.cc:460] Webserver started at http://127.8.208.254:36415/ using document root <none> and password file <none>
I20260807 08:40:12.165555 14600 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:12.165619 14600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:12.165868 14600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:12.167841 14600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "79e9530cb77b45aeaef3a4d3f1a3eefe"
format_stamp: "Formatted at 2026-08-07 08:40:12 on dist-test-slave-6nmv"
server_key: "b1776d2488a3e148edcb7faa6a9487ec"
server_key_iv: "80ef7d4e89accefef9d578b82cb2c83d"
server_key_version: "encryptionkey@0"
I20260807 08:40:12.168387 14600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "79e9530cb77b45aeaef3a4d3f1a3eefe"
format_stamp: "Formatted at 2026-08-07 08:40:12 on dist-test-slave-6nmv"
server_key: "b1776d2488a3e148edcb7faa6a9487ec"
server_key_iv: "80ef7d4e89accefef9d578b82cb2c83d"
server_key_version: "encryptionkey@0"
I20260807 08:40:12.171988 14600 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 08:40:12.174368 14615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:12.175593 14600 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:40:12.175732 14600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "79e9530cb77b45aeaef3a4d3f1a3eefe"
format_stamp: "Formatted at 2026-08-07 08:40:12 on dist-test-slave-6nmv"
server_key: "b1776d2488a3e148edcb7faa6a9487ec"
server_key_iv: "80ef7d4e89accefef9d578b82cb2c83d"
server_key_version: "encryptionkey@0"
I20260807 08:40:12.175839 14600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:12.199223 14600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:12.199823 14600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:12.200001 14600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:12.206801 14600 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:36191
I20260807 08:40:12.206813 14669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:36191 every 8 connection(s)
I20260807 08:40:12.207672 14600 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:40:12.210265 14670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:12.215044 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 14600
I20260807 08:40:12.215195 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:40:12.215461 9027 external_mini_cluster.cc:1428] Setting key 9b5d470ea289cb62c7e1558040beadc6
I20260807 08:40:12.215637 14670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79e9530cb77b45aeaef3a4d3f1a3eefe: Bootstrap starting.
I20260807 08:40:12.218129 14670 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79e9530cb77b45aeaef3a4d3f1a3eefe: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:12.218837 14670 log.cc:824] T 00000000000000000000000000000000 P 79e9530cb77b45aeaef3a4d3f1a3eefe: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:12.220492 14670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79e9530cb77b45aeaef3a4d3f1a3eefe: No bootstrap required, opened a new log
I20260807 08:40:12.223796 14673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:12.216656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48336 (local address 127.8.208.254:36191)
0807 08:40:12.217262 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:12.217274 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:12.217305 (+ 31us) server_negotiation.cc:407] Connection header received
0807 08:40:12.217954 (+ 649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:12.217971 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:12.218363 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:12.218677 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:12.219093 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:12.219928 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:12.220823 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:12.221275 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:12.221441 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:12.222287 (+ 846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:12.222292 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:12.222310 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:40:12.222670 (+ 360us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:12.222716 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:40:12.222743 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:12.222857 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:12.222963 (+ 106us) server_negotiation.cc:299] Negotiation successful
0807 08:40:12.223186 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":128,"threads_started":1}
I20260807 08:40:12.223794 14670 raft_consensus.cc:348] T 00000000000000000000000000000000 P 79e9530cb77b45aeaef3a4d3f1a3eefe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79e9530cb77b45aeaef3a4d3f1a3eefe" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36191 } }
I20260807 08:40:12.224102 14670 raft_consensus.cc:374] T 00000000000000000000000000000000 P 79e9530cb77b45aeaef3a4d3f1a3eefe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:12.224176 14670 raft_consensus.cc:729] T 00000000000000000000000000000000 P 79e9530cb77b45aeaef3a4d3f1a3eefe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79e9530cb77b45aeaef3a4d3f1a3eefe, State: Initialized, Role: FOLLOWER
I20260807 08:40:12.224598 14670 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79e9530cb77b45aeaef3a4d3f1a3eefe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79e9530cb77b45aeaef3a4d3f1a3eefe" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36191 } }
I20260807 08:40:12.224740 14670 raft_consensus.cc:388] T 00000000000000000000000000000000 P 79e9530cb77b45aeaef3a4d3f1a3eefe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:40:12.224805 14670 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79e9530cb77b45aeaef3a4d3f1a3eefe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:40:12.224898 14670 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79e9530cb77b45aeaef3a4d3f1a3eefe [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:12.225858 14670 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79e9530cb77b45aeaef3a4d3f1a3eefe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79e9530cb77b45aeaef3a4d3f1a3eefe" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36191 } }
I20260807 08:40:12.226210 14670 leader_election.cc:302] T 00000000000000000000000000000000 P 79e9530cb77b45aeaef3a4d3f1a3eefe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 79e9530cb77b45aeaef3a4d3f1a3eefe; no voters:
I20260807 08:40:12.226464 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 08:40:12.226564 14670 leader_election.cc:288] T 00000000000000000000000000000000 P 79e9530cb77b45aeaef3a4d3f1a3eefe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:40:12.226630 14675 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 79e9530cb77b45aeaef3a4d3f1a3eefe [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:12.226807 14675 raft_consensus.cc:686] T 00000000000000000000000000000000 P 79e9530cb77b45aeaef3a4d3f1a3eefe [term 1 LEADER]: Becoming Leader. State: Replica: 79e9530cb77b45aeaef3a4d3f1a3eefe, State: Running, Role: LEADER
I20260807 08:40:12.227135 14675 consensus_queue.cc:237] T 00000000000000000000000000000000 P 79e9530cb77b45aeaef3a4d3f1a3eefe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79e9530cb77b45aeaef3a4d3f1a3eefe" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36191 } }
I20260807 08:40:12.227669 14670 sys_catalog.cc:564] T 00000000000000000000000000000000 P 79e9530cb77b45aeaef3a4d3f1a3eefe [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:40:12.228595 14676 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79e9530cb77b45aeaef3a4d3f1a3eefe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "79e9530cb77b45aeaef3a4d3f1a3eefe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79e9530cb77b45aeaef3a4d3f1a3eefe" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36191 } } }
I20260807 08:40:12.228724 14676 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79e9530cb77b45aeaef3a4d3f1a3eefe [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:12.228941 14676 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79e9530cb77b45aeaef3a4d3f1a3eefe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79e9530cb77b45aeaef3a4d3f1a3eefe. Latest consensus state: current_term: 1 leader_uuid: "79e9530cb77b45aeaef3a4d3f1a3eefe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79e9530cb77b45aeaef3a4d3f1a3eefe" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36191 } } }
I20260807 08:40:12.229012 14676 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79e9530cb77b45aeaef3a4d3f1a3eefe [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:12.229075 14684 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:40:12.231823 14684 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:40:12.236549 14684 catalog_manager.cc:1347] Generated new cluster ID: 739a0a1a8b4e40d9824c6fe65dd898e2
I20260807 08:40:12.236610 14684 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:40:12.249318 14684 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:40:12.250192 14684 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:40:12.254873 14684 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 79e9530cb77b45aeaef3a4d3f1a3eefe: Generated new TSK 0
I20260807 08:40:12.255455 14684 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 08:40:12.285125 14702 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260807 08:40:12.285225 14702 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 08:40:12.285672 14673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:12.263475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48342 (local address 127.8.208.254:36191)
0807 08:40:12.263601 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:12.263605 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:12.263812 (+ 207us) server_negotiation.cc:407] Connection header received
0807 08:40:12.264030 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:12.264033 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:12.264082 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:12.264174 (+ 92us) server_negotiation.cc:226] Negotiated authn=JWT
0807 08:40:12.264460 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:12.264996 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:12.265868 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:12.266133 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:12.266252 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:12.266565 (+ 313us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 08:40:12.285287 (+ 18722us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41123/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 08:40:12.285538 (+ 251us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48342: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41123/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":37}
W20260807 08:40:12.285759 14673 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48342: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41123/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260807 08:40:12.286907 14701 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:12.263421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.0.0.1:48342)
0807 08:40:12.263735 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:12.263746 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:12.263876 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:12.264201 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:12.264204 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:12.264211 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0807 08:40:12.264346 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:12.264351 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:12.265110 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:12.265114 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:12.265735 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:12.265742 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:12.266257 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:12.266261 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:12.266348 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:12.266400 (+ 52us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 08:40:12.285500 (+ 19100us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41123/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 08:40:12.285715 (+ 215us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.8.208.254:36191: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41123/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":108,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.8.208.254:36191: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41123/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260807 08:40:12.287825 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 14600
2026-08-07T08:40:12Z chronyd exiting
I20260807 08:40:12.326911 9027 test_util.cc:175] -----------------------------------------------
I20260807 08:40:12.326982 9027 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786091987266300-9027-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (299 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260807 08:40:12.327977 9027 mini_oidc.cc:152] Starting JWKS server
I20260807 08:40:12.328815 9027 webserver.cc:460] Webserver started at https://127.0.0.1:44613/ using document root <none> and password file <none>
I20260807 08:40:12.328926 9027 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 08:40:12.329209 9027 webserver.cc:460] Webserver started at http://127.0.0.1:40911/ using document root <none> and password file <none>
2026-08-07T08:40:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:40:12Z Disabled control of system clock
I20260807 08:40:12.337888 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:34523
--webserver_interface=127.8.208.254
--webserver_port=0
--builtin_ntp_servers=127.8.208.212:42899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:34523
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44613/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786091987266300-9027-0/testchainca.cert with env {}
W20260807 08:40:12.438486 14708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:12.438688 14708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:12.438720 14708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:12.442230 14708 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:40:12.442273 14708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:12.442287 14708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:12.442301 14708 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:40:12.442315 14708 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 08:40:12.442329 14708 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 08:40:12.442340 14708 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44613/jwks.json
I20260807 08:40:12.447117 14708 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:42899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:34523
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:34523
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44613/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786091987266300-9027-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14708
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:12.447911 14708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:12.448738 14708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:12.456616 14716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:12.456595 14713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:12.456584 14714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:12.456988 14708 server_base.cc:1034] running on GCE node
I20260807 08:40:12.457530 14708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:12.458513 14708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:12.459687 14708 hybrid_clock.cc:648] HybridClock initialized: now 1786092012459680 us; error 28 us; skew 500 ppm
I20260807 08:40:12.461225 14708 webserver.cc:460] Webserver started at http://127.8.208.254:41611/ using document root <none> and password file <none>
I20260807 08:40:12.461750 14708 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:12.461858 14708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:12.462080 14708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:12.463792 14708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "1fe4fbfcc2ac4b3fa07203b8b7323312"
format_stamp: "Formatted at 2026-08-07 08:40:12 on dist-test-slave-6nmv"
server_key: "1735c02535b4db6919f26b9cf1923804"
server_key_iv: "b9fd2d615ef4f304b645a37142808509"
server_key_version: "encryptionkey@0"
I20260807 08:40:12.464280 14708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "1fe4fbfcc2ac4b3fa07203b8b7323312"
format_stamp: "Formatted at 2026-08-07 08:40:12 on dist-test-slave-6nmv"
server_key: "1735c02535b4db6919f26b9cf1923804"
server_key_iv: "b9fd2d615ef4f304b645a37142808509"
server_key_version: "encryptionkey@0"
I20260807 08:40:12.467566 14708 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 08:40:12.469691 14723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:12.470778 14708 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:12.470904 14708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "1fe4fbfcc2ac4b3fa07203b8b7323312"
format_stamp: "Formatted at 2026-08-07 08:40:12 on dist-test-slave-6nmv"
server_key: "1735c02535b4db6919f26b9cf1923804"
server_key_iv: "b9fd2d615ef4f304b645a37142808509"
server_key_version: "encryptionkey@0"
I20260807 08:40:12.470999 14708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:12.484687 14708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:12.485258 14708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:12.485447 14708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:12.491334 14708 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:34523
I20260807 08:40:12.491350 14777 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:34523 every 8 connection(s)
I20260807 08:40:12.492101 14708 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:40:12.492515 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 14708
I20260807 08:40:12.492656 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:40:12.492944 9027 external_mini_cluster.cc:1428] Setting key 3d1fea0f1f9ef14333d841b6dbb8122e
I20260807 08:40:12.495015 14778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:12.499552 14778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fe4fbfcc2ac4b3fa07203b8b7323312: Bootstrap starting.
I20260807 08:40:12.500801 14781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:12.494187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35966 (local address 127.8.208.254:34523)
0807 08:40:12.494722 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:12.494736 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:12.494766 (+ 30us) server_negotiation.cc:407] Connection header received
0807 08:40:12.495422 (+ 656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:12.495439 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:12.495784 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:12.496111 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:12.496469 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:12.497272 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:12.498109 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:12.498499 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:12.498650 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:12.499416 (+ 766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:12.499420 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:12.499430 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:40:12.499772 (+ 342us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:12.499817 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:40:12.499834 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:12.499933 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:12.500051 (+ 118us) server_negotiation.cc:299] Negotiation successful
0807 08:40:12.500261 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":125,"threads_started":1}
I20260807 08:40:12.501446 14778 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1fe4fbfcc2ac4b3fa07203b8b7323312: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:12.502136 14778 log.cc:824] T 00000000000000000000000000000000 P 1fe4fbfcc2ac4b3fa07203b8b7323312: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:12.503299 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 08:40:12.504089 14778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fe4fbfcc2ac4b3fa07203b8b7323312: No bootstrap required, opened a new log
I20260807 08:40:12.507392 14778 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1fe4fbfcc2ac4b3fa07203b8b7323312 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fe4fbfcc2ac4b3fa07203b8b7323312" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 34523 } }
I20260807 08:40:12.507566 14778 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1fe4fbfcc2ac4b3fa07203b8b7323312 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:12.507632 14778 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1fe4fbfcc2ac4b3fa07203b8b7323312 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fe4fbfcc2ac4b3fa07203b8b7323312, State: Initialized, Role: FOLLOWER
I20260807 08:40:12.507968 14778 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1fe4fbfcc2ac4b3fa07203b8b7323312 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fe4fbfcc2ac4b3fa07203b8b7323312" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 34523 } }
I20260807 08:40:12.508090 14778 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1fe4fbfcc2ac4b3fa07203b8b7323312 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:40:12.508150 14778 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1fe4fbfcc2ac4b3fa07203b8b7323312 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:40:12.508234 14778 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1fe4fbfcc2ac4b3fa07203b8b7323312 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:12.509110 14778 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1fe4fbfcc2ac4b3fa07203b8b7323312 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fe4fbfcc2ac4b3fa07203b8b7323312" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 34523 } }
I20260807 08:40:12.509353 14778 leader_election.cc:302] T 00000000000000000000000000000000 P 1fe4fbfcc2ac4b3fa07203b8b7323312 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1fe4fbfcc2ac4b3fa07203b8b7323312; no voters:
I20260807 08:40:12.509562 14778 leader_election.cc:288] T 00000000000000000000000000000000 P 1fe4fbfcc2ac4b3fa07203b8b7323312 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:40:12.509670 14783 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1fe4fbfcc2ac4b3fa07203b8b7323312 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:12.509977 14783 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1fe4fbfcc2ac4b3fa07203b8b7323312 [term 1 LEADER]: Becoming Leader. State: Replica: 1fe4fbfcc2ac4b3fa07203b8b7323312, State: Running, Role: LEADER
I20260807 08:40:12.510233 14783 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1fe4fbfcc2ac4b3fa07203b8b7323312 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fe4fbfcc2ac4b3fa07203b8b7323312" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 34523 } }
I20260807 08:40:12.510665 14778 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1fe4fbfcc2ac4b3fa07203b8b7323312 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:40:12.511633 14785 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fe4fbfcc2ac4b3fa07203b8b7323312 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1fe4fbfcc2ac4b3fa07203b8b7323312. Latest consensus state: current_term: 1 leader_uuid: "1fe4fbfcc2ac4b3fa07203b8b7323312" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fe4fbfcc2ac4b3fa07203b8b7323312" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 34523 } } }
I20260807 08:40:12.511762 14785 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fe4fbfcc2ac4b3fa07203b8b7323312 [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:12.512029 14784 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fe4fbfcc2ac4b3fa07203b8b7323312 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1fe4fbfcc2ac4b3fa07203b8b7323312" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fe4fbfcc2ac4b3fa07203b8b7323312" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 34523 } } }
I20260807 08:40:12.512126 14784 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fe4fbfcc2ac4b3fa07203b8b7323312 [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:12.512861 14792 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:40:12.515453 14792 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:40:12.520453 14792 catalog_manager.cc:1347] Generated new cluster ID: e11715d1ab9b4e7fb51814c48cd11484
I20260807 08:40:12.520526 14792 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:40:12.528892 14792 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:40:12.530019 14792 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:40:12.534066 14792 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1fe4fbfcc2ac4b3fa07203b8b7323312: Generated new TSK 0
I20260807 08:40:12.534665 14792 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 08:40:12.571511 14808 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260807 08:40:12.571587 14808 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 08:40:12.572224 14781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:12.549787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35980 (local address 127.8.208.254:34523)
0807 08:40:12.549939 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:12.549943 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:12.550148 (+ 205us) server_negotiation.cc:407] Connection header received
0807 08:40:12.550290 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:12.550292 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:12.550335 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:12.550421 (+ 86us) server_negotiation.cc:226] Negotiated authn=JWT
0807 08:40:12.550670 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:12.551186 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:12.552408 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:12.552607 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:12.552721 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:12.553050 (+ 329us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 08:40:12.571837 (+ 18787us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44613/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 08:40:12.572087 (+ 250us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35980: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44613/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":64}
W20260807 08:40:12.572263 14807 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:12.549729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:34523 (local address 127.0.0.1:35980)
0807 08:40:12.550057 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:12.550071 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:12.550181 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:12.550443 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:12.550446 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:12.550454 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0807 08:40:12.550565 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:12.550571 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:12.551300 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:12.551304 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:12.552288 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:12.552298 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:12.552731 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:12.552736 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:12.552859 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:12.552885 (+ 26us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 08:40:12.572006 (+ 19121us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44613/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 08:40:12.572131 (+ 125us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.8.208.254:34523: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44613/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":136,"threads_started":1}
W20260807 08:40:12.572289 14781 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35980: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44613/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260807 08:40:12.572806 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 14708
2026-08-07T08:40:12Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (286 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260807 08:40:12.614339 9027 mini_oidc.cc:152] Starting JWKS server
I20260807 08:40:12.615091 9027 webserver.cc:460] Webserver started at https://127.0.0.1:45889/ using document root <none> and password file <none>
I20260807 08:40:12.615203 9027 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 08:40:12.615481 9027 webserver.cc:460] Webserver started at http://127.0.0.1:36711/ using document root <none> and password file <none>
2026-08-07T08:40:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:40:12Z Disabled control of system clock
I20260807 08:40:12.624452 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:33925
--webserver_interface=127.8.208.254
--webserver_port=0
--builtin_ntp_servers=127.8.208.212:38119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:33925
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45889/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 08:40:12.724663 14815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:12.724865 14815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:12.724959 14815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:12.728628 14815 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:40:12.728672 14815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:12.728685 14815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:12.728699 14815 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:40:12.728713 14815 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 08:40:12.728727 14815 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 08:40:12.728740 14815 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45889/jwks.json
I20260807 08:40:12.732816 14815 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:38119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:33925
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:33925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45889/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14815
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:12.733664 14815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:12.734827 14815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:12.742245 14823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:12.742267 14821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:12.742255 14820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:12.742584 14815 server_base.cc:1034] running on GCE node
I20260807 08:40:12.743058 14815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:12.743865 14815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:12.745085 14815 hybrid_clock.cc:648] HybridClock initialized: now 1786092012745056 us; error 36 us; skew 500 ppm
I20260807 08:40:12.746991 14815 webserver.cc:460] Webserver started at http://127.8.208.254:33647/ using document root <none> and password file <none>
I20260807 08:40:12.747495 14815 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:12.747558 14815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:12.747771 14815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:12.749644 14815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "50827d183d73495eb3a618b3b374e2f6"
format_stamp: "Formatted at 2026-08-07 08:40:12 on dist-test-slave-6nmv"
server_key: "fcc8730a98dc9f608d5e58f6baecc84c"
server_key_iv: "576c2d052bbfc2b2b984b94937f92441"
server_key_version: "encryptionkey@0"
I20260807 08:40:12.750221 14815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "50827d183d73495eb3a618b3b374e2f6"
format_stamp: "Formatted at 2026-08-07 08:40:12 on dist-test-slave-6nmv"
server_key: "fcc8730a98dc9f608d5e58f6baecc84c"
server_key_iv: "576c2d052bbfc2b2b984b94937f92441"
server_key_version: "encryptionkey@0"
I20260807 08:40:12.753633 14815 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 08:40:12.755847 14829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:12.756923 14815 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:12.757045 14815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "50827d183d73495eb3a618b3b374e2f6"
format_stamp: "Formatted at 2026-08-07 08:40:12 on dist-test-slave-6nmv"
server_key: "fcc8730a98dc9f608d5e58f6baecc84c"
server_key_iv: "576c2d052bbfc2b2b984b94937f92441"
server_key_version: "encryptionkey@0"
I20260807 08:40:12.757138 14815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:12.773993 14815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:12.774507 14815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:12.774712 14815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:12.781224 14815 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:33925
I20260807 08:40:12.781256 14886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:33925 every 8 connection(s)
I20260807 08:40:12.782094 14815 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:40:12.784592 14887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:12.789155 14887 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50827d183d73495eb3a618b3b374e2f6: Bootstrap starting.
I20260807 08:40:12.789446 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 14815
I20260807 08:40:12.789579 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:40:12.789985 9027 external_mini_cluster.cc:1428] Setting key d6e25920b2f6b54aa77472dc90c6e266
I20260807 08:40:12.791520 14887 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 50827d183d73495eb3a618b3b374e2f6: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:12.792229 14887 log.cc:824] T 00000000000000000000000000000000 P 50827d183d73495eb3a618b3b374e2f6: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:12.794106 14887 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50827d183d73495eb3a618b3b374e2f6: No bootstrap required, opened a new log
I20260807 08:40:12.797966 14887 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50827d183d73495eb3a618b3b374e2f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50827d183d73495eb3a618b3b374e2f6" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33925 } }
I20260807 08:40:12.798157 14887 raft_consensus.cc:374] T 00000000000000000000000000000000 P 50827d183d73495eb3a618b3b374e2f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:12.798224 14887 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50827d183d73495eb3a618b3b374e2f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50827d183d73495eb3a618b3b374e2f6, State: Initialized, Role: FOLLOWER
I20260807 08:40:12.798390 14891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:12.791101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48506 (local address 127.8.208.254:33925)
0807 08:40:12.791662 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:12.791680 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:12.791738 (+ 58us) server_negotiation.cc:407] Connection header received
0807 08:40:12.792281 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:12.792296 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:12.792773 (+ 477us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:12.793076 (+ 303us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:12.793341 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:12.794292 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:12.795381 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:12.795863 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:12.795978 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:12.796768 (+ 790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:12.796785 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:12.796795 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:40:12.797114 (+ 319us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:12.797161 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:40:12.797177 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:12.797245 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:12.797407 (+ 162us) server_negotiation.cc:299] Negotiation successful
0807 08:40:12.797645 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":114,"threads_started":1}
I20260807 08:40:12.798651 14887 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50827d183d73495eb3a618b3b374e2f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50827d183d73495eb3a618b3b374e2f6" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33925 } }
I20260807 08:40:12.798789 14887 raft_consensus.cc:388] T 00000000000000000000000000000000 P 50827d183d73495eb3a618b3b374e2f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:40:12.798838 14887 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50827d183d73495eb3a618b3b374e2f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:40:12.798908 14887 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50827d183d73495eb3a618b3b374e2f6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:12.799692 14887 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50827d183d73495eb3a618b3b374e2f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50827d183d73495eb3a618b3b374e2f6" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33925 } }
I20260807 08:40:12.800014 14887 leader_election.cc:302] T 00000000000000000000000000000000 P 50827d183d73495eb3a618b3b374e2f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 50827d183d73495eb3a618b3b374e2f6; no voters:
I20260807 08:40:12.800318 14887 leader_election.cc:288] T 00000000000000000000000000000000 P 50827d183d73495eb3a618b3b374e2f6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:40:12.800398 14894 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 50827d183d73495eb3a618b3b374e2f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:12.800595 14894 raft_consensus.cc:686] T 00000000000000000000000000000000 P 50827d183d73495eb3a618b3b374e2f6 [term 1 LEADER]: Becoming Leader. State: Replica: 50827d183d73495eb3a618b3b374e2f6, State: Running, Role: LEADER
I20260807 08:40:12.800848 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 08:40:12.800910 14894 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50827d183d73495eb3a618b3b374e2f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50827d183d73495eb3a618b3b374e2f6" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33925 } }
I20260807 08:40:12.801338 14887 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50827d183d73495eb3a618b3b374e2f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:40:12.802278 14896 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50827d183d73495eb3a618b3b374e2f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50827d183d73495eb3a618b3b374e2f6. Latest consensus state: current_term: 1 leader_uuid: "50827d183d73495eb3a618b3b374e2f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50827d183d73495eb3a618b3b374e2f6" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33925 } } }
I20260807 08:40:12.802389 14896 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50827d183d73495eb3a618b3b374e2f6 [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:12.802680 14895 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50827d183d73495eb3a618b3b374e2f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "50827d183d73495eb3a618b3b374e2f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50827d183d73495eb3a618b3b374e2f6" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33925 } } }
I20260807 08:40:12.802775 14895 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50827d183d73495eb3a618b3b374e2f6 [sys.catalog]: This master's current role is: LEADER
W20260807 08:40:12.805330 14910 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 50827d183d73495eb3a618b3b374e2f6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:40:12.805393 14910 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:40:12.805509 14903 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:40:12.806401 14903 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:40:12.810519 14903 catalog_manager.cc:1347] Generated new cluster ID: c609ccf800ff47aeaf856185f9dd4e7a
I20260807 08:40:12.810572 14903 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:40:12.820221 14903 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:40:12.821305 14903 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:40:12.830158 14903 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 50827d183d73495eb3a618b3b374e2f6: Generated new TSK 0
I20260807 08:40:12.830809 14903 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:40:12.846210 14891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:12.841525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48522 (local address 127.8.208.254:33925)
0807 08:40:12.841636 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:12.841639 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:12.841769 (+ 130us) server_negotiation.cc:407] Connection header received
0807 08:40:12.841914 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:12.841917 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:12.841982 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:12.842079 (+ 97us) server_negotiation.cc:226] Negotiated authn=JWT
0807 08:40:12.842281 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:12.843026 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:12.843809 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:12.844136 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:12.844237 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:12.844518 (+ 281us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 08:40:12.845846 (+ 1328us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45889/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 08:40:12.846068 (+ 222us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48522: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45889/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":43}
W20260807 08:40:12.846263 14891 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48522: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45889/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260807 08:40:12.847896 14920 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:12.841408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:33925 (local address 127.0.0.1:48522)
0807 08:40:12.841696 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:12.841706 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:12.841787 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:12.842090 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:12.842092 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:12.842098 (+ 6us) client_negotiation.cc:189] Negotiated authn=JWT
0807 08:40:12.842189 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:12.842194 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:12.843126 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:12.843128 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:12.843709 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:12.843715 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:12.844275 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:12.844278 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:12.844342 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:12.844363 (+ 21us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 08:40:12.846024 (+ 1661us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45889/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 08:40:12.847752 (+ 1728us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.8.208.254:33925: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45889/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":217,"mutex_wait_us":1556,"thread_start_us":99,"threads_started":1}
I20260807 08:40:12.848160 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 14815
E20260807 08:40:12.857767 14921 webserver.cc:533] Webserver: sslize failed:
E20260807 08:40:12.857856 14921 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-07T08:40:12Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (274 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-07T08:40:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:40:12Z Disabled control of system clock
I20260807 08:40:12.896279 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:40703
--webserver_interface=127.8.208.254
--webserver_port=0
--builtin_ntp_servers=127.8.208.212:38045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:40703
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786091987266300-9027-0/testchainca.cert with env {}
W20260807 08:40:12.998049 14925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:12.998238 14925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:12.998270 14925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:13.001449 14925 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:40:13.001487 14925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:13.001499 14925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:13.001513 14925 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:40:13.001525 14925 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 08:40:13.001538 14925 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 08:40:13.001549 14925 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260807 08:40:13.006034 14925 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:38045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:40703
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:40703
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786091987266300-9027-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14925
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:13.006812 14925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:13.007603 14925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:13.015064 14933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:13.015085 14930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:13.015130 14925 server_base.cc:1034] running on GCE node
W20260807 08:40:13.015093 14931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:13.015841 14925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:13.016810 14925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:13.017982 14925 hybrid_clock.cc:648] HybridClock initialized: now 1786092013017960 us; error 34 us; skew 500 ppm
I20260807 08:40:13.019524 14925 webserver.cc:460] Webserver started at http://127.8.208.254:33575/ using document root <none> and password file <none>
I20260807 08:40:13.020027 14925 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:13.020114 14925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:13.020295 14925 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:13.022010 14925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "0f346fa272aa47bca47ea167123b9d0e"
format_stamp: "Formatted at 2026-08-07 08:40:13 on dist-test-slave-6nmv"
server_key: "7c38c20fa46edec464e3db3d068581e0"
server_key_iv: "bd08f264c19de6f14073daf78d710c19"
server_key_version: "encryptionkey@0"
I20260807 08:40:13.022487 14925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "0f346fa272aa47bca47ea167123b9d0e"
format_stamp: "Formatted at 2026-08-07 08:40:13 on dist-test-slave-6nmv"
server_key: "7c38c20fa46edec464e3db3d068581e0"
server_key_iv: "bd08f264c19de6f14073daf78d710c19"
server_key_version: "encryptionkey@0"
I20260807 08:40:13.025635 14925 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 08:40:13.027788 14939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:13.028781 14925 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:13.028929 14925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "0f346fa272aa47bca47ea167123b9d0e"
format_stamp: "Formatted at 2026-08-07 08:40:13 on dist-test-slave-6nmv"
server_key: "7c38c20fa46edec464e3db3d068581e0"
server_key_iv: "bd08f264c19de6f14073daf78d710c19"
server_key_version: "encryptionkey@0"
I20260807 08:40:13.029031 14925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:13.043504 14925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:13.044059 14925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:13.044234 14925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:13.050383 14925 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:40703
I20260807 08:40:13.050415 14994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:40703 every 8 connection(s)
I20260807 08:40:13.051205 14925 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:40:13.053897 14995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:13.058614 14995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f346fa272aa47bca47ea167123b9d0e: Bootstrap starting.
I20260807 08:40:13.060598 14995 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f346fa272aa47bca47ea167123b9d0e: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:13.061004 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 14925
I20260807 08:40:13.061133 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:40:13.061299 14995 log.cc:824] T 00000000000000000000000000000000 P 0f346fa272aa47bca47ea167123b9d0e: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:13.061400 9027 external_mini_cluster.cc:1428] Setting key 5612e8258e44f4ee4ec9f1172cafabca
I20260807 08:40:13.063136 14995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f346fa272aa47bca47ea167123b9d0e: No bootstrap required, opened a new log
I20260807 08:40:13.066169 14995 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f346fa272aa47bca47ea167123b9d0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f346fa272aa47bca47ea167123b9d0e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40703 } }
I20260807 08:40:13.066394 14995 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f346fa272aa47bca47ea167123b9d0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:13.066483 14995 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f346fa272aa47bca47ea167123b9d0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f346fa272aa47bca47ea167123b9d0e, State: Initialized, Role: FOLLOWER
I20260807 08:40:13.066876 14995 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f346fa272aa47bca47ea167123b9d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f346fa272aa47bca47ea167123b9d0e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40703 } }
I20260807 08:40:13.067025 14995 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0f346fa272aa47bca47ea167123b9d0e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:40:13.067106 14995 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f346fa272aa47bca47ea167123b9d0e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:40:13.067209 14995 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f346fa272aa47bca47ea167123b9d0e [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:13.067919 14995 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f346fa272aa47bca47ea167123b9d0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f346fa272aa47bca47ea167123b9d0e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40703 } }
I20260807 08:40:13.068249 14995 leader_election.cc:302] T 00000000000000000000000000000000 P 0f346fa272aa47bca47ea167123b9d0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f346fa272aa47bca47ea167123b9d0e; no voters:
I20260807 08:40:13.068567 14995 leader_election.cc:288] T 00000000000000000000000000000000 P 0f346fa272aa47bca47ea167123b9d0e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:40:13.068675 15000 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f346fa272aa47bca47ea167123b9d0e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:13.068877 15000 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f346fa272aa47bca47ea167123b9d0e [term 1 LEADER]: Becoming Leader. State: Replica: 0f346fa272aa47bca47ea167123b9d0e, State: Running, Role: LEADER
I20260807 08:40:13.069195 15000 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f346fa272aa47bca47ea167123b9d0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f346fa272aa47bca47ea167123b9d0e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40703 } }
I20260807 08:40:13.069634 14999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:13.062335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47582 (local address 127.8.208.254:40703)
0807 08:40:13.062853 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:13.062865 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:13.062901 (+ 36us) server_negotiation.cc:407] Connection header received
0807 08:40:13.063464 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:13.063479 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:13.063739 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:13.064016 (+ 277us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:13.064372 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:13.065191 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:13.066139 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:13.066754 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:13.066926 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:13.067667 (+ 741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:13.067672 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:13.067690 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:40:13.068001 (+ 311us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:13.068076 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:40:13.068098 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:13.068180 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:13.068332 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 08:40:13.068786 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":104,"threads_started":1}
I20260807 08:40:13.069669 14995 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f346fa272aa47bca47ea167123b9d0e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:40:13.070254 15000 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f346fa272aa47bca47ea167123b9d0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f346fa272aa47bca47ea167123b9d0e. Latest consensus state: current_term: 1 leader_uuid: "0f346fa272aa47bca47ea167123b9d0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f346fa272aa47bca47ea167123b9d0e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40703 } } }
I20260807 08:40:13.070425 15000 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f346fa272aa47bca47ea167123b9d0e [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:13.070664 15002 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f346fa272aa47bca47ea167123b9d0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f346fa272aa47bca47ea167123b9d0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f346fa272aa47bca47ea167123b9d0e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40703 } } }
I20260807 08:40:13.070763 15002 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f346fa272aa47bca47ea167123b9d0e [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:13.071064 15008 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:40:13.072324 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 08:40:13.073993 15008 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:40:13.078684 15008 catalog_manager.cc:1347] Generated new cluster ID: 26c3dfbbd45249089279403767dd2dae
I20260807 08:40:13.078738 15008 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:40:13.084719 15008 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:40:13.085727 15008 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:40:13.094925 15008 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0f346fa272aa47bca47ea167123b9d0e: Generated new TSK 0
I20260807 08:40:13.095590 15008 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:40:13.613627 14999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:13.103106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47594 (local address 127.8.208.254:40703)
0807 08:40:13.103214 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:13.103218 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:13.103401 (+ 183us) server_negotiation.cc:407] Connection header received
0807 08:40:13.103525 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:13.103528 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:13.103576 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:13.103685 (+ 109us) server_negotiation.cc:226] Negotiated authn=JWT
0807 08:40:13.103980 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:13.104798 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:13.105639 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:13.106000 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:13.106104 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:13.106403 (+ 299us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 08:40:13.613267 (+506864us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 08:40:13.613516 (+ 249us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47594: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":45}
W20260807 08:40:13.613719 14999 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47594: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260807 08:40:13.613855 15025 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:13.102993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:40703 (local address 127.0.0.1:47594)
0807 08:40:13.103292 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:13.103309 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:13.103424 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:13.103733 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:13.103736 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:13.103743 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0807 08:40:13.103848 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:13.103853 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:13.104932 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:13.104934 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:13.105533 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:13.105539 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:13.106129 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:13.106132 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:13.106220 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:13.106255 (+ 35us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 08:40:13.613490 (+507235us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 08:40:13.613653 (+ 163us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.8.208.254:40703: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":97,"threads_started":1}
I20260807 08:40:13.614528 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 14925
2026-08-07T08:40:13Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (746 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (112 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (111 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:40:13 dist-test-slave-6nmv krb5kdc[15039](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:40:13 dist-test-slave-6nmv krb5kdc[15039](info): set up 2 sockets
Aug 07 08:40:13 dist-test-slave-6nmv krb5kdc[15039](info): commencing operation
krb5kdc: starting...
W20260807 08:40:14.828367 9027 mini_kdc.cc:121] Time spent starting KDC: real 0.969s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:40:14 dist-test-slave-6nmv krb5kdc[15039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092014, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:40:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:40:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:40:14.946849 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:32947
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:41261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:32947
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:15.051781 15052 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:15.052004 15052 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:15.052042 15052 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:15.055795 15052 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:40:15.055845 15052 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:15.055866 15052 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:15.055887 15052 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:40:15.055902 15052 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:40:15.060741 15052 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:41261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:32947
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:32947
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15052
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:15.061597 15052 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:15.062573 15052 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:15.070457 15062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:15.070498 15058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:15.070457 15059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:15.070698 15052 server_base.cc:1034] running on GCE node
I20260807 08:40:15.071298 15052 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:15.072348 15052 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:15.073554 15052 hybrid_clock.cc:648] HybridClock initialized: now 1786092015073536 us; error 29 us; skew 500 ppm
Aug 07 08:40:15 dist-test-slave-6nmv krb5kdc[15039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092015, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:15.080313 15052 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:40:15.081261 15052 webserver.cc:460] Webserver started at http://127.8.208.254:40923/ using document root <none> and password file <none>
I20260807 08:40:15.081972 15052 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:15.082078 15052 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:15.082335 15052 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:15.084559 15052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "82b658cec1ad473c8008df8b6530c6ed"
format_stamp: "Formatted at 2026-08-07 08:40:15 on dist-test-slave-6nmv"
server_key: "8d57d69753b25d0c9cf8747a0267c92a"
server_key_iv: "85a54ef0a1cbfc60aa76d981043c2d89"
server_key_version: "encryptionkey@0"
I20260807 08:40:15.085229 15052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "82b658cec1ad473c8008df8b6530c6ed"
format_stamp: "Formatted at 2026-08-07 08:40:15 on dist-test-slave-6nmv"
server_key: "8d57d69753b25d0c9cf8747a0267c92a"
server_key_iv: "85a54ef0a1cbfc60aa76d981043c2d89"
server_key_version: "encryptionkey@0"
I20260807 08:40:15.089298 15052 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 08:40:15.091786 15069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:15.093281 15052 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 08:40:15.093437 15052 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "82b658cec1ad473c8008df8b6530c6ed"
format_stamp: "Formatted at 2026-08-07 08:40:15 on dist-test-slave-6nmv"
server_key: "8d57d69753b25d0c9cf8747a0267c92a"
server_key_iv: "85a54ef0a1cbfc60aa76d981043c2d89"
server_key_version: "encryptionkey@0"
I20260807 08:40:15.093549 15052 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:15.109972 15052 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:15.113389 15052 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:15.113603 15052 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:15.121071 15052 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:32947
I20260807 08:40:15.121083 15123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:32947 every 8 connection(s)
I20260807 08:40:15.122043 15052 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:40:15.123011 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 15052
I20260807 08:40:15.123178 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:40:15.123502 9027 external_mini_cluster.cc:1428] Setting key a77dfcbd79987726b6d25e50284de300
I20260807 08:40:15.125001 15124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:15.131421 15124 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82b658cec1ad473c8008df8b6530c6ed: Bootstrap starting.
Aug 07 08:40:15 dist-test-slave-6nmv krb5kdc[15039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092014, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:15.133796 15124 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82b658cec1ad473c8008df8b6530c6ed: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:15.134722 15124 log.cc:824] T 00000000000000000000000000000000 P 82b658cec1ad473c8008df8b6530c6ed: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:15.136935 15124 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82b658cec1ad473c8008df8b6530c6ed: No bootstrap required, opened a new log
I20260807 08:40:15.138954 15127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:15.124952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37112 (local address 127.8.208.254:32947)
0807 08:40:15.125441 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:15.125460 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:15.125501 (+ 41us) server_negotiation.cc:407] Connection header received
0807 08:40:15.126332 (+ 831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:15.126353 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:15.126753 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:15.127094 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:15.127773 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:15.129151 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:15.130122 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:15.130781 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:15.130942 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:15.133836 (+ 2894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:15.133846 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:15.133864 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:15.133902 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:15.135815 (+ 1913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:15.136293 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:15.136298 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:15.136304 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:15.136452 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:15.136746 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:15.136749 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:15.136751 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:15.137234 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:15.137432 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:15.137731 (+ 299us) server_negotiation.cc:299] Negotiation successful
0807 08:40:15.138056 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":161,"threads_started":1}
I20260807 08:40:15.141148 15124 raft_consensus.cc:348] T 00000000000000000000000000000000 P 82b658cec1ad473c8008df8b6530c6ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82b658cec1ad473c8008df8b6530c6ed" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 32947 } }
I20260807 08:40:15.141374 15124 raft_consensus.cc:374] T 00000000000000000000000000000000 P 82b658cec1ad473c8008df8b6530c6ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:15.141412 15124 raft_consensus.cc:729] T 00000000000000000000000000000000 P 82b658cec1ad473c8008df8b6530c6ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82b658cec1ad473c8008df8b6530c6ed, State: Initialized, Role: FOLLOWER
I20260807 08:40:15.141796 15124 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82b658cec1ad473c8008df8b6530c6ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82b658cec1ad473c8008df8b6530c6ed" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 32947 } }
I20260807 08:40:15.141973 15124 raft_consensus.cc:388] T 00000000000000000000000000000000 P 82b658cec1ad473c8008df8b6530c6ed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:40:15.142019 15124 raft_consensus.cc:482] T 00000000000000000000000000000000 P 82b658cec1ad473c8008df8b6530c6ed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:40:15.142087 15124 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 82b658cec1ad473c8008df8b6530c6ed [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:15.142892 15124 raft_consensus.cc:504] T 00000000000000000000000000000000 P 82b658cec1ad473c8008df8b6530c6ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82b658cec1ad473c8008df8b6530c6ed" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 32947 } }
I20260807 08:40:15.143164 15124 leader_election.cc:302] T 00000000000000000000000000000000 P 82b658cec1ad473c8008df8b6530c6ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 82b658cec1ad473c8008df8b6530c6ed; no voters:
I20260807 08:40:15.143428 15124 leader_election.cc:288] T 00000000000000000000000000000000 P 82b658cec1ad473c8008df8b6530c6ed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:40:15.143501 15129 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 82b658cec1ad473c8008df8b6530c6ed [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:15.143729 15129 raft_consensus.cc:686] T 00000000000000000000000000000000 P 82b658cec1ad473c8008df8b6530c6ed [term 1 LEADER]: Becoming Leader. State: Replica: 82b658cec1ad473c8008df8b6530c6ed, State: Running, Role: LEADER
I20260807 08:40:15.144019 15129 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82b658cec1ad473c8008df8b6530c6ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82b658cec1ad473c8008df8b6530c6ed" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 32947 } }
I20260807 08:40:15.144681 15124 sys_catalog.cc:564] T 00000000000000000000000000000000 P 82b658cec1ad473c8008df8b6530c6ed [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:40:15.145870 15130 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82b658cec1ad473c8008df8b6530c6ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "82b658cec1ad473c8008df8b6530c6ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82b658cec1ad473c8008df8b6530c6ed" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 32947 } } }
I20260807 08:40:15.146006 15130 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82b658cec1ad473c8008df8b6530c6ed [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:15.146262 15131 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82b658cec1ad473c8008df8b6530c6ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82b658cec1ad473c8008df8b6530c6ed. Latest consensus state: current_term: 1 leader_uuid: "82b658cec1ad473c8008df8b6530c6ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82b658cec1ad473c8008df8b6530c6ed" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 32947 } } }
I20260807 08:40:15.146353 15131 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82b658cec1ad473c8008df8b6530c6ed [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:15.146533 15138 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:40:15.149454 15138 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:40:15.155421 15138 catalog_manager.cc:1347] Generated new cluster ID: aa481515405d4ba4ae3fcb892ac8346c
I20260807 08:40:15.155498 15138 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:40:15.169344 15138 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:40:15.170570 15138 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:40:15.180346 15138 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 82b658cec1ad473c8008df8b6530c6ed: Generated new TSK 0
I20260807 08:40:15.181007 15138 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.208.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
I20260807 08:40:15.213768 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:32947
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:41261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:15.317072 15151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:15.317269 15151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:15.317304 15151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:15.320911 15151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:15.320961 15151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:15.321046 15151 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:40:15.325407 15151 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:41261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:32947
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15151
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:15.326380 15151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:15.327277 15151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:15.336261 15161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:15.336274 15159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:15.336274 15158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:15.336493 15151 server_base.cc:1034] running on GCE node
I20260807 08:40:15.336902 15151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:15.337440 15151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:15.338587 15151 hybrid_clock.cc:648] HybridClock initialized: now 1786092015338570 us; error 27 us; skew 500 ppm
Aug 07 08:40:15 dist-test-slave-6nmv krb5kdc[15039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092015, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:15.341193 15151 init.cc:377] Logged in from keytab as kudu/127.8.208.193@KRBTEST.COM (short username kudu)
I20260807 08:40:15.342010 15151 webserver.cc:460] Webserver started at http://127.8.208.193:38489/ using document root <none> and password file <none>
I20260807 08:40:15.342510 15151 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:15.342594 15151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:15.342818 15151 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:15.344717 15151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "0d371affe75b446584d05738ade0f54a"
format_stamp: "Formatted at 2026-08-07 08:40:15 on dist-test-slave-6nmv"
server_key: "3a929651137ba903052a17314d272935"
server_key_iv: "93cfa27d736fd5895187d4c93eac7ea8"
server_key_version: "encryptionkey@0"
I20260807 08:40:15.345359 15151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "0d371affe75b446584d05738ade0f54a"
format_stamp: "Formatted at 2026-08-07 08:40:15 on dist-test-slave-6nmv"
server_key: "3a929651137ba903052a17314d272935"
server_key_iv: "93cfa27d736fd5895187d4c93eac7ea8"
server_key_version: "encryptionkey@0"
I20260807 08:40:15.348884 15151 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 08:40:15.351109 15168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:15.352254 15151 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 08:40:15.352382 15151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "0d371affe75b446584d05738ade0f54a"
format_stamp: "Formatted at 2026-08-07 08:40:15 on dist-test-slave-6nmv"
server_key: "3a929651137ba903052a17314d272935"
server_key_iv: "93cfa27d736fd5895187d4c93eac7ea8"
server_key_version: "encryptionkey@0"
I20260807 08:40:15.352489 15151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:15.373610 15151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:15.377110 15151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:15.377313 15151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:15.378062 15151 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:15.378986 15151 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:15.379057 15151 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:15.379140 15151 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:15.379181 15151 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:15.387470 15151 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:32969
I20260807 08:40:15.387506 15290 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:32969 every 8 connection(s)
I20260807 08:40:15.388329 15151 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:40:15.389578 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 15151
I20260807 08:40:15.389716 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
I20260807 08:40:15.390074 9027 external_mini_cluster.cc:1428] Setting key 10b8bc7b395183292f003d1b670d031f
Aug 07 08:40:15 dist-test-slave-6nmv krb5kdc[15039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092015, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.208.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.194@KRBTEST.COM" created.
I20260807 08:40:15.403407 15127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:15.390349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:34565 (local address 127.8.208.254:32947)
0807 08:40:15.390492 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:15.390496 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:15.391334 (+ 838us) server_negotiation.cc:407] Connection header received
0807 08:40:15.392927 (+ 1593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:15.392931 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:15.392981 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:15.393054 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:15.394566 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:15.395053 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:15.396936 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:15.397150 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:15.397225 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:15.399773 (+ 2548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:15.399776 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:15.399778 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:15.399817 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:15.401157 (+ 1340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:15.401707 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:15.401716 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:15.401717 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:15.401792 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:15.402244 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:15.402248 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:15.402249 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:15.402435 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:15.402621 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:15.403171 (+ 550us) server_negotiation.cc:299] Negotiation successful
0807 08:40:15.403282 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 08:40:15.404589 15293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:15.390726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:32947 (local address 127.8.208.193:34565)
0807 08:40:15.391190 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:15.391230 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:15.392714 (+ 1484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:15.393206 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:15.393213 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:15.393718 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:15.394411 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:15.394433 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:15.395187 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:15.395193 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:15.396798 (+ 1605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:15.396811 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:15.397300 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:15.397306 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:15.397532 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:15.398131 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:15.398152 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:15.399615 (+ 1463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:15.401309 (+ 1694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:15.401314 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:15.401327 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:15.401589 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:15.401941 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:15.401943 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:15.401946 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:15.402153 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:15.402610 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:15.402616 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:15.402919 (+ 303us) client_negotiation.cc:769] Sending connection context
0807 08:40:15.403118 (+ 199us) client_negotiation.cc:240] Negotiation successful
0807 08:40:15.403493 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":146,"threads_started":1}
I20260807 08:40:15.405969 15291 heartbeater.cc:347] Connected to a master server at 127.8.208.254:32947
I20260807 08:40:15.406208 15291 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:15.406697 15291 heartbeater.cc:511] Master 127.8.208.254:32947 requested a full tablet report, sending...
I20260807 08:40:15.408195 15086 ts_manager.cc:194] Registered new tserver with Master: 0d371affe75b446584d05738ade0f54a (127.8.208.193:32969)
I20260807 08:40:15.409258 15086 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.193@KRBTEST.COM'} at 127.8.208.193:34565
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
I20260807 08:40:15.418370 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:32947
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:41261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:15.522491 15296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:15.522683 15296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:15.522717 15296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:15.526383 15296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:15.526441 15296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:15.526499 15296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:40:15.530618 15296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:41261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:32947
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:15.531386 15296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:15.532256 15296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:15.541076 15304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:15.541098 15301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:15.541042 15302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:15.541172 15296 server_base.cc:1034] running on GCE node
I20260807 08:40:15.541501 15296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:15.542083 15296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:15.543284 15296 hybrid_clock.cc:648] HybridClock initialized: now 1786092015543273 us; error 25 us; skew 500 ppm
Aug 07 08:40:15 dist-test-slave-6nmv krb5kdc[15039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092015, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:15.546030 15296 init.cc:377] Logged in from keytab as kudu/127.8.208.194@KRBTEST.COM (short username kudu)
I20260807 08:40:15.546881 15296 webserver.cc:460] Webserver started at http://127.8.208.194:37225/ using document root <none> and password file <none>
I20260807 08:40:15.547333 15296 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:15.547392 15296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:15.547564 15296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:15.549376 15296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "9e5a97e66ca24328a0f178bb288c2a12"
format_stamp: "Formatted at 2026-08-07 08:40:15 on dist-test-slave-6nmv"
server_key: "5eb8ad4d5e158a0cbbfb33201a4991cc"
server_key_iv: "3bef278b096a87afe918b06a0900e425"
server_key_version: "encryptionkey@0"
I20260807 08:40:15.549968 15296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "9e5a97e66ca24328a0f178bb288c2a12"
format_stamp: "Formatted at 2026-08-07 08:40:15 on dist-test-slave-6nmv"
server_key: "5eb8ad4d5e158a0cbbfb33201a4991cc"
server_key_iv: "3bef278b096a87afe918b06a0900e425"
server_key_version: "encryptionkey@0"
I20260807 08:40:15.553308 15296 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 08:40:15.555732 15311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:15.556928 15296 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:15.557065 15296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "9e5a97e66ca24328a0f178bb288c2a12"
format_stamp: "Formatted at 2026-08-07 08:40:15 on dist-test-slave-6nmv"
server_key: "5eb8ad4d5e158a0cbbfb33201a4991cc"
server_key_iv: "3bef278b096a87afe918b06a0900e425"
server_key_version: "encryptionkey@0"
I20260807 08:40:15.557173 15296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:15.569295 15296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:15.572294 15296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:15.572504 15296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:15.573057 15296 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:15.573871 15296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:15.573938 15296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:15.574004 15296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:15.574051 15296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:15.582772 15296 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:45177
I20260807 08:40:15.582813 15432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:45177 every 8 connection(s)
I20260807 08:40:15.583618 15296 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:40:15.583971 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 15296
I20260807 08:40:15.584096 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:40:15.584407 9027 external_mini_cluster.cc:1428] Setting key 74928767743fa02691d1190a3063bbe6
Aug 07 08:40:15 dist-test-slave-6nmv krb5kdc[15039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092015, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.208.195@KRBTEST.COM; defaulting to no policy
I20260807 08:40:15.597621 15127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:15.585482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:53099 (local address 127.8.208.254:32947)
0807 08:40:15.585632 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:15.585636 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:15.586518 (+ 882us) server_negotiation.cc:407] Connection header received
0807 08:40:15.588214 (+ 1696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:15.588216 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:15.588256 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:15.588317 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:15.589478 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:15.590295 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:15.591401 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:15.591782 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:15.591916 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:15.594340 (+ 2424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:15.594343 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:15.594345 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:15.594366 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:15.595833 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:15.596290 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:15.596292 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:15.596294 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:15.596367 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:15.596694 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:15.596697 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:15.596698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:15.596867 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:15.596967 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:15.597361 (+ 394us) server_negotiation.cc:299] Negotiation successful
0807 08:40:15.597474 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.195@KRBTEST.COM" created.
I20260807 08:40:15.598477 15435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:15.585797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:32947 (local address 127.8.208.194:53099)
0807 08:40:15.586339 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:15.586402 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:15.588015 (+ 1613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:15.588494 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:15.588504 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:15.588947 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:15.589347 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:15.589359 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:15.590407 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:15.590409 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:15.591277 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:15.591288 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:15.591920 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:15.591922 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:15.592054 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:15.592601 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:15.592616 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:15.594195 (+ 1579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:15.595957 (+ 1762us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:15.595961 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:15.595971 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:15.596204 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:15.596496 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:15.596498 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:15.596499 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:15.596603 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:15.596965 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:15.596971 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:15.597156 (+ 185us) client_negotiation.cc:769] Sending connection context
0807 08:40:15.597320 (+ 164us) client_negotiation.cc:240] Negotiation successful
0807 08:40:15.597571 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":167,"threads_started":1}
I20260807 08:40:15.600137 15433 heartbeater.cc:347] Connected to a master server at 127.8.208.254:32947
I20260807 08:40:15.600399 15433 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:15.600870 15433 heartbeater.cc:511] Master 127.8.208.254:32947 requested a full tablet report, sending...
I20260807 08:40:15.601934 15086 ts_manager.cc:194] Registered new tserver with Master: 9e5a97e66ca24328a0f178bb288c2a12 (127.8.208.194:45177)
I20260807 08:40:15.602769 15086 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.194@KRBTEST.COM'} at 127.8.208.194:53099
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
I20260807 08:40:15.612154 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:32947
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:41261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:15.710410 15438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:15.710642 15438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:15.710716 15438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:15.714484 15438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:15.714555 15438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:15.714635 15438 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:40:15.719354 15438 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:41261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:32947
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15438
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:15.720166 15438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:15.720973 15438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:15.729370 15443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:15.729382 15446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:15.729568 15438 server_base.cc:1034] running on GCE node
W20260807 08:40:15.729715 15444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:15.730083 15438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:15.730571 15438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:15.731719 15438 hybrid_clock.cc:648] HybridClock initialized: now 1786092015731698 us; error 32 us; skew 500 ppm
Aug 07 08:40:15 dist-test-slave-6nmv krb5kdc[15039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092015, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:15.734238 15438 init.cc:377] Logged in from keytab as kudu/127.8.208.195@KRBTEST.COM (short username kudu)
I20260807 08:40:15.734983 15438 webserver.cc:460] Webserver started at http://127.8.208.195:42457/ using document root <none> and password file <none>
I20260807 08:40:15.735494 15438 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:15.735580 15438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:15.735790 15438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:15.737577 15438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "bba5164fb995429685b42a3f0e2a48aa"
format_stamp: "Formatted at 2026-08-07 08:40:15 on dist-test-slave-6nmv"
server_key: "7385bbb44d43c22aa64c0c42fb5e99d2"
server_key_iv: "f46cad9f09ebc9cc1bd30567f53a4998"
server_key_version: "encryptionkey@0"
I20260807 08:40:15.738083 15438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "bba5164fb995429685b42a3f0e2a48aa"
format_stamp: "Formatted at 2026-08-07 08:40:15 on dist-test-slave-6nmv"
server_key: "7385bbb44d43c22aa64c0c42fb5e99d2"
server_key_iv: "f46cad9f09ebc9cc1bd30567f53a4998"
server_key_version: "encryptionkey@0"
I20260807 08:40:15.741061 15438 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20260807 08:40:15.743191 15453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:15.744215 15438 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 08:40:15.744333 15438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "bba5164fb995429685b42a3f0e2a48aa"
format_stamp: "Formatted at 2026-08-07 08:40:15 on dist-test-slave-6nmv"
server_key: "7385bbb44d43c22aa64c0c42fb5e99d2"
server_key_iv: "f46cad9f09ebc9cc1bd30567f53a4998"
server_key_version: "encryptionkey@0"
I20260807 08:40:15.744426 15438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:15.760007 15438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:15.762609 15438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:15.762775 15438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:15.763239 15438 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:15.763886 15438 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:15.763933 15438 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:15.763990 15438 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:15.764022 15438 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:15.771919 15438 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:40233
I20260807 08:40:15.771945 15576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:40233 every 8 connection(s)
I20260807 08:40:15.772670 15438 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:40:15.777102 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 15438
I20260807 08:40:15.777187 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:40:15.777448 9027 external_mini_cluster.cc:1428] Setting key 59af919e6769e8008c662668d174b3f8
Aug 07 08:40:15 dist-test-slave-6nmv krb5kdc[15039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092015, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:15.784505 15127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:15.774266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:59777 (local address 127.8.208.254:32947)
0807 08:40:15.774385 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:15.774388 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:15.775047 (+ 659us) server_negotiation.cc:407] Connection header received
0807 08:40:15.776343 (+ 1296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:15.776346 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:15.776403 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:15.776530 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:15.777584 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:15.778306 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:15.779536 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:15.779802 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:15.779905 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:15.781843 (+ 1938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:15.781852 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:15.781854 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:15.781876 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:15.782995 (+ 1119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:15.783404 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:15.783406 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:15.783407 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:15.783476 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:15.783730 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:15.783732 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:15.783733 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:15.783878 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:15.783947 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:15.784304 (+ 357us) server_negotiation.cc:299] Negotiation successful
0807 08:40:15.784401 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 08:40:15.785111 15579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:15.774535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:32947 (local address 127.8.208.195:59777)
0807 08:40:15.774902 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:15.774935 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:15.776137 (+ 1202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:15.776675 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:15.776681 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:15.776978 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:15.777422 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:15.777433 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:15.778461 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:15.778464 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:15.779400 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:15.779410 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:15.779940 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:15.779944 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:15.780093 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:15.780478 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:15.780490 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:15.781679 (+ 1189us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:15.783088 (+ 1409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:15.783092 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:15.783101 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:15.783320 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:15.783548 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:15.783549 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:15.783551 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:15.783661 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:15.783956 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:15.783960 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:15.784133 (+ 173us) client_negotiation.cc:769] Sending connection context
0807 08:40:15.784261 (+ 128us) client_negotiation.cc:240] Negotiation successful
0807 08:40:15.784467 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":109,"threads_started":1}
I20260807 08:40:15.786140 15577 heartbeater.cc:347] Connected to a master server at 127.8.208.254:32947
I20260807 08:40:15.786342 15577 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:15.786763 15577 heartbeater.cc:511] Master 127.8.208.254:32947 requested a full tablet report, sending...
I20260807 08:40:15.787624 15086 ts_manager.cc:194] Registered new tserver with Master: bba5164fb995429685b42a3f0e2a48aa (127.8.208.195:40233)
I20260807 08:40:15.788115 15086 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.195@KRBTEST.COM'} at 127.8.208.195:59777
I20260807 08:40:15.790912 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/test-admin.keytab.
Aug 07 08:40:15 dist-test-slave-6nmv krb5kdc[15039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:15.805692 9027 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260807 08:40:15.808210 15584 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:15.806920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42370 (local address 127.8.208.193:32969)
0807 08:40:15.807230 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:15.807241 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:15.807259 (+ 18us) server_negotiation.cc:407] Connection header received
0807 08:40:15.807297 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:15.807300 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:15.807439 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:15.807573 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:15.808025 (+ 452us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42370: BlockingRecv error: recv got EOF from 127.0.0.1:42370 (error 108)
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":94,"threads_started":1}
W20260807 08:40:15.808378 9027 init.cc:244] Error while opening credential cache '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/krb5cc)
Aug 07 08:40:15 dist-test-slave-6nmv krb5kdc[15039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:15.809250 9027 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 08:40:15 dist-test-slave-6nmv krb5kdc[15039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:15.810091 9027 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 08:40:15 dist-test-slave-6nmv krb5kdc[15039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.193@KRBTEST.COM
I20260807 08:40:15.818934 15584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:15.810779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42378 (local address 127.8.208.193:32969)
0807 08:40:15.810886 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:15.810889 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:15.810972 (+ 83us) server_negotiation.cc:407] Connection header received
0807 08:40:15.811091 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:15.811095 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:15.811135 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:15.811208 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:15.811745 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:15.812471 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:15.813274 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:15.813572 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:15.813675 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:15.815685 (+ 2010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:15.815694 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:15.815704 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:15.815726 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:15.817323 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:15.817715 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:15.817720 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:15.817721 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:15.817878 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:15.818140 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:15.818142 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:15.818143 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:15.818356 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:15.818500 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:15.818638 (+ 138us) server_negotiation.cc:299] Negotiation successful
0807 08:40:15.818795 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260807 08:40:15.822698 15584 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:15.821470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42390 (local address 127.8.208.193:32969)
0807 08:40:15.821618 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:15.821624 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:15.821759 (+ 135us) server_negotiation.cc:407] Connection header received
0807 08:40:15.821905 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:15.821908 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:15.821980 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:15.822069 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:15.822600 (+ 531us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42390: BlockingRecv error: recv got EOF from 127.0.0.1:42390 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260807 08:40:15.822814 9027 init.cc:244] Error while opening credential cache '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/krb5cc' of type FILE: Runtime error: Bad format in credentials cache (filename: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/krb5cc)
Aug 07 08:40:15 dist-test-slave-6nmv krb5kdc[15039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:15.823769 9027 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 08:40:15 dist-test-slave-6nmv krb5kdc[15039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:15.824656 9027 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 08:40:15 dist-test-slave-6nmv krb5kdc[15039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.193@KRBTEST.COM
I20260807 08:40:15.832037 15584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:15.825418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42406 (local address 127.8.208.193:32969)
0807 08:40:15.825547 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:15.825550 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:15.825563 (+ 13us) server_negotiation.cc:407] Connection header received
0807 08:40:15.825662 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:15.825664 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:15.825696 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:15.825758 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:15.826234 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:15.826710 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:15.827370 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:15.827560 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:15.827627 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:15.829437 (+ 1810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:15.829439 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:15.829441 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:15.829460 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:15.830759 (+ 1299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:15.831073 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:15.831075 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:15.831075 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:15.831154 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:15.831350 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:15.831352 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:15.831353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:15.831481 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:15.831562 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:15.831767 (+ 205us) server_negotiation.cc:299] Negotiation successful
0807 08:40:15.831885 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260807 08:40:15.834625 15584 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:15.833558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42418 (local address 127.8.208.193:32969)
0807 08:40:15.833663 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:15.833666 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:15.833801 (+ 135us) server_negotiation.cc:407] Connection header received
0807 08:40:15.834029 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:15.834032 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:15.834071 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:15.834147 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:15.834532 (+ 385us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42418: BlockingRecv error: recv got EOF from 127.0.0.1:42418 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260807 08:40:15.834784 9027 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786091987266300-9027-0/krb5kdc/krb5cc' of type FILE
Aug 07 08:40:15 dist-test-slave-6nmv krb5kdc[15039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:15.835718 9027 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 08:40:15 dist-test-slave-6nmv krb5kdc[15039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:15.836622 9027 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 08:40:15 dist-test-slave-6nmv krb5kdc[15039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.193@KRBTEST.COM
I20260807 08:40:15.843999 15584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:15.837323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42420 (local address 127.8.208.193:32969)
0807 08:40:15.837433 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:15.837437 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:15.837548 (+ 111us) server_negotiation.cc:407] Connection header received
0807 08:40:15.837673 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:15.837675 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:15.837712 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:15.837785 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:15.838229 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:15.838623 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:15.839292 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:15.839484 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:15.839583 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:15.841540 (+ 1957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:15.841543 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:15.841544 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:15.841575 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:15.842711 (+ 1136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:15.843081 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:15.843083 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:15.843084 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:15.843144 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:15.843361 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:15.843363 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:15.843364 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:15.843483 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:15.843581 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:15.843825 (+ 244us) server_negotiation.cc:299] Negotiation successful
0807 08:40:15.843905 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 08:40:15.844846 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 15151
I20260807 08:40:15.852847 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 15296
I20260807 08:40:15.858878 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 15438
I20260807 08:40:15.864291 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 15052
2026-08-07T08:40:15Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2026 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:40:15 dist-test-slave-6nmv krb5kdc[15597](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:40:15 dist-test-slave-6nmv krb5kdc[15597](info): set up 2 sockets
Aug 07 08:40:15 dist-test-slave-6nmv krb5kdc[15597](info): commencing operation
krb5kdc: starting...
W20260807 08:40:16.861621 9027 mini_kdc.cc:121] Time spent starting KDC: real 0.976s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:40:16 dist-test-slave-6nmv krb5kdc[15597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:40:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:40:16Z Disabled control of system clock
WARNING: no policy specified for oryx/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.254.keytab.
Entry for principal oryx/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.254.keytab.
I20260807 08:40:16.972700 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:35737
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.254.keytab
--principal=oryx/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:35737
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:17.069485 15610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:17.069675 15610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:17.069707 15610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:17.073216 15610 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:40:17.073258 15610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:17.073280 15610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:17.073294 15610 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:40:17.073307 15610 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:40:17.078104 15610 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:35737
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.254.keytab
--principal=oryx/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:35737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15610
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:17.078855 15610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:17.079623 15610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:17.086977 15615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:17.087023 15618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:17.087021 15616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:17.087301 15610 server_base.cc:1034] running on GCE node
I20260807 08:40:17.087860 15610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:17.088805 15610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:17.089973 15610 hybrid_clock.cc:648] HybridClock initialized: now 1786092017089951 us; error 37 us; skew 500 ppm
Aug 07 08:40:17 dist-test-slave-6nmv krb5kdc[15597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092017, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:17.092447 15610 init.cc:377] Logged in from keytab as oryx/127.8.208.254@KRBTEST.COM (short username oryx)
I20260807 08:40:17.093119 15610 webserver.cc:460] Webserver started at http://127.8.208.254:43725/ using document root <none> and password file <none>
I20260807 08:40:17.093531 15610 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:17.093595 15610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:17.093722 15610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:17.095428 15610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "1da71c42e9a941adbd04972d66e00568"
format_stamp: "Formatted at 2026-08-07 08:40:17 on dist-test-slave-6nmv"
server_key: "aa27ee1780e4c8622701f0fd989b492a"
server_key_iv: "e516fdb84b100724febc06f5e11ef0f0"
server_key_version: "encryptionkey@0"
I20260807 08:40:17.095902 15610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "1da71c42e9a941adbd04972d66e00568"
format_stamp: "Formatted at 2026-08-07 08:40:17 on dist-test-slave-6nmv"
server_key: "aa27ee1780e4c8622701f0fd989b492a"
server_key_iv: "e516fdb84b100724febc06f5e11ef0f0"
server_key_version: "encryptionkey@0"
I20260807 08:40:17.099046 15610 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 08:40:17.101007 15627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:17.102061 15610 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:40:17.102169 15610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "1da71c42e9a941adbd04972d66e00568"
format_stamp: "Formatted at 2026-08-07 08:40:17 on dist-test-slave-6nmv"
server_key: "aa27ee1780e4c8622701f0fd989b492a"
server_key_iv: "e516fdb84b100724febc06f5e11ef0f0"
server_key_version: "encryptionkey@0"
I20260807 08:40:17.102253 15610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:17.130167 15610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:17.133106 15610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:17.133251 15610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:17.139365 15610 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:35737
I20260807 08:40:17.139621 15683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:35737 every 8 connection(s)
I20260807 08:40:17.140158 15610 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:40:17.142370 15684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:17.146934 15684 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568: Bootstrap starting.
I20260807 08:40:17.147997 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 15610
I20260807 08:40:17.148125 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:40:17.148391 9027 external_mini_cluster.cc:1428] Setting key 800dc43daacee2480d2bdad7b2b16300
I20260807 08:40:17.149348 15684 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:17.150056 15684 log.cc:824] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:17.151984 15684 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568: No bootstrap required, opened a new log
I20260807 08:40:17.155853 15684 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } }
I20260807 08:40:17.156119 15684 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:17.156198 15684 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da71c42e9a941adbd04972d66e00568, State: Initialized, Role: FOLLOWER
I20260807 08:40:17.156672 15684 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } }
Aug 07 08:40:17 dist-test-slave-6nmv krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM
I20260807 08:40:17.156824 15684 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:40:17.156899 15684 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:40:17.156996 15684 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:17.157931 15684 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } }
I20260807 08:40:17.158249 15684 leader_election.cc:302] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1da71c42e9a941adbd04972d66e00568; no voters:
I20260807 08:40:17.158664 15684 leader_election.cc:288] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:40:17.158774 15689 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:17.158990 15689 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [term 1 LEADER]: Becoming Leader. State: Replica: 1da71c42e9a941adbd04972d66e00568, State: Running, Role: LEADER
I20260807 08:40:17.159271 15689 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } }
I20260807 08:40:17.159898 15684 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:40:17.161118 15691 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1da71c42e9a941adbd04972d66e00568. Latest consensus state: current_term: 1 leader_uuid: "1da71c42e9a941adbd04972d66e00568" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } }
I20260807 08:40:17.161118 15690 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1da71c42e9a941adbd04972d66e00568" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } }
I20260807 08:40:17.161269 15690 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:17.161269 15691 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:17.161700 15698 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:40:17.163722 15687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:17.149475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40238 (local address 127.8.208.254:35737)
0807 08:40:17.149876 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:17.149892 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:17.149923 (+ 31us) server_negotiation.cc:407] Connection header received
0807 08:40:17.150563 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:17.150578 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:17.150847 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:17.151094 (+ 247us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:17.151956 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:17.152926 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:17.153979 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:17.154393 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:17.154505 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:17.157428 (+ 2923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:17.157432 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:17.157443 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:17.157467 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:17.159547 (+ 2080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:17.160135 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:17.160141 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:17.160146 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:17.160296 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:17.160668 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:17.160674 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:17.160678 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:17.161223 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:17.162246 (+ 1023us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:17.162482 (+ 236us) server_negotiation.cc:299] Negotiation successful
0807 08:40:17.162769 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":123,"threads_started":1}
I20260807 08:40:17.164606 15698 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:40:17.170001 15698 catalog_manager.cc:1347] Generated new cluster ID: 823e534d40b54b65a027caf24944f346
I20260807 08:40:17.170074 15698 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:40:17.181063 15698 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:40:17.182243 15698 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:40:17.185253 15698 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568: Generated new TSK 0
I20260807 08:40:17.185907 15698 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.8.208.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.208.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.208.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.193.keytab.
Entry for principal oryx/127.8.208.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.193.keytab.
I20260807 08:40:17.219113 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:35737
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.193.keytab
--principal=oryx/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:17.338514 15712 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:17.338785 15712 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:17.338860 15712 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:17.342845 15712 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:17.342929 15712 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:17.343014 15712 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:40:17.347988 15712 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.193.keytab
--principal=oryx/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:35737
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15712
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:17.348996 15712 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:17.350046 15712 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:17.359227 15717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:17.359262 15718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:17.359261 15720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:17.359457 15712 server_base.cc:1034] running on GCE node
I20260807 08:40:17.359954 15712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:17.360612 15712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:17.361781 15712 hybrid_clock.cc:648] HybridClock initialized: now 1786092017361749 us; error 38 us; skew 500 ppm
Aug 07 08:40:17 dist-test-slave-6nmv krb5kdc[15597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092017, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:17.364545 15712 init.cc:377] Logged in from keytab as oryx/127.8.208.193@KRBTEST.COM (short username oryx)
I20260807 08:40:17.365330 15712 webserver.cc:460] Webserver started at http://127.8.208.193:46799/ using document root <none> and password file <none>
I20260807 08:40:17.365942 15712 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:17.366006 15712 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:17.366236 15712 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:17.368099 15712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "7eaeed1bd2884ff1a20a897907db390f"
format_stamp: "Formatted at 2026-08-07 08:40:17 on dist-test-slave-6nmv"
server_key: "a534532d03c8eed5d859cb860a6cbd11"
server_key_iv: "b5703bfafa8b0ef54bd84409c7372533"
server_key_version: "encryptionkey@0"
I20260807 08:40:17.368606 15712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "7eaeed1bd2884ff1a20a897907db390f"
format_stamp: "Formatted at 2026-08-07 08:40:17 on dist-test-slave-6nmv"
server_key: "a534532d03c8eed5d859cb860a6cbd11"
server_key_iv: "b5703bfafa8b0ef54bd84409c7372533"
server_key_version: "encryptionkey@0"
I20260807 08:40:17.372002 15712 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260807 08:40:17.374238 15728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:17.375330 15712 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:40:17.375478 15712 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "7eaeed1bd2884ff1a20a897907db390f"
format_stamp: "Formatted at 2026-08-07 08:40:17 on dist-test-slave-6nmv"
server_key: "a534532d03c8eed5d859cb860a6cbd11"
server_key_iv: "b5703bfafa8b0ef54bd84409c7372533"
server_key_version: "encryptionkey@0"
I20260807 08:40:17.375607 15712 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:17.396046 15712 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:17.399545 15712 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:17.399746 15712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:17.400328 15712 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:17.401136 15712 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:17.401178 15712 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:17.401242 15712 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:17.401269 15712 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:17.409862 15712 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:39547
I20260807 08:40:17.409943 15849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:39547 every 8 connection(s)
I20260807 08:40:17.410738 15712 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:40:17.416041 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 15712
I20260807 08:40:17.416200 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
I20260807 08:40:17.416528 9027 external_mini_cluster.cc:1428] Setting key 8f1e790729e2c4fff273e1ac2046973b
Aug 07 08:40:17 dist-test-slave-6nmv krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092017, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM
I20260807 08:40:17.425470 15687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:17.412522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:50069 (local address 127.8.208.254:35737)
0807 08:40:17.412667 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:17.412672 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:17.413715 (+ 1043us) server_negotiation.cc:407] Connection header received
0807 08:40:17.414647 (+ 932us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:17.414649 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:17.414694 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:17.414767 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:17.415976 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:17.416583 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:17.418063 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:17.418279 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:17.418355 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:17.421562 (+ 3207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:17.421566 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:17.421569 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:17.421597 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:17.423182 (+ 1585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:17.423805 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:17.423807 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:17.423809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:17.423919 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:17.424328 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:17.424330 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:17.424331 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:17.424518 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:17.424604 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:17.425207 (+ 603us) server_negotiation.cc:299] Negotiation successful
0807 08:40:17.425315 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 08:40:17.426607 15852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:17.412952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.8.208.193:50069)
0807 08:40:17.413578 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:17.413617 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:17.414453 (+ 836us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:17.414937 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:17.414943 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:17.415270 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:17.415814 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:17.415837 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:17.416733 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:17.416738 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:17.417900 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:17.417911 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:17.418442 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:17.418448 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:17.418676 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:17.419284 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:17.419312 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:17.421351 (+ 2039us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:17.423299 (+ 1948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:17.423306 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:17.423320 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:17.423691 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:17.424024 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:17.424029 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:17.424034 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:17.424224 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:17.424633 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:17.424642 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:17.424954 (+ 312us) client_negotiation.cc:769] Sending connection context
0807 08:40:17.425163 (+ 209us) client_negotiation.cc:240] Negotiation successful
0807 08:40:17.425522 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":106,"threads_started":1}
WARNING: no policy specified for oryx/127.8.208.194@KRBTEST.COM; defaulting to no policy
I20260807 08:40:17.427989 15850 heartbeater.cc:347] Connected to a master server at 127.8.208.254:35737
I20260807 08:40:17.428290 15850 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:17.428747 15850 heartbeater.cc:511] Master 127.8.208.254:35737 requested a full tablet report, sending...
I20260807 08:40:17.430264 15646 ts_manager.cc:194] Registered new tserver with Master: 7eaeed1bd2884ff1a20a897907db390f (127.8.208.193:39547)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.208.194@KRBTEST.COM" created.
I20260807 08:40:17.431447 15646 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.208.193@KRBTEST.COM'} at 127.8.208.193:50069
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.208.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.194.keytab.
Entry for principal oryx/127.8.208.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.194.keytab.
I20260807 08:40:17.448516 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:35737
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.194.keytab
--principal=oryx/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:17.554247 15856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:17.554466 15856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:17.554504 15856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:17.558310 15856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:17.558355 15856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:17.558408 15856 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:40:17.563355 15856 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.194.keytab
--principal=oryx/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:35737
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15856
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:17.564168 15856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:17.564981 15856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:17.573776 15862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:17.573766 15865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:17.573871 15863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:17.574012 15856 server_base.cc:1034] running on GCE node
I20260807 08:40:17.574549 15856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:17.575111 15856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:17.576294 15856 hybrid_clock.cc:648] HybridClock initialized: now 1786092017576276 us; error 34 us; skew 500 ppm
Aug 07 08:40:17 dist-test-slave-6nmv krb5kdc[15597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092017, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:17.578979 15856 init.cc:377] Logged in from keytab as oryx/127.8.208.194@KRBTEST.COM (short username oryx)
I20260807 08:40:17.579881 15856 webserver.cc:460] Webserver started at http://127.8.208.194:35173/ using document root <none> and password file <none>
I20260807 08:40:17.580397 15856 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:17.580495 15856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:17.580746 15856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:17.582697 15856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "3ffd435e99a84e969eb52e5e8270697b"
format_stamp: "Formatted at 2026-08-07 08:40:17 on dist-test-slave-6nmv"
server_key: "073d4c157f8857bd639804e7f34b5c3b"
server_key_iv: "7e114c6d63adf9e075f62729e6367148"
server_key_version: "encryptionkey@0"
I20260807 08:40:17.583254 15856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "3ffd435e99a84e969eb52e5e8270697b"
format_stamp: "Formatted at 2026-08-07 08:40:17 on dist-test-slave-6nmv"
server_key: "073d4c157f8857bd639804e7f34b5c3b"
server_key_iv: "7e114c6d63adf9e075f62729e6367148"
server_key_version: "encryptionkey@0"
I20260807 08:40:17.586637 15856 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 08:40:17.588775 15872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:17.590293 15856 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:40:17.590535 15856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "3ffd435e99a84e969eb52e5e8270697b"
format_stamp: "Formatted at 2026-08-07 08:40:17 on dist-test-slave-6nmv"
server_key: "073d4c157f8857bd639804e7f34b5c3b"
server_key_iv: "7e114c6d63adf9e075f62729e6367148"
server_key_version: "encryptionkey@0"
I20260807 08:40:17.590679 15856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:17.611997 15856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:17.614385 15856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:17.614557 15856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:17.615044 15856 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:17.615775 15856 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:17.615845 15856 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:17.615923 15856 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:17.615963 15856 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:17.624123 15856 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:33125
I20260807 08:40:17.624151 15990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:33125 every 8 connection(s)
I20260807 08:40:17.624928 15856 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
Aug 07 08:40:17 dist-test-slave-6nmv krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092017, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM
I20260807 08:40:17.635061 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 15856
I20260807 08:40:17.635190 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:40:17.635550 9027 external_mini_cluster.cc:1428] Setting key 2d17663f55a27d9749b22ecdd9617611
I20260807 08:40:17.636459 15687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:17.626569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:46773 (local address 127.8.208.254:35737)
0807 08:40:17.626711 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:17.626714 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:17.627580 (+ 866us) server_negotiation.cc:407] Connection header received
0807 08:40:17.628290 (+ 710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:17.628292 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:17.628334 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:17.628405 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:17.629340 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:17.629791 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:17.630805 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:17.630985 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:17.631054 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:17.633055 (+ 2001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:17.633058 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:17.633060 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:17.633080 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:17.634340 (+ 1260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:17.634723 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:17.634725 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:17.634726 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:17.634792 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:17.635210 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:17.635216 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:17.635217 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:17.635458 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:17.635538 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:17.636190 (+ 652us) server_negotiation.cc:299] Negotiation successful
0807 08:40:17.636283 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 08:40:17.637241 15993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:17.626861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.8.208.194:46773)
0807 08:40:17.627448 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:17.627483 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:17.628137 (+ 654us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:17.628547 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:17.628552 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:17.628839 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:17.629226 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:17.629236 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:17.629931 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:17.629934 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:17.630707 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:17.630715 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:17.631098 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:17.631100 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:17.631215 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:17.631663 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:17.631677 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:17.632920 (+ 1243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:17.634433 (+ 1513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:17.634437 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:17.634445 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:17.634650 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:17.634900 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:17.634904 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:17.634909 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:17.635083 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:17.635630 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:17.635635 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:17.635930 (+ 295us) client_negotiation.cc:769] Sending connection context
0807 08:40:17.636106 (+ 176us) client_negotiation.cc:240] Negotiation successful
0807 08:40:17.636415 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":100,"threads_started":1}
I20260807 08:40:17.638199 15991 heartbeater.cc:347] Connected to a master server at 127.8.208.254:35737
I20260807 08:40:17.638393 15991 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:17.638783 15991 heartbeater.cc:511] Master 127.8.208.254:35737 requested a full tablet report, sending...
I20260807 08:40:17.639671 15646 ts_manager.cc:194] Registered new tserver with Master: 3ffd435e99a84e969eb52e5e8270697b (127.8.208.194:33125)
I20260807 08:40:17.640295 15646 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.208.194@KRBTEST.COM'} at 127.8.208.194:46773
WARNING: no policy specified for oryx/127.8.208.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.208.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.208.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.195.keytab.
Entry for principal oryx/127.8.208.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.195.keytab.
I20260807 08:40:17.660811 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:35737
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.195.keytab
--principal=oryx/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:17.759096 15997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:17.759359 15997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:17.759446 15997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:17.763660 15997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:17.763733 15997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:17.763819 15997 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:40:17.768587 15997 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.195.keytab
--principal=oryx/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:35737
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:17.769447 15997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:17.770275 15997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:17.779139 16006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:17.779132 16003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:17.779217 16004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:17.779498 15997 server_base.cc:1034] running on GCE node
I20260807 08:40:17.779886 15997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:17.780419 15997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:17.781594 15997 hybrid_clock.cc:648] HybridClock initialized: now 1786092017781585 us; error 27 us; skew 500 ppm
Aug 07 08:40:17 dist-test-slave-6nmv krb5kdc[15597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092017, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:17.784572 15997 init.cc:377] Logged in from keytab as oryx/127.8.208.195@KRBTEST.COM (short username oryx)
I20260807 08:40:17.785348 15997 webserver.cc:460] Webserver started at http://127.8.208.195:35651/ using document root <none> and password file <none>
I20260807 08:40:17.785914 15997 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:17.785979 15997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:17.786134 15997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:17.787822 15997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "9a888333f0be4ec0892844bec224461d"
format_stamp: "Formatted at 2026-08-07 08:40:17 on dist-test-slave-6nmv"
server_key: "9fc213ec2519926e17d2dd454ca5014b"
server_key_iv: "37d089ebc1d0870f717ff142c5303aae"
server_key_version: "encryptionkey@0"
I20260807 08:40:17.788281 15997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "9a888333f0be4ec0892844bec224461d"
format_stamp: "Formatted at 2026-08-07 08:40:17 on dist-test-slave-6nmv"
server_key: "9fc213ec2519926e17d2dd454ca5014b"
server_key_iv: "37d089ebc1d0870f717ff142c5303aae"
server_key_version: "encryptionkey@0"
I20260807 08:40:17.791456 15997 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 08:40:17.793586 16013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:17.794727 15997 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:17.794831 15997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "9a888333f0be4ec0892844bec224461d"
format_stamp: "Formatted at 2026-08-07 08:40:17 on dist-test-slave-6nmv"
server_key: "9fc213ec2519926e17d2dd454ca5014b"
server_key_iv: "37d089ebc1d0870f717ff142c5303aae"
server_key_version: "encryptionkey@0"
I20260807 08:40:17.794952 15997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:17.817096 15997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:17.819970 15997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:17.820150 15997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:17.820654 15997 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:17.821355 15997 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:17.821398 15997 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:17.821451 15997 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:17.821486 15997 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:17.830277 15997 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:41233
I20260807 08:40:17.830318 16133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:41233 every 8 connection(s)
I20260807 08:40:17.831063 15997 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:40:17.835983 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 15997
I20260807 08:40:17.836108 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:40:17.836375 9027 external_mini_cluster.cc:1428] Setting key b5e839c60f33b8443df8f76f668f2b61
Aug 07 08:40:17 dist-test-slave-6nmv krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092017, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM
I20260807 08:40:17.843058 15687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:17.832661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:35873 (local address 127.8.208.254:35737)
0807 08:40:17.832786 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:17.832789 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:17.833694 (+ 905us) server_negotiation.cc:407] Connection header received
0807 08:40:17.834514 (+ 820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:17.834517 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:17.834573 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:17.834671 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:17.835764 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:17.836404 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:17.837659 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:17.837957 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:17.838053 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:17.840153 (+ 2100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:17.840156 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:17.840158 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:17.840193 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:17.841376 (+ 1183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:17.841867 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:17.841870 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:17.841872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:17.841952 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:17.842252 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:17.842254 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:17.842255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:17.842419 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:17.842491 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:17.842860 (+ 369us) server_negotiation.cc:299] Negotiation successful
0807 08:40:17.842941 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 08:40:17.843719 16137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:17.833016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.8.208.195:35873)
0807 08:40:17.833564 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:17.833598 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:17.834329 (+ 731us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:17.834820 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:17.834826 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:17.835147 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:17.835600 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:17.835612 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:17.836535 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:17.836538 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:17.837535 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:17.837547 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:17.838081 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:17.838083 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:17.838267 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:17.838693 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:17.838706 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:17.839979 (+ 1273us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:17.841479 (+ 1500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:17.841483 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:17.841492 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:17.841736 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:17.842042 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:17.842044 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:17.842045 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:17.842180 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:17.842498 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:17.842502 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:17.842682 (+ 180us) client_negotiation.cc:769] Sending connection context
0807 08:40:17.842816 (+ 134us) client_negotiation.cc:240] Negotiation successful
0807 08:40:17.843024 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":101,"threads_started":1}
I20260807 08:40:17.844695 16134 heartbeater.cc:347] Connected to a master server at 127.8.208.254:35737
I20260807 08:40:17.844910 16134 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:17.845337 16134 heartbeater.cc:511] Master 127.8.208.254:35737 requested a full tablet report, sending...
I20260807 08:40:17.846333 15646 ts_manager.cc:194] Registered new tserver with Master: 9a888333f0be4ec0892844bec224461d (127.8.208.195:41233)
I20260807 08:40:17.846885 15646 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.208.195@KRBTEST.COM'} at 127.8.208.195:35873
I20260807 08:40:17.849929 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.8.208.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.208.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.208.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.253.keytab.
Entry for principal oryx/127.8.208.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.253.keytab.
I20260807 08:40:17.874898 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.253:32955
--webserver_interface=127.8.208.253
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.253.keytab
--principal=oryx/127.8.208.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:35737,127.8.208.253:32955
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:17.977804 16140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:17.978086 16140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:17.978157 16140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:17.982213 16140 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:40:17.982257 16140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:17.982275 16140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:17.982311 16140 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:40:17.982340 16140 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:40:17.987277 16140 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:35737,127.8.208.253:32955
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.253.keytab
--principal=oryx/127.8.208.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.253:32955
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.208.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
W20260807 08:40:17.987448 16140 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.8.208.254:35737,127.8.208.253:32955'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 08:40:17.988147 16140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:17.989043 16140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:17.996662 16150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:17.996682 16148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:17.996851 16140 server_base.cc:1034] running on GCE node
W20260807 08:40:17.997023 16147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:17.997539 16140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:17.998608 16140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:17.999755 16140 hybrid_clock.cc:648] HybridClock initialized: now 1786092017999737 us; error 28 us; skew 500 ppm
Aug 07 08:40:17 dist-test-slave-6nmv krb5kdc[15597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092017, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:18.002054 16140 init.cc:377] Logged in from keytab as oryx/127.8.208.253@KRBTEST.COM (short username oryx)
I20260807 08:40:18.002895 16140 webserver.cc:460] Webserver started at http://127.8.208.253:45455/ using document root <none> and password file <none>
I20260807 08:40:18.003386 16140 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:18.003480 16140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:18.003664 16140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:18.005406 16140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/data/instance:
uuid: "bb0067b7a44f41bb9ce80d4797ec363b"
format_stamp: "Formatted at 2026-08-07 08:40:18 on dist-test-slave-6nmv"
server_key: "c5cd30f756e2cf352781e5ac4e5edaff"
server_key_iv: "d07211cc8d9d30075411a53865da84b5"
server_key_version: "encryptionkey@0"
I20260807 08:40:18.006028 16140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/wal/instance:
uuid: "bb0067b7a44f41bb9ce80d4797ec363b"
format_stamp: "Formatted at 2026-08-07 08:40:18 on dist-test-slave-6nmv"
server_key: "c5cd30f756e2cf352781e5ac4e5edaff"
server_key_iv: "d07211cc8d9d30075411a53865da84b5"
server_key_version: "encryptionkey@0"
I20260807 08:40:18.009305 16140 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 08:40:18.011540 16157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:18.012629 16140 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 08:40:18.012758 16140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/wal
uuid: "bb0067b7a44f41bb9ce80d4797ec363b"
format_stamp: "Formatted at 2026-08-07 08:40:18 on dist-test-slave-6nmv"
server_key: "c5cd30f756e2cf352781e5ac4e5edaff"
server_key_iv: "d07211cc8d9d30075411a53865da84b5"
server_key_version: "encryptionkey@0"
I20260807 08:40:18.012854 16140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:18.030237 16140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:18.032667 16140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:18.032858 16140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:18.039068 16140 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.253:32955
I20260807 08:40:18.039309 16214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.253:32955 every 8 connection(s)
I20260807 08:40:18.039896 16140 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/data/info.pb
I20260807 08:40:18.042268 16215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:18.047042 16215 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } has no permanent_uuid. Determining permanent_uuid...
I20260807 08:40:18.050221 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 16140
Aug 07 08:40:18 dist-test-slave-6nmv krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092017, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.253@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM
Aug 07 08:40:18 dist-test-slave-6nmv krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.208.253@KRBTEST.COM
I20260807 08:40:18.060425 15687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.049239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40242 (local address 127.8.208.254:35737)
0807 08:40:18.049355 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:18.049359 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:18.050050 (+ 691us) server_negotiation.cc:407] Connection header received
0807 08:40:18.051640 (+ 1590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:18.051643 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:18.051714 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:18.051806 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:18.052536 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.053030 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.053917 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.054122 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.054219 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.056592 (+ 2373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:18.056595 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:18.056597 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:18.056633 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:18.058229 (+ 1596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.058716 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.058719 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.058720 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.058817 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.059194 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.059197 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.059199 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.059481 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:18.059592 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:18.060098 (+ 506us) server_negotiation.cc:299] Negotiation successful
0807 08:40:18.060249 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 08:40:18.061069 16217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.049316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.0.0.1:40242)
0807 08:40:18.049840 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:18.049891 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:18.051450 (+ 1559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:18.051849 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:18.051857 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:18.052153 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:18.052397 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.052407 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.053148 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.053151 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.053774 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.053782 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.054247 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.054251 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.054403 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.054884 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:18.054902 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:18.056417 (+ 1515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:18.058324 (+ 1907us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.058330 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.058335 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.058621 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.058902 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.058907 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.058911 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.059071 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.059607 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:18.059611 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:18.059855 (+ 244us) client_negotiation.cc:769] Sending connection context
0807 08:40:18.060039 (+ 184us) client_negotiation.cc:240] Negotiation successful
0807 08:40:18.060314 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":132,"threads_started":1}
I20260807 08:40:18.061076 16219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.051006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40232 (local address 127.8.208.253:32955)
0807 08:40:18.051383 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:18.051393 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:18.051428 (+ 35us) server_negotiation.cc:407] Connection header received
0807 08:40:18.051564 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:18.051576 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:18.051749 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:18.051919 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:18.052658 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.053401 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.054195 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.054499 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.054600 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.057070 (+ 2470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:18.057077 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:18.057091 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:18.057112 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:18.058749 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.059202 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.059208 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.059210 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.059277 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.059555 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.059561 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.059564 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.059825 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:18.060027 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:18.060178 (+ 151us) server_negotiation.cc:299] Negotiation successful
0807 08:40:18.060386 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":81,"server-negotiator.queue_time_us":289,"spinlock_wait_cycles":4992,"thread_start_us":142,"threads_started":1}
I20260807 08:40:18.062202 16215 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 08:40:18 dist-test-slave-6nmv krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092017, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.253@KRBTEST.COM for oryx/127.8.208.253@KRBTEST.COM
I20260807 08:40:18.068475 16217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.062566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:32955 (local address 127.0.0.1:40236)
0807 08:40:18.062633 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:18.062645 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:18.062702 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:18.062903 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:18.062906 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:18.063063 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:18.063144 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.063148 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.063696 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.063698 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.064099 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.064106 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.064472 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.064474 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.064535 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.064872 (+ 337us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:18.064882 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:18.066036 (+ 1154us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:18.067557 (+ 1521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.067559 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.067560 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.067704 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.067898 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.067900 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.067901 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.067967 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.068190 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:18.068192 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:18.068250 (+ 58us) client_negotiation.cc:769] Sending connection context
0807 08:40:18.068314 (+ 64us) client_negotiation.cc:240] Negotiation successful
0807 08:40:18.068394 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260807 08:40:18.068569 16219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.062609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40236 (local address 127.8.208.253:32955)
0807 08:40:18.062694 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:18.062697 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:18.062709 (+ 12us) server_negotiation.cc:407] Connection header received
0807 08:40:18.062773 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:18.062775 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:18.062808 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:18.062874 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:18.063217 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.063611 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.064181 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.064362 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.064456 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.066152 (+ 1696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:18.066154 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:18.066156 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:18.066176 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:18.067479 (+ 1303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.067771 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.067773 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.067774 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.067833 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.068015 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.068016 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.068017 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.068128 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:18.068185 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:18.068338 (+ 153us) server_negotiation.cc:299] Negotiation successful
0807 08:40:18.068441 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":37}
I20260807 08:40:18.071139 16215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b: Bootstrap starting.
I20260807 08:40:18.073149 16215 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:18.073804 16215 log.cc:824] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:18.075397 16215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b: No bootstrap required, opened a new log
I20260807 08:40:18.078179 16215 raft_consensus.cc:348] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } }
I20260807 08:40:18.078380 16215 raft_consensus.cc:374] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:18.078452 16215 raft_consensus.cc:729] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb0067b7a44f41bb9ce80d4797ec363b, State: Initialized, Role: FOLLOWER
I20260807 08:40:18.078881 16215 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } }
I20260807 08:40:18.079319 16221 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } } }
I20260807 08:40:18.079486 16221 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:40:18.080041 16215 sys_catalog.cc:564] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [sys.catalog]: configured and running, proceeding with master startup.
W20260807 08:40:18.084997 16232 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:40:18.085076 16232 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:40:18.086694 16140 master_runner.cc:428] Detected that this master bb0067b7a44f41bb9ce80d4797ec363b is joining an existing cluster
I20260807 08:40:18.086786 16140 master_runner.cc:432] Initiating AddMaster RPC to add 127.8.208.253:32955
I20260807 08:40:18.097043 15687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.088645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40246 (local address 127.8.208.254:35737)
0807 08:40:18.088756 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:18.088760 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:18.089005 (+ 245us) server_negotiation.cc:407] Connection header received
0807 08:40:18.089193 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:18.089196 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:18.089241 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:18.089294 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:18.089844 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.090335 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.091449 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.091803 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.091873 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.093413 (+ 1540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:18.093417 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:18.093420 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:18.093445 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:18.095233 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.095734 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.095738 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.095740 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.095830 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.096140 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.096145 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.096150 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.096360 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:18.096434 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:18.096816 (+ 382us) server_negotiation.cc:299] Negotiation successful
0807 08:40:18.096919 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 08:40:18.097070 16238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.088581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.0.0.1:40246)
0807 08:40:18.088913 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:18.088927 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:18.089068 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:18.089333 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:18.089336 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:18.089550 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:18.089682 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.089689 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.090443 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.090447 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.091310 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.091319 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.092025 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.092030 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.092140 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.092747 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:18.092758 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:18.093246 (+ 488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:18.095336 (+ 2090us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.095342 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.095343 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.095658 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.095930 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.095933 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.095935 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.096025 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.096509 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:18.096511 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:18.096621 (+ 110us) client_negotiation.cc:769] Sending connection context
0807 08:40:18.096761 (+ 140us) client_negotiation.cc:240] Negotiation successful
0807 08:40:18.096882 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"mutex_wait_us":59,"thread_start_us":78,"threads_started":1}
I20260807 08:40:18.097213 16219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.088654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40246 (local address 127.8.208.253:32955)
0807 08:40:18.088737 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:18.088741 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:18.089080 (+ 339us) server_negotiation.cc:407] Connection header received
0807 08:40:18.089368 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:18.089370 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:18.089395 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:18.089467 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:18.089902 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.090566 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.091551 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.091875 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.091956 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.093900 (+ 1944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:18.093903 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:18.093906 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:18.093928 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:18.095548 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.096021 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.096025 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.096026 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.096096 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.096388 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.096394 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.096408 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.096620 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:18.096729 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:18.096984 (+ 255us) server_negotiation.cc:299] Negotiation successful
0807 08:40:18.097093 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":27}
I20260807 08:40:18.097672 16239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.088751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:32955 (local address 127.0.0.1:40246)
0807 08:40:18.088990 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:18.089003 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:18.089115 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:18.089479 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:18.089481 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:18.089651 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:18.089734 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.089739 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.090672 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.090675 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.091463 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.091470 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.092085 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.092088 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.092172 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.093422 (+ 1250us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:18.093439 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:18.093703 (+ 264us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:18.095662 (+ 1959us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.095666 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.095668 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.095911 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.096187 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.096190 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.096192 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.096284 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.096735 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:18.096738 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:18.096821 (+ 83us) client_negotiation.cc:769] Sending connection context
0807 08:40:18.097400 (+ 579us) client_negotiation.cc:240] Negotiation successful
0807 08:40:18.097526 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":1,"thread_start_us":108,"threads_started":1}
Aug 07 08:40:18 dist-test-slave-6nmv krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092017, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.254@KRBTEST.COM for oryx/127.8.208.253@KRBTEST.COM
I20260807 08:40:18.110105 16219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.101147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40252 (local address 127.8.208.253:32955)
0807 08:40:18.101251 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:18.101255 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:18.102201 (+ 946us) server_negotiation.cc:407] Connection header received
0807 08:40:18.102367 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:18.102369 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:18.102409 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:18.102470 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:18.103148 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.103581 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.104763 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.104950 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.105015 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.107205 (+ 2190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:18.107208 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:18.107210 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:18.107230 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:18.108518 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.108981 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.108986 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.108987 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.109061 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.109314 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.109318 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.109320 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.109472 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:18.109570 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:18.109886 (+ 316us) server_negotiation.cc:299] Negotiation successful
0807 08:40:18.109984 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 08:40:18.110157 16240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.101102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:32955 (local address 127.0.0.1:40252)
0807 08:40:18.102070 (+ 968us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:18.102126 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:18.102262 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:18.102526 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:18.102532 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:18.102931 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:18.103044 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.103051 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.103676 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.103680 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.104630 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.104641 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.105045 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.105048 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.105152 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.105638 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:18.105658 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:18.107082 (+ 1424us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:18.108634 (+ 1552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.108644 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.108648 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.108880 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.109148 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.109151 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.109152 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.109231 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.109573 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:18.109581 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:18.109683 (+ 102us) client_negotiation.cc:769] Sending connection context
0807 08:40:18.109809 (+ 126us) client_negotiation.cc:240] Negotiation successful
0807 08:40:18.110010 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":805,"thread_start_us":77,"threads_started":1}
I20260807 08:40:18.111230 15646 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.8.208.253:32955: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b"
member_type: NON_VOTER
last_known_addr {
host: "127.8.208.253"
port: 32955
}
attrs {
promote: true
}
}
dest_uuid: "1da71c42e9a941adbd04972d66e00568"
cas_config_opid_index: -1
I20260807 08:40:18.111815 15646 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: NON_VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: true } }
I20260807 08:40:18.113229 16243 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER bb0067b7a44f41bb9ce80d4797ec363b (127.8.208.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: NON_VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: true } } }
I20260807 08:40:18.113860 16187 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:18.114686 16243 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.8.208.253:32955
I20260807 08:40:18.115016 16140 master.cc:537] Master@127.8.208.253:32955 shutting down...
I20260807 08:40:18.115031 16241 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1da71c42e9a941adbd04972d66e00568" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: NON_VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: true } } }
I20260807 08:40:18.115067 16187 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [term 1 FOLLOWER]: Refusing update from remote peer 1da71c42e9a941adbd04972d66e00568: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 08:40:18.115115 16241 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:18.118072 16241 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: NON_VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:40:18.119843 16140 raft_consensus.cc:2229] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [term 1 FOLLOWER]: Raft consensus shutting down.
W20260807 08:40:18.119866 15629 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260807 08:40:18.120043 16140 raft_consensus.cc:2258] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:18.120131 16140 tablet_replica.cc:330] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b: stopping tablet replica
W20260807 08:40:18.120683 15629 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 -> Peer bb0067b7a44f41bb9ce80d4797ec363b (127.8.208.253:32955): Couldn't send request to peer bb0067b7a44f41bb9ce80d4797ec363b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
WARNING: no policy specified for oryx/127.8.208.252@KRBTEST.COM; defaulting to no policy
I20260807 08:40:18.135150 16140 master.cc:552] Master@127.8.208.253:32955 shutdown complete.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.208.252@KRBTEST.COM" created.
I20260807 08:40:18.135210 16140 master_runner.cc:305] Clearing existing system tablet
I20260807 08:40:18.135430 16140 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:18.135504 16140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:18.136999 16140 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 08:40:18.138190 16249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:18.138437 16140 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:18.138550 16140 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 08:40:18.138581 16140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/wal
uuid: "bb0067b7a44f41bb9ce80d4797ec363b"
format_stamp: "Formatted at 2026-08-07 08:40:18 on dist-test-slave-6nmv"
server_key: "c5cd30f756e2cf352781e5ac4e5edaff"
server_key_iv: "d07211cc8d9d30075411a53865da84b5"
server_key_version: "encryptionkey@0"
I20260807 08:40:18.140489 16140 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:18.142591 16140 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 08:40:18.142671 16140 log.cc:1196] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260807 08:40:18.142881 16140 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b: Deleting consensus metadata
I20260807 08:40:18.143028 16140 master_runner.cc:315] Copying system tablet from 127.8.208.254:35737
I20260807 08:40:18.143946 16140 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.208.254:35737
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.208.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.252.keytab.
Entry for principal oryx/127.8.208.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.252.keytab.
I20260807 08:40:18.151419 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.252:34643
--webserver_interface=127.8.208.252
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.252.keytab
--principal=oryx/127.8.208.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:35737,127.8.208.253:32955,127.8.208.252:34643
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 08:40:18.153543 16255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.144484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.0.0.1:40252)
0807 08:40:18.144735 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:18.144747 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:18.144872 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:18.145180 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:18.145183 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:18.145367 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:18.145561 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.145568 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.146633 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.146637 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.147609 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.147619 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.148419 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.148423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.148521 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.149015 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:18.149028 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:18.149479 (+ 451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:18.151914 (+ 2435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.151917 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.151920 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.152152 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.152464 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.152467 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.152470 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.152549 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.153024 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:18.153027 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:18.153113 (+ 86us) client_negotiation.cc:769] Sending connection context
0807 08:40:18.153219 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 08:40:18.153373 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":83,"threads_started":1}
I20260807 08:40:18.153571 15687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.144574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40252 (local address 127.8.208.254:35737)
0807 08:40:18.144707 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:18.144712 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:18.144810 (+ 98us) server_negotiation.cc:407] Connection header received
0807 08:40:18.145003 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:18.145006 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:18.145056 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:18.145151 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:18.145672 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.146491 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.147728 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.148129 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.148227 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.149616 (+ 1389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:18.149620 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:18.149622 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:18.149646 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:18.151787 (+ 2141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.152276 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.152280 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.152282 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.152361 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.152645 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.152648 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.152649 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.152851 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:18.152933 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:18.153317 (+ 384us) server_negotiation.cc:299] Negotiation successful
0807 08:40:18.153436 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 08:40:18.154299 15666 tablet_copy_service.cc:140] P 1da71c42e9a941adbd04972d66e00568: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer bb0067b7a44f41bb9ce80d4797ec363b ({username='oryx', principal='oryx/127.8.208.253@KRBTEST.COM'} at 127.0.0.1:40252)
I20260807 08:40:18.154484 15666 tablet_copy_service.cc:161] P 1da71c42e9a941adbd04972d66e00568: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer bb0067b7a44f41bb9ce80d4797ec363b at {username='oryx', principal='oryx/127.8.208.253@KRBTEST.COM'} at 127.0.0.1:40252: session id = bb0067b7a44f41bb9ce80d4797ec363b-00000000000000000000000000000000
I20260807 08:40:18.155988 15666 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 08:40:18.157523 16140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 08:40:18.159619 16140 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b: tablet copy: Starting download of 0 data blocks...
I20260807 08:40:18.159785 16140 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b: tablet copy: Starting download of 1 WAL segments...
I20260807 08:40:18.161509 16140 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 08:40:18.163902 15666 tablet_copy_service.cc:342] P 1da71c42e9a941adbd04972d66e00568: Request end of tablet copy session bb0067b7a44f41bb9ce80d4797ec363b-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.8.208.253@KRBTEST.COM'} at 127.0.0.1:40252
I20260807 08:40:18.164016 15666 tablet_copy_service.cc:433] P 1da71c42e9a941adbd04972d66e00568: ending tablet copy session bb0067b7a44f41bb9ce80d4797ec363b-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer bb0067b7a44f41bb9ce80d4797ec363b
I20260807 08:40:18.171555 16140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:18.173298 16260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:18.173472 16257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:18.173749 16258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:18.173758 16140 server_base.cc:1034] running on GCE node
I20260807 08:40:18.174088 16140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:18.174371 16140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:18.175518 16140 hybrid_clock.cc:648] HybridClock initialized: now 1786092018175513 us; error 43 us; skew 500 ppm
Aug 07 08:40:18 dist-test-slave-6nmv krb5kdc[15597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092018, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:18.177141 16140 init.cc:377] Logged in from keytab as oryx/127.8.208.253@KRBTEST.COM (short username oryx)
I20260807 08:40:18.177580 16140 webserver.cc:460] Webserver started at http://127.8.208.253:33051/ using document root <none> and password file <none>
I20260807 08:40:18.177755 16140 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:18.177796 16140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:18.179096 16140 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 08:40:18.180068 16267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:18.180332 16140 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 08:40:18.180405 16140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/wal
uuid: "bb0067b7a44f41bb9ce80d4797ec363b"
format_stamp: "Formatted at 2026-08-07 08:40:18 on dist-test-slave-6nmv"
server_key: "c5cd30f756e2cf352781e5ac4e5edaff"
server_key_iv: "d07211cc8d9d30075411a53865da84b5"
server_key_version: "encryptionkey@0"
I20260807 08:40:18.180481 16140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:18.187451 16140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:18.189452 16140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:18.194232 16140 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.253:32955
I20260807 08:40:18.194917 16140 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-1/data/info.pb
I20260807 08:40:18.196743 16324 sys_catalog.cc:263] Verifying existing consensus state
I20260807 08:40:18.197747 16324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b: Bootstrap starting.
I20260807 08:40:18.198237 16323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.253:32955 every 8 connection(s)
I20260807 08:40:18.207576 16324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 08:40:18.207957 16324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b: Bootstrap complete.
I20260807 08:40:18.208565 16324 raft_consensus.cc:348] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: NON_VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: true } }
I20260807 08:40:18.208796 16324 raft_consensus.cc:729] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bb0067b7a44f41bb9ce80d4797ec363b, State: Initialized, Role: LEARNER
I20260807 08:40:18.208985 16324 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: NON_VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: true } }
I20260807 08:40:18.209436 16328 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: NON_VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: true } } }
I20260807 08:40:18.209547 16328 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [sys.catalog]: This master's current role is: LEARNER
I20260807 08:40:18.209715 16324 sys_catalog.cc:564] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:40:18.212888 16339 catalog_manager.cc:1259] Loaded cluster ID: 823e534d40b54b65a027caf24944f346
I20260807 08:40:18.212950 16339 catalog_manager.cc:1552] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b: loading cluster ID for follower catalog manager: success
I20260807 08:40:18.214931 16339 catalog_manager.cc:1574] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b: acquiring CA information for follower catalog manager: success
I20260807 08:40:18.216265 16339 catalog_manager.cc:1602] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 08:40:18.273360 16256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:18.273597 16256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:18.273659 16256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:18.277493 16256 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:40:18.277566 16256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:18.277601 16256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:18.277632 16256 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:40:18.277663 16256 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:40:18.282455 16256 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:35737,127.8.208.253:32955,127.8.208.252:34643
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.252.keytab
--principal=oryx/127.8.208.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.252:34643
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.208.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:18.283260 16256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:18.284230 16256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:18.291961 16347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:18.292006 16344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:18.291970 16345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:18.292310 16256 server_base.cc:1034] running on GCE node
I20260807 08:40:18.292841 16256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:18.293757 16256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:18.294946 16256 hybrid_clock.cc:648] HybridClock initialized: now 1786092018294928 us; error 28 us; skew 500 ppm
Aug 07 08:40:18 dist-test-slave-6nmv krb5kdc[15597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092018, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:18.297614 16256 init.cc:377] Logged in from keytab as oryx/127.8.208.252@KRBTEST.COM (short username oryx)
I20260807 08:40:18.298559 16256 webserver.cc:460] Webserver started at http://127.8.208.252:39331/ using document root <none> and password file <none>
I20260807 08:40:18.299216 16256 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:18.299310 16256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:18.299559 16256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:18.301440 16256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/data/instance:
uuid: "3a23667e3d3343d283b0dffb86ed369c"
format_stamp: "Formatted at 2026-08-07 08:40:18 on dist-test-slave-6nmv"
server_key: "48fc37acffe2bbdf94a3a6abc4441d01"
server_key_iv: "510f1f9e4558f6562590c62ebb2118a9"
server_key_version: "encryptionkey@0"
I20260807 08:40:18.302055 16256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/wal/instance:
uuid: "3a23667e3d3343d283b0dffb86ed369c"
format_stamp: "Formatted at 2026-08-07 08:40:18 on dist-test-slave-6nmv"
server_key: "48fc37acffe2bbdf94a3a6abc4441d01"
server_key_iv: "510f1f9e4558f6562590c62ebb2118a9"
server_key_version: "encryptionkey@0"
I20260807 08:40:18.305605 16256 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 08:40:18.307906 16355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:18.309042 16256 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:18.309183 16256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/wal
uuid: "3a23667e3d3343d283b0dffb86ed369c"
format_stamp: "Formatted at 2026-08-07 08:40:18 on dist-test-slave-6nmv"
server_key: "48fc37acffe2bbdf94a3a6abc4441d01"
server_key_iv: "510f1f9e4558f6562590c62ebb2118a9"
server_key_version: "encryptionkey@0"
I20260807 08:40:18.309281 16256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:18.333624 16256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:18.336202 16256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:18.336410 16256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:18.342942 16256 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.252:34643
I20260807 08:40:18.343207 16409 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.252:34643 every 8 connection(s)
I20260807 08:40:18.344014 16256 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/data/info.pb
I20260807 08:40:18.346553 16411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:18.349944 16411 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } has no permanent_uuid. Determining permanent_uuid...
I20260807 08:40:18.350921 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 16256
Aug 07 08:40:18 dist-test-slave-6nmv krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092018, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.252@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM
Aug 07 08:40:18 dist-test-slave-6nmv krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.208.252@KRBTEST.COM
I20260807 08:40:18.363226 15687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.351704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40256 (local address 127.8.208.254:35737)
0807 08:40:18.351838 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:18.351843 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:18.352536 (+ 693us) server_negotiation.cc:407] Connection header received
0807 08:40:18.353338 (+ 802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:18.353341 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:18.353404 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:18.353486 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:18.354460 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.355219 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.356514 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.356851 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.356954 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.359544 (+ 2590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:18.359547 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:18.359549 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:18.359570 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:18.361171 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.361740 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.361742 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.361743 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.361878 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.362224 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.362229 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.362230 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.362406 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:18.362515 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:18.362963 (+ 448us) server_negotiation.cc:299] Negotiation successful
0807 08:40:18.363075 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 08:40:18.364068 16414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.351962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58076 (local address 127.8.208.252:34643)
0807 08:40:18.352419 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:18.352432 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:18.352464 (+ 32us) server_negotiation.cc:407] Connection header received
0807 08:40:18.353121 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:18.353135 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:18.353348 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:18.353512 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:18.354380 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.355499 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.356641 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.357128 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.357205 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.360014 (+ 2809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:18.360019 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:18.360027 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:18.360058 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:18.361633 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.362194 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.362200 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.362202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.362290 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.362602 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.362606 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.362608 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.362838 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:18.363070 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:18.363281 (+ 211us) server_negotiation.cc:299] Negotiation successful
0807 08:40:18.363413 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"spinlock_wait_cycles":22272,"thread_start_us":189,"threads_started":1}
I20260807 08:40:18.364071 16413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.351961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.0.0.1:40256)
0807 08:40:18.352378 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:18.352422 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:18.353136 (+ 714us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:18.353549 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:18.353554 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:18.353983 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:18.354315 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.354335 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.355332 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.355334 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.356385 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.356396 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.356994 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.356999 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.357129 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.357633 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:18.357653 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:18.359362 (+ 1709us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:18.361291 (+ 1929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.361298 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.361305 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.361640 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.361987 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.361990 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.361991 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.362125 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.362525 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:18.362533 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:18.362742 (+ 209us) client_negotiation.cc:769] Sending connection context
0807 08:40:18.362920 (+ 178us) client_negotiation.cc:240] Negotiation successful
0807 08:40:18.363181 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":127,"threads_started":1}
I20260807 08:40:18.365214 16411 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 08:40:18 dist-test-slave-6nmv krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092018, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.252@KRBTEST.COM for oryx/127.8.208.253@KRBTEST.COM
I20260807 08:40:18.372288 16413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.365683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:32955 (local address 127.0.0.1:40256)
0807 08:40:18.365776 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:18.365789 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:18.365886 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:18.366294 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:18.366296 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:18.366462 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:18.366543 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.366548 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.367356 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.367358 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.367775 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.367781 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.368136 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.368137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.368195 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.368593 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:18.368603 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:18.369653 (+ 1050us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:18.371126 (+ 1473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.371129 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.371130 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.371307 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.371530 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.371532 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.371533 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.371598 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.371969 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:18.371971 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:18.372037 (+ 66us) client_negotiation.cc:769] Sending connection context
0807 08:40:18.372114 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 08:40:18.372196 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260807 08:40:18.372393 16415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.365783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40256 (local address 127.8.208.253:32955)
0807 08:40:18.366093 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:18.366096 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:18.366109 (+ 13us) server_negotiation.cc:407] Connection header received
0807 08:40:18.366147 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:18.366149 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:18.366188 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:18.366268 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:18.366674 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.367271 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.367862 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.368053 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.368121 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.369778 (+ 1657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:18.369781 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:18.369783 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:18.369806 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:18.371031 (+ 1225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.371377 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.371379 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.371380 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.371454 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.371705 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.371707 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.371709 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.371882 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:18.371966 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:18.372148 (+ 182us) server_negotiation.cc:299] Negotiation successful
0807 08:40:18.372244 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":98,"threads_started":1}
I20260807 08:40:18.373086 16411 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34643 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 08:40:18 dist-test-slave-6nmv krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092018, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.252@KRBTEST.COM for oryx/127.8.208.252@KRBTEST.COM
I20260807 08:40:18.380111 16413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.373511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:34643 (local address 127.0.0.1:58092)
0807 08:40:18.373663 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:18.373677 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:18.373756 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:18.373982 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:18.373985 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:18.374140 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:18.374189 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.374194 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.374878 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.374883 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.375345 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.375351 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.375799 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.375803 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.375879 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.376300 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:18.376310 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:18.377382 (+ 1072us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:18.379017 (+ 1635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.379019 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.379021 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.379225 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.379449 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.379451 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.379452 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.379533 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.379816 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:18.379818 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:18.379879 (+ 61us) client_negotiation.cc:769] Sending connection context
0807 08:40:18.379948 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 08:40:18.380023 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":1}
I20260807 08:40:18.380234 16414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.373555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58092 (local address 127.8.208.252:34643)
0807 08:40:18.373663 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:18.373668 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:18.373720 (+ 52us) server_negotiation.cc:407] Connection header received
0807 08:40:18.373843 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:18.373846 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:18.373883 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:18.373973 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:18.374311 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.374777 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.375459 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.375697 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.375802 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.377523 (+ 1721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:18.377525 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:18.377527 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:18.377547 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:18.378918 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.379301 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.379303 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.379304 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.379369 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.379606 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.379608 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.379609 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.379743 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:18.379811 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:18.380008 (+ 197us) server_negotiation.cc:299] Negotiation successful
0807 08:40:18.380111 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 08:40:18.383042 16411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c: Bootstrap starting.
I20260807 08:40:18.385141 16411 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:18.385893 16411 log.cc:824] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:18.387566 16411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c: No bootstrap required, opened a new log
I20260807 08:40:18.390021 16411 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34643 } }
I20260807 08:40:18.390170 16411 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:18.390232 16411 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a23667e3d3343d283b0dffb86ed369c, State: Initialized, Role: FOLLOWER
I20260807 08:40:18.390596 16411 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34643 } }
I20260807 08:40:18.391002 16417 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34643 } } }
I20260807 08:40:18.391153 16417 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:40:18.391566 16411 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [sys.catalog]: configured and running, proceeding with master startup.
W20260807 08:40:18.395771 16429 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:40:18.395884 16429 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:40:18.398772 16256 master_runner.cc:428] Detected that this master 3a23667e3d3343d283b0dffb86ed369c is joining an existing cluster
I20260807 08:40:18.398826 16256 master_runner.cc:432] Initiating AddMaster RPC to add 127.8.208.252:34643
I20260807 08:40:18.409125 15687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.400924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40270 (local address 127.8.208.254:35737)
0807 08:40:18.401030 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:18.401035 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:18.401697 (+ 662us) server_negotiation.cc:407] Connection header received
0807 08:40:18.401825 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:18.401828 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:18.401873 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:18.401941 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:18.402536 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.403227 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.404409 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.404721 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.404801 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.406301 (+ 1500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:18.406304 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:18.406305 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:18.406326 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:18.407732 (+ 1406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.408158 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.408160 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.408161 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.408226 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.408500 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.408502 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.408503 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.408654 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:18.408720 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:18.408952 (+ 232us) server_negotiation.cc:299] Negotiation successful
0807 08:40:18.409028 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 08:40:18.409188 16435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.400888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.0.0.1:40270)
0807 08:40:18.401619 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:18.401634 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:18.401728 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:18.402050 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:18.402053 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:18.402281 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:18.402398 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.402405 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.403358 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.403361 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.404283 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.404292 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.404962 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.404965 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.405091 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.405638 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:18.405654 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:18.406100 (+ 446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:18.407835 (+ 1735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.407839 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.407841 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.408065 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.408307 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.408309 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.408311 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.408401 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.408736 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:18.408739 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:18.408822 (+ 83us) client_negotiation.cc:769] Sending connection context
0807 08:40:18.408924 (+ 102us) client_negotiation.cc:240] Negotiation successful
0807 08:40:18.409037 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":671,"mutex_wait_us":23,"thread_start_us":83,"threads_started":1}
I20260807 08:40:18.417088 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 15712
Aug 07 08:40:18 dist-test-slave-6nmv krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092017, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.254@KRBTEST.COM for oryx/127.8.208.252@KRBTEST.COM
I20260807 08:40:18.427376 16437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.400888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:32955 (local address 127.0.0.1:40268)
0807 08:40:18.401546 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:18.401558 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:18.401648 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:18.402000 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:18.402005 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:18.402246 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:18.402398 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.402407 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.403369 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.403373 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.404447 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.404457 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.405130 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.405133 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.405230 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.423184 (+ 17954us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:18.423198 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:18.423637 (+ 439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:18.425563 (+ 1926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.425567 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.425570 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.425886 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.426226 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.426229 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.426231 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.426325 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.426811 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:18.426814 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:18.426908 (+ 94us) client_negotiation.cc:769] Sending connection context
0807 08:40:18.427016 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 08:40:18.427170 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"mutex_wait_us":102,"thread_start_us":112,"threads_started":1}
I20260807 08:40:18.427930 16415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.401283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40268 (local address 127.8.208.253:32955)
0807 08:40:18.401393 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:18.401398 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:18.401639 (+ 241us) server_negotiation.cc:407] Connection header received
0807 08:40:18.401746 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:18.401752 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:18.401800 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:18.401884 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:18.402527 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.403252 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.404571 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.404900 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.404970 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.423781 (+ 18811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:18.423786 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:18.423789 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:18.423814 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:18.425412 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.426023 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.426027 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.426029 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.426114 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.426431 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.426434 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.426436 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.426672 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:18.426773 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:18.427650 (+ 877us) server_negotiation.cc:299] Negotiation successful
0807 08:40:18.427778 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 08:40:18.428025 16414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.401321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58104 (local address 127.8.208.252:34643)
0807 08:40:18.401422 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:18.401427 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:18.401995 (+ 568us) server_negotiation.cc:407] Connection header received
0807 08:40:18.402118 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:18.402122 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:18.402157 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:18.402198 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:18.402715 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.403324 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.404563 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.404848 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.404930 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.423965 (+ 19035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:18.423968 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:18.423976 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:18.424000 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:18.426445 (+ 2445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.426881 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.426883 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.426885 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.426947 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.427245 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.427248 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.427250 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.427424 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:18.427510 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:18.427809 (+ 299us) server_negotiation.cc:299] Negotiation successful
0807 08:40:18.427896 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 08:40:18.428470 16436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.401331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:34643 (local address 127.0.0.1:58104)
0807 08:40:18.401929 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:18.401943 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:18.402036 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:18.402310 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:18.402313 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:18.402534 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:18.402621 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.402627 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.403442 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.403446 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.404447 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.404457 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.405054 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.405057 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.405154 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.423441 (+ 18287us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:18.423455 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:18.423848 (+ 393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:18.426556 (+ 2708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.426559 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.426561 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.426802 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.427034 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.427037 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.427038 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.427128 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.427576 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:18.427580 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:18.427656 (+ 76us) client_negotiation.cc:769] Sending connection context
0807 08:40:18.428172 (+ 516us) client_negotiation.cc:240] Negotiation successful
0807 08:40:18.428300 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"mutex_wait_us":105,"thread_start_us":79,"threads_started":1}
I20260807 08:40:18.430790 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:39547
--local_ip_for_outbound_sockets=127.8.208.193
--tserver_master_addrs=127.8.208.254:35737
--webserver_port=46799
--webserver_interface=127.8.208.193
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.193.keytab
--principal=oryx/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.8.208.254:35737,127.8.208.253:32955
--tserver_master_addrs=127.8.208.254:35737,127.8.208.253:32955,127.8.208.252:34643 with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 08:40:18.430830 16240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.412509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:34643 (local address 127.0.0.1:58120)
0807 08:40:18.413936 (+ 1427us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:18.413947 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:18.414055 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:18.414322 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:18.414324 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:18.414489 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:18.414554 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.414558 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.415201 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.415205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.415737 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.415745 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.416235 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.416238 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.416329 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.416865 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:18.416877 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:18.418457 (+ 1580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:18.428945 (+ 10488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.428951 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.428953 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.429188 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.429772 (+ 584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.429778 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.429782 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.429906 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.430349 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:18.430355 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:18.430455 (+ 100us) client_negotiation.cc:769] Sending connection context
0807 08:40:18.430550 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 08:40:18.430675 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1362}
I20260807 08:40:18.431694 16438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.412564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58120 (local address 127.8.208.252:34643)
0807 08:40:18.412793 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:18.412804 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:18.414003 (+ 1199us) server_negotiation.cc:407] Connection header received
0807 08:40:18.414150 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:18.414152 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:18.414200 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:18.414307 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:18.414657 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.415101 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.415864 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.416128 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.416230 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.418653 (+ 2423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:18.418660 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:18.418666 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:18.418699 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:18.428836 (+ 10137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.429546 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.429552 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.429556 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.429660 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.430025 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.430030 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.430034 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.430242 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:18.431059 (+ 817us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:18.431129 (+ 70us) server_negotiation.cc:299] Negotiation successful
0807 08:40:18.431258 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":103,"threads_started":1}
I20260807 08:40:18.432489 15646 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.8.208.252:34643: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c"
member_type: NON_VOTER
last_known_addr {
host: "127.8.208.252"
port: 34643
}
attrs {
promote: true
}
}
dest_uuid: "1da71c42e9a941adbd04972d66e00568"
cas_config_opid_index: 5
I20260807 08:40:18.433013 15646 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: NON_VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: true } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: NON_VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: true } }
I20260807 08:40:18.433979 16241 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 3a23667e3d3343d283b0dffb86ed369c (127.8.208.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: NON_VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: true } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: NON_VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: true } } }
I20260807 08:40:18.434381 16383 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:18.435544 16241 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.8.208.252:34643
I20260807 08:40:18.435688 16383 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [term 1 FOLLOWER]: Refusing update from remote peer 1da71c42e9a941adbd04972d66e00568: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 08:40:18.435722 16241 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1da71c42e9a941adbd04972d66e00568" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: NON_VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: true } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: NON_VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: true } } }
I20260807 08:40:18.435822 16241 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:18.437158 16256 master.cc:537] Master@127.8.208.252:34643 shutting down...
I20260807 08:40:18.437592 16243 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: NON_VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:40:18.440717 16240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.436114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:32955 (local address 127.0.0.1:40270)
0807 08:40:18.436208 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:18.436222 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:18.436294 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:18.436738 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:18.436741 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:18.436756 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:18.436839 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.436845 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.438150 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.438153 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.439200 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.439210 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.440278 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.440283 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.440384 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.440431 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 08:40:18.440509 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 08:40:18.440574 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
W20260807 08:40:18.440739 15631 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 -> Peer 3a23667e3d3343d283b0dffb86ed369c (127.8.208.252:34643): Couldn't send request to peer 3a23667e3d3343d283b0dffb86ed369c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 08:40:18.441107 16415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.436315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40270 (local address 127.8.208.253:32955)
0807 08:40:18.436508 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:18.436511 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:18.436521 (+ 10us) server_negotiation.cc:407] Connection header received
0807 08:40:18.436553 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:18.436554 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:18.436595 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:18.436715 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:18.436955 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.437620 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.439331 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.439941 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.440036 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.440205 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:18.440907 (+ 702us) server_negotiation.cc:299] Negotiation successful
0807 08:40:18.440974 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134}
I20260807 08:40:18.441859 16296 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [term 1 LEARNER]: Refusing update from remote peer 1da71c42e9a941adbd04972d66e00568: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 08:40:18.442826 16243 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: NON_VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 08:40:18.444595 16296 raft_consensus.cc:2932] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 3a23667e3d3343d283b0dffb86ed369c (127.8.208.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: NON_VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: true } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: NON_VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: true } } }
I20260807 08:40:18.444996 16256 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:40:18.445261 16256 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:18.445344 16256 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c: stopping tablet replica
I20260807 08:40:18.446820 16328 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1da71c42e9a941adbd04972d66e00568. Latest consensus state: current_term: 1 leader_uuid: "1da71c42e9a941adbd04972d66e00568" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: NON_VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: true } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: NON_VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: true } } }
I20260807 08:40:18.446918 16328 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [sys.catalog]: This master's current role is: LEARNER
I20260807 08:40:18.447003 16328 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1da71c42e9a941adbd04972d66e00568" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: NON_VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: true } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: NON_VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: true } } }
I20260807 08:40:18.447064 16328 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [sys.catalog]: This master's current role is: LEARNER
I20260807 08:40:18.448357 16241 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568: attempting to promote NON_VOTER bb0067b7a44f41bb9ce80d4797ec363b to VOTER
I20260807 08:40:18.448810 16241 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: NON_VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: true } }
I20260807 08:40:18.450100 16296 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [term 1 LEARNER]: Refusing update from remote peer 1da71c42e9a941adbd04972d66e00568: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 08:40:18.450548 16243 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 08:40:18.451078 16240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.450795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:34643 (local address 127.0.0.1:58130)
0807 08:40:18.450932 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:18.451011 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:34643: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260807 08:40:18.451186 15631 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 -> Peer 3a23667e3d3343d283b0dffb86ed369c (127.8.208.252:34643): Couldn't send request to peer 3a23667e3d3343d283b0dffb86ed369c. Status: Network error: Client connection negotiation failed: client connection to 127.8.208.252:34643: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 08:40:18.452178 16243 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, bb0067b7a44f41bb9ce80d4797ec363b (127.8.208.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: NON_VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: true } } }
I20260807 08:40:18.453303 16243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1da71c42e9a941adbd04972d66e00568" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: NON_VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: true } } }
I20260807 08:40:18.453423 16243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:18.453553 16243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1da71c42e9a941adbd04972d66e00568" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: NON_VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: true } } }
I20260807 08:40:18.453644 16243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:18.454161 16296 raft_consensus.cc:2932] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, bb0067b7a44f41bb9ce80d4797ec363b (127.8.208.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: NON_VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: true } } }
I20260807 08:40:18.455583 16443 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1da71c42e9a941adbd04972d66e00568" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: NON_VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: true } } }
I20260807 08:40:18.455717 16443 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:40:18.462518 16256 master.cc:552] Master@127.8.208.252:34643 shutdown complete.
I20260807 08:40:18.462580 16256 master_runner.cc:305] Clearing existing system tablet
I20260807 08:40:18.462785 16256 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:18.462848 16256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:18.463788 16256 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 08:40:18.464557 16446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:18.464742 16256 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:18.464879 16256 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 08:40:18.464915 16256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/wal
uuid: "3a23667e3d3343d283b0dffb86ed369c"
format_stamp: "Formatted at 2026-08-07 08:40:18 on dist-test-slave-6nmv"
server_key: "48fc37acffe2bbdf94a3a6abc4441d01"
server_key_iv: "510f1f9e4558f6562590c62ebb2118a9"
server_key_version: "encryptionkey@0"
I20260807 08:40:18.466542 16256 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:18.468221 16256 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 08:40:18.468314 16256 log.cc:1196] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260807 08:40:18.468555 16256 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c: Deleting consensus metadata
I20260807 08:40:18.468724 16256 master_runner.cc:315] Copying system tablet from 127.8.208.254:35737
I20260807 08:40:18.469913 16256 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c: tablet copy: Beginning tablet copy session from remote peer at address 127.8.208.254:35737
I20260807 08:40:18.477218 15687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.470443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40274 (local address 127.8.208.254:35737)
0807 08:40:18.470553 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:18.470557 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:18.470780 (+ 223us) server_negotiation.cc:407] Connection header received
0807 08:40:18.470900 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:18.470903 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:18.470944 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:18.471047 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:18.471447 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.471956 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.472701 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.472910 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.473015 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.474127 (+ 1112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:18.474144 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:18.474146 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:18.474167 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:18.475535 (+ 1368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.476014 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.476018 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.476020 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.476102 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.476380 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.476385 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.476387 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.476559 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:18.476666 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:18.476972 (+ 306us) server_negotiation.cc:299] Negotiation successful
0807 08:40:18.477078 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 08:40:18.477233 16452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.470405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.0.0.1:40274)
0807 08:40:18.470694 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:18.470706 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:18.470823 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:18.471062 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:18.471065 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:18.471259 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:18.471340 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.471345 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.472063 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.472067 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.472584 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.472592 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.473018 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.473022 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.473097 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.473592 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:18.473636 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:18.474006 (+ 370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:18.475705 (+ 1699us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.475708 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.475710 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.475907 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.476202 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.476205 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.476207 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.476292 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.476657 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:18.476660 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:18.476783 (+ 123us) client_negotiation.cc:769] Sending connection context
0807 08:40:18.476908 (+ 125us) client_negotiation.cc:240] Negotiation successful
0807 08:40:18.477040 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":90,"threads_started":1}
I20260807 08:40:18.477865 15666 tablet_copy_service.cc:140] P 1da71c42e9a941adbd04972d66e00568: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 3a23667e3d3343d283b0dffb86ed369c ({username='oryx', principal='oryx/127.8.208.252@KRBTEST.COM'} at 127.0.0.1:40274)
I20260807 08:40:18.478006 15666 tablet_copy_service.cc:161] P 1da71c42e9a941adbd04972d66e00568: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 3a23667e3d3343d283b0dffb86ed369c at {username='oryx', principal='oryx/127.8.208.252@KRBTEST.COM'} at 127.0.0.1:40274: session id = 3a23667e3d3343d283b0dffb86ed369c-00000000000000000000000000000000
I20260807 08:40:18.478778 15666 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 08:40:18.479791 16256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 08:40:18.481572 16256 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c: tablet copy: Starting download of 0 data blocks...
I20260807 08:40:18.481745 16256 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c: tablet copy: Starting download of 1 WAL segments...
I20260807 08:40:18.482967 16256 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 08:40:18.484406 15666 tablet_copy_service.cc:342] P 1da71c42e9a941adbd04972d66e00568: Request end of tablet copy session 3a23667e3d3343d283b0dffb86ed369c-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.8.208.252@KRBTEST.COM'} at 127.0.0.1:40274
I20260807 08:40:18.484516 15666 tablet_copy_service.cc:433] P 1da71c42e9a941adbd04972d66e00568: ending tablet copy session 3a23667e3d3343d283b0dffb86ed369c-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 3a23667e3d3343d283b0dffb86ed369c
I20260807 08:40:18.490631 16256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:18.492189 16453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:18.492280 16456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:18.492465 16454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:18.492529 16256 server_base.cc:1034] running on GCE node
I20260807 08:40:18.492664 16256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:18.492908 16256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:18.494050 16256 hybrid_clock.cc:648] HybridClock initialized: now 1786092018494042 us; error 33 us; skew 500 ppm
Aug 07 08:40:18 dist-test-slave-6nmv krb5kdc[15597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092018, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:18.495587 16256 init.cc:377] Logged in from keytab as oryx/127.8.208.252@KRBTEST.COM (short username oryx)
I20260807 08:40:18.496062 16256 webserver.cc:460] Webserver started at http://127.8.208.252:44745/ using document root <none> and password file <none>
I20260807 08:40:18.496250 16256 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:18.496294 16256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:18.497273 16256 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 08:40:18.498204 16464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:18.498435 16256 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 08:40:18.498498 16256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/wal
uuid: "3a23667e3d3343d283b0dffb86ed369c"
format_stamp: "Formatted at 2026-08-07 08:40:18 on dist-test-slave-6nmv"
server_key: "48fc37acffe2bbdf94a3a6abc4441d01"
server_key_iv: "510f1f9e4558f6562590c62ebb2118a9"
server_key_version: "encryptionkey@0"
I20260807 08:40:18.498621 16256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:18.516920 16256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:18.518663 16256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:18.523228 16256 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.252:34643
I20260807 08:40:18.523799 16256 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/master-2/data/info.pb
I20260807 08:40:18.525002 16525 sys_catalog.cc:263] Verifying existing consensus state
I20260807 08:40:18.525770 16525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c: Bootstrap starting.
I20260807 08:40:18.533582 16525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 08:40:18.533882 16524 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.252:34643 every 8 connection(s)
I20260807 08:40:18.533898 16525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c: Bootstrap complete.
I20260807 08:40:18.534441 16525 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: NON_VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: true } }
I20260807 08:40:18.534595 16525 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3a23667e3d3343d283b0dffb86ed369c, State: Initialized, Role: LEARNER
I20260807 08:40:18.534710 16525 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: NON_VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: true } }
I20260807 08:40:18.535030 16528 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: NON_VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: true } } }
I20260807 08:40:18.535184 16525 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:40:18.535192 16528 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [sys.catalog]: This master's current role is: LEARNER
I20260807 08:40:18.539062 16539 catalog_manager.cc:1259] Loaded cluster ID: 823e534d40b54b65a027caf24944f346
I20260807 08:40:18.539132 16539 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c: loading cluster ID for follower catalog manager: success
I20260807 08:40:18.540500 16539 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c: acquiring CA information for follower catalog manager: success
I20260807 08:40:18.541455 16539 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 08:40:18.580017 16440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:18.580278 16440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:18.580329 16440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:18.586333 16440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:18.586393 16440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:18.586481 16440 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:40:18.593214 16440 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.193.keytab
--principal=oryx/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:39547
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=46799
--tserver_master_addrs=127.8.208.254:35737,127.8.208.253:32955,127.8.208.252:34643
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16440
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:18.594238 16440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:18.595274 16440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:18.606196 16548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:18.606283 16546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:18.606381 16545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:18.607183 16440 server_base.cc:1034] running on GCE node
I20260807 08:40:18.607560 16440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:18.608147 16440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:18.609357 16440 hybrid_clock.cc:648] HybridClock initialized: now 1786092018609327 us; error 27 us; skew 500 ppm
Aug 07 08:40:18 dist-test-slave-6nmv krb5kdc[15597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092018, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:18.612133 16440 init.cc:377] Logged in from keytab as oryx/127.8.208.193@KRBTEST.COM (short username oryx)
I20260807 08:40:18.612908 16440 webserver.cc:460] Webserver started at http://127.8.208.193:46799/ using document root <none> and password file <none>
I20260807 08:40:18.613390 16440 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:18.613508 16440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:18.617429 16440 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260807 08:40:18.619578 16555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:18.620652 16440 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 08:40:18.620805 16440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "7eaeed1bd2884ff1a20a897907db390f"
format_stamp: "Formatted at 2026-08-07 08:40:17 on dist-test-slave-6nmv"
server_key: "a534532d03c8eed5d859cb860a6cbd11"
server_key_iv: "b5703bfafa8b0ef54bd84409c7372533"
server_key_version: "encryptionkey@0"
I20260807 08:40:18.621292 16440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:18.642511 15991 heartbeater.cc:503] Master 127.8.208.254:35737 was elected leader, sending a full tablet report...
I20260807 08:40:18.643005 16440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:18.645663 16440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:18.645901 16440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:18.646457 16440 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:18.647236 16440 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:18.647281 16440 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:18.647342 16440 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:18.647374 16440 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:18.656306 16440 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:39547
I20260807 08:40:18.656328 16680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:39547 every 8 connection(s)
I20260807 08:40:18.657205 16440 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:40:18.658205 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 16440
I20260807 08:40:18.658440 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 15856
I20260807 08:40:18.667502 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:33125
--local_ip_for_outbound_sockets=127.8.208.194
--tserver_master_addrs=127.8.208.254:35737
--webserver_port=35173
--webserver_interface=127.8.208.194
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.194.keytab
--principal=oryx/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.8.208.254:35737,127.8.208.253:32955
--tserver_master_addrs=127.8.208.254:35737,127.8.208.253:32955,127.8.208.252:34643 with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 08:40:18 dist-test-slave-6nmv krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092018, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.253@KRBTEST.COM
Aug 07 08:40:18 dist-test-slave-6nmv krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092018, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM
Aug 07 08:40:18 dist-test-slave-6nmv krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092018, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.252@KRBTEST.COM
I20260807 08:40:18.674667 16415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.659797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:43245 (local address 127.8.208.253:32955)
0807 08:40:18.659931 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:18.659937 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:18.660480 (+ 543us) server_negotiation.cc:407] Connection header received
0807 08:40:18.661750 (+ 1270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:18.661756 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:18.661820 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:18.661912 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:18.663749 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.664393 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.666072 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.666429 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.666530 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.669850 (+ 3320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:18.669856 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:18.669860 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:18.669893 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:18.671828 (+ 1935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.672822 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.672827 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.672830 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.672922 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.673363 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.673369 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.673373 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.673623 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:18.673710 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:18.674364 (+ 654us) server_negotiation.cc:299] Negotiation successful
0807 08:40:18.674476 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 08:40:18.674734 15687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.661979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:46697 (local address 127.8.208.254:35737)
0807 08:40:18.662107 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:18.662112 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:18.662126 (+ 14us) server_negotiation.cc:407] Connection header received
0807 08:40:18.662168 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:18.662172 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:18.662239 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:18.662313 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:18.663587 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.664308 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.667007 (+ 2699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.667286 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.667357 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.670267 (+ 2910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:18.670271 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:18.670274 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:18.670303 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:18.672107 (+ 1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.673046 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.673052 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.673055 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.673151 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.673492 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.673498 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.673501 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.673746 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:18.673831 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:18.674371 (+ 540us) server_negotiation.cc:299] Negotiation successful
0807 08:40:18.674512 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 08:40:18.675554 16686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.659553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:34601 (local address 127.8.208.252:34643)
0807 08:40:18.662476 (+ 2923us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:18.662483 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:18.662500 (+ 17us) server_negotiation.cc:407] Connection header received
0807 08:40:18.662546 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:18.662551 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:18.662602 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:18.663185 (+ 583us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:18.664472 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.665461 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.666592 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.668100 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.668687 (+ 587us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.670585 (+ 1898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:18.670590 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:18.670594 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:18.670621 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:18.673319 (+ 2698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.673794 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.673797 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.673799 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.673921 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.674231 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.674236 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.674240 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.674448 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:18.674558 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:18.675248 (+ 690us) server_negotiation.cc:299] Negotiation successful
0807 08:40:18.675367 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2843,"thread_start_us":107,"threads_started":1}
I20260807 08:40:18.676113 16689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.661595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.8.208.193:46697)
0807 08:40:18.661936 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:18.661950 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:18.662032 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:18.662440 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:18.662443 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:18.662749 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:18.663423 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.663438 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.664478 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.664484 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.666880 (+ 2396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.666892 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.667521 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.667525 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.667617 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.668064 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:18.668079 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:18.670098 (+ 2019us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:18.672325 (+ 2227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.672622 (+ 297us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.672628 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.672901 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.673272 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.673276 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.673279 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.673365 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.673913 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:18.673917 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:18.674103 (+ 186us) client_negotiation.cc:769] Sending connection context
0807 08:40:18.674886 (+ 783us) client_negotiation.cc:240] Negotiation successful
0807 08:40:18.675228 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":185,"spinlock_wait_cycles":29696,"thread_start_us":86,"threads_started":1}
I20260807 08:40:18.676110 16688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.659372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:34643 (local address 127.8.208.193:34601)
0807 08:40:18.661538 (+ 2166us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:18.661552 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:18.661632 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:18.662748 (+ 1116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:18.662751 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:18.662914 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:18.663426 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.663443 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.665623 (+ 2180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.665627 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.666437 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.666447 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.668245 (+ 1798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.668248 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.668325 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.668763 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:18.668775 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:18.670413 (+ 1638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:18.673456 (+ 3043us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.673459 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.673461 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.673692 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.674029 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.674032 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.674034 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.674122 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.674603 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:18.674606 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:18.674689 (+ 83us) client_negotiation.cc:769] Sending connection context
0807 08:40:18.674834 (+ 145us) client_negotiation.cc:240] Negotiation successful
0807 08:40:18.675332 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2051,"mutex_wait_us":877,"spinlock_wait_cycles":3968,"thread_start_us":108,"threads_started":1}
I20260807 08:40:18.676736 16685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.659356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:32955 (local address 127.8.208.193:43245)
0807 08:40:18.660317 (+ 961us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:18.660368 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:18.661537 (+ 1169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:18.662231 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:18.662241 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:18.662751 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:18.663640 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.663648 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.664516 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.664519 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.665909 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.665921 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.666741 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.666756 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.666975 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.667574 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:18.667597 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:18.669648 (+ 2051us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:18.672253 (+ 2605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.672260 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.672275 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.672681 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.673050 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.673055 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.673057 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.673235 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.673789 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:18.673794 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:18.674101 (+ 307us) client_negotiation.cc:769] Sending connection context
0807 08:40:18.674894 (+ 793us) client_negotiation.cc:240] Negotiation successful
0807 08:40:18.676232 (+ 1338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":746,"mutex_wait_us":523,"spinlock_wait_cycles":31104,"thread_start_us":146,"threads_started":1}
I20260807 08:40:18.677692 16681 heartbeater.cc:347] Connected to a master server at 127.8.208.252:34643
I20260807 08:40:18.677768 16682 heartbeater.cc:347] Connected to a master server at 127.8.208.254:35737
I20260807 08:40:18.677938 16681 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:18.677968 16682 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:18.678454 16682 heartbeater.cc:511] Master 127.8.208.254:35737 requested a full tablet report, sending...
I20260807 08:40:18.678454 16681 heartbeater.cc:511] Master 127.8.208.252:34643 requested a full tablet report, sending...
I20260807 08:40:18.678481 16683 heartbeater.cc:347] Connected to a master server at 127.8.208.253:32955
I20260807 08:40:18.678627 16683 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:18.678785 16683 heartbeater.cc:511] Master 127.8.208.253:32955 requested a full tablet report, sending...
I20260807 08:40:18.679644 15646 ts_manager.cc:194] Re-registered known tserver with Master: 7eaeed1bd2884ff1a20a897907db390f (127.8.208.193:39547)
I20260807 08:40:18.679967 16279 ts_manager.cc:194] Registered new tserver with Master: 7eaeed1bd2884ff1a20a897907db390f (127.8.208.193:39547)
I20260807 08:40:18.679951 16484 ts_manager.cc:194] Registered new tserver with Master: 7eaeed1bd2884ff1a20a897907db390f (127.8.208.193:39547)
I20260807 08:40:18.680205 15646 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.208.193@KRBTEST.COM'} at 127.8.208.193:46697
W20260807 08:40:18.780395 16690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:18.780720 16690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:18.780797 16690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:18.784817 16690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:18.784884 16690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:18.784962 16690 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:40:18.790002 16690 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.194.keytab
--principal=oryx/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:33125
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=35173
--tserver_master_addrs=127.8.208.254:35737,127.8.208.253:32955,127.8.208.252:34643
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:18.790907 16690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:18.791906 16690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:18.801189 16698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:18.801213 16696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:18.801198 16695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:18.801229 16690 server_base.cc:1034] running on GCE node
I20260807 08:40:18.801788 16690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:18.802374 16690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:18.803539 16690 hybrid_clock.cc:648] HybridClock initialized: now 1786092018803508 us; error 38 us; skew 500 ppm
Aug 07 08:40:18 dist-test-slave-6nmv krb5kdc[15597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092018, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:18.806401 16690 init.cc:377] Logged in from keytab as oryx/127.8.208.194@KRBTEST.COM (short username oryx)
I20260807 08:40:18.807133 16690 webserver.cc:460] Webserver started at http://127.8.208.194:35173/ using document root <none> and password file <none>
I20260807 08:40:18.807569 16690 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:18.807633 16690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:18.811195 16690 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:40:18.813148 16705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:18.814271 16690 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:18.814379 16690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "3ffd435e99a84e969eb52e5e8270697b"
format_stamp: "Formatted at 2026-08-07 08:40:17 on dist-test-slave-6nmv"
server_key: "073d4c157f8857bd639804e7f34b5c3b"
server_key_iv: "7e114c6d63adf9e075f62729e6367148"
server_key_version: "encryptionkey@0"
I20260807 08:40:18.814849 16690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:18.848753 16134 heartbeater.cc:503] Master 127.8.208.254:35737 was elected leader, sending a full tablet report...
I20260807 08:40:18.863160 16690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:18.866010 16690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:18.866206 16690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:18.866811 16690 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:18.867578 16690 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:18.867621 16690 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:18.867686 16690 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:18.867714 16690 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:18.876003 16690 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:33125
I20260807 08:40:18.876037 16827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:33125 every 8 connection(s)
I20260807 08:40:18.876912 16690 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:40:18.885275 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 16690
I20260807 08:40:18.885463 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 15997
Aug 07 08:40:18 dist-test-slave-6nmv krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092018, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.252@KRBTEST.COM
Aug 07 08:40:18 dist-test-slave-6nmv krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092018, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM
Aug 07 08:40:18 dist-test-slave-6nmv krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092018, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.253@KRBTEST.COM
I20260807 08:40:18.892529 16686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.880176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:56205 (local address 127.8.208.252:34643)
0807 08:40:18.880293 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:18.880297 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:18.880384 (+ 87us) server_negotiation.cc:407] Connection header received
0807 08:40:18.880754 (+ 370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:18.880757 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:18.880806 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:18.880873 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:18.882355 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.882818 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.883843 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.884069 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.884171 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.887398 (+ 3227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:18.887401 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:18.887403 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:18.887429 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:18.889722 (+ 2293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.890472 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.890475 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.890477 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.890547 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.891005 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.891008 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.891010 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.891266 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:18.891353 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:18.892253 (+ 900us) server_negotiation.cc:299] Negotiation successful
0807 08:40:18.892371 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 08:40:18.892529 15687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.878602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:45501 (local address 127.8.208.254:35737)
0807 08:40:18.878760 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:18.878764 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:18.879656 (+ 892us) server_negotiation.cc:407] Connection header received
0807 08:40:18.880753 (+ 1097us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:18.880756 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:18.880805 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:18.880901 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:18.882367 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.883059 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.884249 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.884543 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.884744 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.887752 (+ 3008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:18.887760 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:18.887766 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:18.887796 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:18.889782 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.890451 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.890457 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.890458 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.890547 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.891002 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.891005 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.891007 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.891531 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:18.891656 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:18.892253 (+ 597us) server_negotiation.cc:299] Negotiation successful
0807 08:40:18.892371 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 08:40:18.894085 16833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.879063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.8.208.194:45501)
0807 08:40:18.879514 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:18.879556 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:18.880542 (+ 986us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:18.881113 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:18.881120 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:18.881611 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:18.882237 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.882244 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.883177 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.883180 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.884128 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.884136 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.884925 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.884942 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.885035 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.885519 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:18.885539 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:18.887608 (+ 2069us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:18.889906 (+ 2298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.889908 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.889909 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.890318 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.890691 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.890694 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.890696 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.890892 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.891655 (+ 763us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:18.891661 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:18.891959 (+ 298us) client_negotiation.cc:769] Sending connection context
0807 08:40:18.892732 (+ 773us) client_negotiation.cc:240] Negotiation successful
0807 08:40:18.893102 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":218,"spinlock_wait_cycles":69248,"thread_start_us":141,"threads_started":1}
I20260807 08:40:18.894085 16834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.880068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:34643 (local address 127.8.208.194:56205)
0807 08:40:18.880297 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:18.880308 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:18.880549 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:18.881112 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:18.881118 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:18.881610 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:18.882226 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.882238 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.882957 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.882960 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.883698 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.883705 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.884202 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.884206 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.884351 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.884847 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:18.884860 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:18.887238 (+ 2378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:18.889861 (+ 2623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.889869 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.889889 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.890368 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.890691 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.890694 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.890696 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.890896 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.891707 (+ 811us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:18.891710 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:18.891959 (+ 249us) client_negotiation.cc:769] Sending connection context
0807 08:40:18.893012 (+ 1053us) client_negotiation.cc:240] Negotiation successful
0807 08:40:18.893171 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":118,"spinlock_wait_cycles":80000,"thread_start_us":95,"threads_started":1}
I20260807 08:40:18.894771 16415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.878532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:53375 (local address 127.8.208.253:32955)
0807 08:40:18.878705 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:18.878709 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:18.879883 (+ 1174us) server_negotiation.cc:407] Connection header received
0807 08:40:18.880745 (+ 862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:18.880748 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:18.880802 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:18.880908 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:18.882367 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.883052 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.884249 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.884543 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.884610 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.890845 (+ 6235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:18.890851 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:18.890857 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:18.890888 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:18.892717 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.893354 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.893360 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.893364 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.893504 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:18.893802 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:18.893807 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:18.893811 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:18.894063 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:18.894138 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:18.894509 (+ 371us) server_negotiation.cc:299] Negotiation successful
0807 08:40:18.894637 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 08:40:18.895205 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:41233
--local_ip_for_outbound_sockets=127.8.208.195
--tserver_master_addrs=127.8.208.254:35737
--webserver_port=35651
--webserver_interface=127.8.208.195
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.195.keytab
--principal=oryx/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.8.208.254:35737,127.8.208.253:32955
--tserver_master_addrs=127.8.208.254:35737,127.8.208.253:32955,127.8.208.252:34643 with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 08:40:18.895481 16828 heartbeater.cc:347] Connected to a master server at 127.8.208.252:34643
I20260807 08:40:18.895555 16829 heartbeater.cc:347] Connected to a master server at 127.8.208.254:35737
I20260807 08:40:18.895732 16828 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:18.895732 16829 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:18.895856 16832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:18.879063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:32955 (local address 127.8.208.194:53375)
0807 08:40:18.879801 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:18.879812 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:18.880542 (+ 730us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:18.881113 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:18.881137 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:18.881611 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:18.882237 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.882244 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.883177 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.883180 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.884127 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:18.884136 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:18.884774 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:18.884778 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:18.884878 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:18.888556 (+ 3678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:18.888575 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:18.890693 (+ 2118us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:18.892929 (+ 2236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.892933 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.892935 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.893248 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.893612 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:18.893617 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:18.893621 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:18.893705 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:18.894209 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:18.894214 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:18.894307 (+ 93us) client_negotiation.cc:769] Sending connection context
0807 08:40:18.894429 (+ 122us) client_negotiation.cc:240] Negotiation successful
0807 08:40:18.894587 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":656,"mutex_wait_us":250,"spinlock_wait_cycles":55296,"thread_start_us":120,"threads_started":1}
I20260807 08:40:18.896294 16829 heartbeater.cc:511] Master 127.8.208.254:35737 requested a full tablet report, sending...
I20260807 08:40:18.896420 16828 heartbeater.cc:511] Master 127.8.208.252:34643 requested a full tablet report, sending...
I20260807 08:40:18.896926 16830 heartbeater.cc:347] Connected to a master server at 127.8.208.253:32955
I20260807 08:40:18.897022 16830 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:18.897166 16830 heartbeater.cc:511] Master 127.8.208.253:32955 requested a full tablet report, sending...
I20260807 08:40:18.897367 16484 ts_manager.cc:194] Registered new tserver with Master: 3ffd435e99a84e969eb52e5e8270697b (127.8.208.194:33125)
I20260807 08:40:18.897367 15646 ts_manager.cc:194] Re-registered known tserver with Master: 3ffd435e99a84e969eb52e5e8270697b (127.8.208.194:33125)
I20260807 08:40:18.897864 16279 ts_manager.cc:194] Registered new tserver with Master: 3ffd435e99a84e969eb52e5e8270697b (127.8.208.194:33125)
I20260807 08:40:18.898109 15646 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.208.194@KRBTEST.COM'} at 127.8.208.194:45501
W20260807 08:40:19.012974 16835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:19.013302 16835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:19.013375 16835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:19.021138 16835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:19.021214 16835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:19.021327 16835 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:40:19.028033 16840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.023752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:34643 (local address 127.0.0.1:58140)
0807 08:40:19.023955 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:19.023968 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:19.024073 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:19.024312 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:19.024314 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:19.024331 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:19.024470 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:19.024476 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.025467 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.025471 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:19.026775 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:19.026788 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.027625 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.027628 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:19.027711 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.027733 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 08:40:19.027813 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 08:40:19.027889 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":75,"threads_started":1}
I20260807 08:40:19.028030 16686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.023799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58140 (local address 127.8.208.252:34643)
0807 08:40:19.024034 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:19.024038 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:19.024051 (+ 13us) server_negotiation.cc:407] Connection header received
0807 08:40:19.024157 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:19.024160 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:19.024212 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:19.024291 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:19.024613 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.025351 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.026907 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.027517 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.027616 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.027762 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:19.027826 (+ 64us) server_negotiation.cc:299] Negotiation successful
0807 08:40:19.027889 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150}
I20260807 08:40:19.028997 16494 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 08:40:19.029491 16528 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1da71c42e9a941adbd04972d66e00568. Latest consensus state: current_term: 1 leader_uuid: "1da71c42e9a941adbd04972d66e00568" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: NON_VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: true } } }
I20260807 08:40:19.029636 16528 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [sys.catalog]: This master's current role is: LEARNER
I20260807 08:40:19.029620 16835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.195.keytab
--principal=oryx/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:41233
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=35651
--tserver_master_addrs=127.8.208.254:35737,127.8.208.253:32955,127.8.208.252:34643
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:19.030802 16835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:19.031772 16835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:19.040810 16845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:19.040815 16843 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:19.040815 16842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:19.041159 16835 server_base.cc:1034] running on GCE node
I20260807 08:40:19.041481 16835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:19.042157 16835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:19.043332 16835 hybrid_clock.cc:648] HybridClock initialized: now 1786092019043304 us; error 42 us; skew 500 ppm
Aug 07 08:40:19 dist-test-slave-6nmv krb5kdc[15597](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092019, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:19.045892 16835 init.cc:377] Logged in from keytab as oryx/127.8.208.195@KRBTEST.COM (short username oryx)
I20260807 08:40:19.046625 16835 webserver.cc:460] Webserver started at http://127.8.208.195:35651/ using document root <none> and password file <none>
I20260807 08:40:19.047112 16835 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:19.047174 16835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:19.050460 16835 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:40:19.052181 16853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:19.053273 16835 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:19.053378 16835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "9a888333f0be4ec0892844bec224461d"
format_stamp: "Formatted at 2026-08-07 08:40:17 on dist-test-slave-6nmv"
server_key: "9fc213ec2519926e17d2dd454ca5014b"
server_key_iv: "37d089ebc1d0870f717ff142c5303aae"
server_key_version: "encryptionkey@0"
I20260807 08:40:19.053910 16835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:19.072536 16835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:19.075106 16835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:19.075281 16835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:19.075899 16835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:19.076723 16835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:19.076769 16835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:19.076845 16835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:19.076874 16835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:19.085542 16835 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:41233
I20260807 08:40:19.085606 16981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:41233 every 8 connection(s)
I20260807 08:40:19.086572 16835 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:40:19.093123 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 16835
Aug 07 08:40:19 dist-test-slave-6nmv krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092019, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.253@KRBTEST.COM
Aug 07 08:40:19 dist-test-slave-6nmv krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092019, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.252@KRBTEST.COM
Aug 07 08:40:19 dist-test-slave-6nmv krb5kdc[15597](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092019, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM
I20260807 08:40:19.102489 16986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.088743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:34643 (local address 127.8.208.195:49385)
0807 08:40:19.089262 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:19.089276 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:19.090167 (+ 891us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:19.090647 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:19.090652 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:19.091044 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:19.091477 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:19.091485 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.092547 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.092550 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:19.093531 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:19.093538 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.094192 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.094195 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:19.094337 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.095248 (+ 911us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:19.095264 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:19.097520 (+ 2256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:19.099642 (+ 2122us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:19.099649 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:19.099662 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:19.099979 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:19.100260 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:19.100263 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:19.100265 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:19.100419 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:19.100820 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:19.100825 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:19.101070 (+ 245us) client_negotiation.cc:769] Sending connection context
0807 08:40:19.101274 (+ 204us) client_negotiation.cc:240] Negotiation successful
0807 08:40:19.101553 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"mutex_wait_us":255,"spinlock_wait_cycles":44544,"thread_start_us":123,"threads_started":1}
I20260807 08:40:19.103282 16686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.088339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:49385 (local address 127.8.208.252:34643)
0807 08:40:19.088460 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:19.088464 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:19.089344 (+ 880us) server_negotiation.cc:407] Connection header received
0807 08:40:19.090366 (+ 1022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:19.090369 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:19.090422 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:19.090473 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:19.091629 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.092404 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.093649 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.093967 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.094023 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.097682 (+ 3659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:19.097686 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:19.097688 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:19.097728 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:19.099499 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:19.100083 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:19.100086 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:19.100087 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:19.100171 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:19.100529 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:19.100532 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:19.100534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:19.100704 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:19.100775 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:19.102947 (+ 2172us) server_negotiation.cc:299] Negotiation successful
0807 08:40:19.103071 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 08:40:19.104161 16988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.089632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.8.208.195:53003)
0807 08:40:19.089890 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:19.089903 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:19.090167 (+ 264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:19.090647 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:19.090652 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:19.091047 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:19.091477 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:19.091485 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.092547 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.092550 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:19.093528 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:19.093538 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.094176 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.094181 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:19.094341 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.095190 (+ 849us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:19.095804 (+ 614us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:19.098329 (+ 2525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:19.100328 (+ 1999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:19.100585 (+ 257us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:19.100593 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:19.100832 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:19.101945 (+ 1113us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:19.101950 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:19.101954 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:19.102051 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:19.103598 (+ 1547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:19.103601 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:19.103699 (+ 98us) client_negotiation.cc:769] Sending connection context
0807 08:40:19.103810 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 08:40:19.103937 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":260,"spinlock_wait_cycles":13952,"thread_start_us":89,"threads_started":1}
I20260807 08:40:19.104350 16982 heartbeater.cc:347] Connected to a master server at 127.8.208.252:34643
I20260807 08:40:19.104580 16982 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:19.105154 15687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.089837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:53003 (local address 127.8.208.254:35737)
0807 08:40:19.089983 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:19.089987 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:19.090001 (+ 14us) server_negotiation.cc:407] Connection header received
0807 08:40:19.090366 (+ 365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:19.090369 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:19.090419 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:19.090475 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:19.091629 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.092404 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.093649 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.093954 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.094022 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.098482 (+ 4460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:19.098485 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:19.098487 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:19.098513 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:19.100213 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:19.101722 (+ 1509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:19.101727 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:19.101730 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:19.101835 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:19.103179 (+ 1344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:19.103182 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:19.103183 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:19.103444 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:19.103551 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:19.104891 (+ 1340us) server_negotiation.cc:299] Negotiation successful
0807 08:40:19.104999 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 08:40:19.105183 16982 heartbeater.cc:511] Master 127.8.208.252:34643 requested a full tablet report, sending...
I20260807 08:40:19.105682 16995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.095294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40280 (local address 127.8.208.253:32955)
0807 08:40:19.095538 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:19.095542 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:19.096315 (+ 773us) server_negotiation.cc:407] Connection header received
0807 08:40:19.096357 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:19.096363 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:19.096412 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:19.096494 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:19.097510 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.098273 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.099462 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.099809 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.099894 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.101537 (+ 1643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:19.101540 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:19.101543 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:19.101570 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:19.103455 (+ 1885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:19.103996 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:19.104002 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:19.104005 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:19.104087 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:19.104387 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:19.104390 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:19.104392 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:19.104658 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:19.104802 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:19.105374 (+ 572us) server_negotiation.cc:299] Negotiation successful
0807 08:40:19.105478 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"spinlock_wait_cycles":7040,"thread_start_us":75,"threads_started":1}
I20260807 08:40:19.106149 16987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.088743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:32955 (local address 127.8.208.195:60103)
0807 08:40:19.089210 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:19.089259 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:19.090164 (+ 905us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:19.090645 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:19.090651 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:19.091013 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:19.091469 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:19.091482 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.092259 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.092262 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:19.093270 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:19.093280 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.093990 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.093994 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:19.094185 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.094980 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:19.094997 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:19.097958 (+ 2961us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:19.102792 (+ 4834us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:19.102797 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:19.102799 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:19.103061 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:19.104614 (+ 1553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:19.104617 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:19.104619 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:19.104720 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:19.105660 (+ 940us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:19.105663 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:19.105756 (+ 93us) client_negotiation.cc:769] Sending connection context
0807 08:40:19.105878 (+ 122us) client_negotiation.cc:240] Negotiation successful
0807 08:40:19.106001 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"mutex_wait_us":37,"spinlock_wait_cycles":12416,"thread_start_us":141,"threads_started":1}
I20260807 08:40:19.106385 16983 heartbeater.cc:347] Connected to a master server at 127.8.208.254:35737
I20260807 08:40:19.106493 16983 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:19.106666 16983 heartbeater.cc:511] Master 127.8.208.254:35737 requested a full tablet report, sending...
I20260807 08:40:19.106740 16415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.088331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:60103 (local address 127.8.208.253:32955)
0807 08:40:19.088490 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:19.088494 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:19.089346 (+ 852us) server_negotiation.cc:407] Connection header received
0807 08:40:19.090344 (+ 998us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:19.090346 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:19.090402 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:19.090496 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:19.091595 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.092124 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.093449 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.093717 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.093802 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.098083 (+ 4281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:19.098087 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:19.098090 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:19.098112 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:19.102679 (+ 4567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:19.104383 (+ 1704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:19.104386 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:19.104388 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:19.104504 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:19.105328 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:19.105331 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:19.105333 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:19.105507 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:19.105606 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:19.106492 (+ 886us) server_negotiation.cc:299] Negotiation successful
0807 08:40:19.106596 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 08:40:19.107272 16484 ts_manager.cc:194] Registered new tserver with Master: 9a888333f0be4ec0892844bec224461d (127.8.208.195:41233)
I20260807 08:40:19.107311 16984 heartbeater.cc:347] Connected to a master server at 127.8.208.253:32955
I20260807 08:40:19.107375 16984 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:19.107493 16984 heartbeater.cc:511] Master 127.8.208.253:32955 requested a full tablet report, sending...
I20260807 08:40:19.108017 16279 ts_manager.cc:194] Registered new tserver with Master: 9a888333f0be4ec0892844bec224461d (127.8.208.195:41233)
I20260807 08:40:19.108037 15646 ts_manager.cc:194] Re-registered known tserver with Master: 9a888333f0be4ec0892844bec224461d (127.8.208.195:41233)
I20260807 08:40:19.108726 15646 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.208.195@KRBTEST.COM'} at 127.8.208.195:53003
I20260807 08:40:19.109015 16998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.096264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58146 (local address 127.8.208.252:34643)
0807 08:40:19.096872 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:19.096878 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:19.099135 (+ 2257us) server_negotiation.cc:407] Connection header received
0807 08:40:19.099171 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:19.099173 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:19.099217 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:19.099293 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:19.100243 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.100823 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.101765 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.102105 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.102191 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.104063 (+ 1872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:19.104066 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:19.104069 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:19.104092 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:19.107055 (+ 2963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:19.107474 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:19.107476 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:19.107478 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:19.107553 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:19.107822 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:19.107827 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:19.107828 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:19.108051 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:19.108164 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:19.108726 (+ 562us) server_negotiation.cc:299] Negotiation successful
0807 08:40:19.108851 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":81,"threads_started":1}
I20260807 08:40:19.113317 16994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.094964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40278 (local address 127.8.208.254:35737)
0807 08:40:19.096970 (+ 2006us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:19.096974 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:19.097251 (+ 277us) server_negotiation.cc:407] Connection header received
0807 08:40:19.097287 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:19.097290 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:19.097330 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:19.097402 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:19.107327 (+ 9925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.107940 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.109001 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.109351 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.109463 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.110855 (+ 1392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:19.110857 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:19.110859 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:19.110878 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:19.112108 (+ 1230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:19.112457 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:19.112459 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:19.112461 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:19.112530 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:19.112745 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:19.112747 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:19.112748 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:19.112897 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:19.112997 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:19.113139 (+ 142us) server_negotiation.cc:299] Negotiation successful
0807 08:40:19.113217 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":66,"threads_started":1}
I20260807 08:40:19.115716 15646 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40278:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 08:40:19.118785 15646 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:40:19.121146 16839 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1da71c42e9a941adbd04972d66e00568" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: NON_VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: true } } }
I20260807 08:40:19.121265 16839 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:19.124279 17001 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568: attempting to promote NON_VOTER 3a23667e3d3343d283b0dffb86ed369c to VOTER
I20260807 08:40:19.124580 17001 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: false } }
I20260807 08:40:19.125983 16296 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [term 1 FOLLOWER]: Refusing update from remote peer 1da71c42e9a941adbd04972d66e00568: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 08:40:19.126348 16493 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [term 1 LEARNER]: Refusing update from remote peer 1da71c42e9a941adbd04972d66e00568: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 08:40:19.126933 17002 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 08:40:19.127713 17002 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 08:40:19.128471 17009 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 3a23667e3d3343d283b0dffb86ed369c (127.8.208.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: false } } }
I20260807 08:40:19.128911 16493 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 3a23667e3d3343d283b0dffb86ed369c (127.8.208.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: false } } }
I20260807 08:40:19.129828 16839 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1da71c42e9a941adbd04972d66e00568" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: false } } }
I20260807 08:40:19.129921 16839 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:19.129882 17009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1da71c42e9a941adbd04972d66e00568" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: false } } }
I20260807 08:40:19.129994 17009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:19.130118 16839 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1da71c42e9a941adbd04972d66e00568" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: false } } }
I20260807 08:40:19.130218 16839 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568 [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:19.130820 16296 raft_consensus.cc:2932] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 3a23667e3d3343d283b0dffb86ed369c (127.8.208.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: false } } }
I20260807 08:40:19.130957 16528 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1da71c42e9a941adbd04972d66e00568" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: false } } }
I20260807 08:40:19.131054 16528 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:40:19.135255 17011 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1da71c42e9a941adbd04972d66e00568" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: false } } }
I20260807 08:40:19.135367 17011 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:40:19.137768 16840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.132236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:41233 (local address 127.0.0.1:43698)
0807 08:40:19.132408 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:19.132424 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:19.132499 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:19.133696 (+ 1197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:19.133699 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:19.133729 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:19.133821 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:19.133827 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.135156 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.135161 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:19.136186 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:19.136196 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.137433 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.137436 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:19.137511 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.137530 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 08:40:19.137596 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 08:40:19.137664 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83}
I20260807 08:40:19.137836 17015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.132697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43698 (local address 127.8.208.195:41233)
0807 08:40:19.133196 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:19.133208 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:19.133235 (+ 27us) server_negotiation.cc:407] Connection header received
0807 08:40:19.133312 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:19.133317 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:19.133535 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:19.134002 (+ 467us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:19.134147 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.135046 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.136304 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.137316 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.137423 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.137548 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:19.137629 (+ 81us) server_negotiation.cc:299] Negotiation successful
0807 08:40:19.137704 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":129,"threads_started":1}
I20260807 08:40:19.139377 17017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.134049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:33125 (local address 127.0.0.1:37620)
0807 08:40:19.134313 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:19.134326 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:19.134397 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:19.135196 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:19.135198 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:19.135214 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:19.135305 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:19.135310 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.136999 (+ 1689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.137002 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:19.137981 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:19.137990 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.138988 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.138991 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:19.139088 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.139110 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 08:40:19.139181 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 08:40:19.139245 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":96,"threads_started":1}
I20260807 08:40:19.139635 17018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.134458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37620 (local address 127.8.208.194:33125)
0807 08:40:19.134793 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:19.134804 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:19.134824 (+ 20us) server_negotiation.cc:407] Connection header received
0807 08:40:19.134893 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:19.134897 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:19.135062 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:19.135516 (+ 454us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:19.135663 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.136883 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.138319 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.138874 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.138955 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.139060 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:19.139223 (+ 163us) server_negotiation.cc:299] Negotiation successful
0807 08:40:19.139319 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":102,"threads_started":1}
I20260807 08:40:19.140439 16907 tablet_service.cc:1467] Processing CreateTablet for tablet 3b7894fe36a1475bb2ab376acfdb0be2 (DEFAULT_TABLE table=test-table [id=b810bfe399884d67ae5f39662481df64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:19.141399 16907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b7894fe36a1475bb2ab376acfdb0be2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:19.143960 16755 tablet_service.cc:1467] Processing CreateTablet for tablet 3b7894fe36a1475bb2ab376acfdb0be2 (DEFAULT_TABLE table=test-table [id=b810bfe399884d67ae5f39662481df64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:19.144892 16755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b7894fe36a1475bb2ab376acfdb0be2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:19.146242 17013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.132530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:39547 (local address 127.0.0.1:38042)
0807 08:40:19.134126 (+ 1596us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:19.134137 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:19.134255 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:19.134883 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:19.134886 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:19.134901 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:19.134998 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:19.135003 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.136347 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.136350 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:19.137428 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:19.137438 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.138391 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.138396 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:19.145922 (+ 7526us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.145951 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 08:40:19.146029 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 08:40:19.146102 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1547,"thread_start_us":102,"threads_started":1}
I20260807 08:40:19.146842 17016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.132959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38042 (local address 127.8.208.193:39547)
0807 08:40:19.133994 (+ 1035us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:19.134008 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:19.134350 (+ 342us) server_negotiation.cc:407] Connection header received
0807 08:40:19.134428 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:19.134435 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:19.134618 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:19.134749 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:19.135119 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.136219 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.137544 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.138280 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.138371 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.138486 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:19.146571 (+ 8085us) server_negotiation.cc:299] Negotiation successful
0807 08:40:19.146686 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":935,"thread_start_us":133,"threads_started":1}
I20260807 08:40:19.149461 16609 tablet_service.cc:1467] Processing CreateTablet for tablet 3b7894fe36a1475bb2ab376acfdb0be2 (DEFAULT_TABLE table=test-table [id=b810bfe399884d67ae5f39662481df64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:19.149905 17019 tablet_bootstrap.cc:492] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d: Bootstrap starting.
I20260807 08:40:19.150406 16609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b7894fe36a1475bb2ab376acfdb0be2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:19.152019 17019 tablet_bootstrap.cc:654] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:19.152904 17019 log.cc:824] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:19.154147 17020 tablet_bootstrap.cc:492] T 3b7894fe36a1475bb2ab376acfdb0be2 P 3ffd435e99a84e969eb52e5e8270697b: Bootstrap starting.
I20260807 08:40:19.154845 17019 tablet_bootstrap.cc:492] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d: No bootstrap required, opened a new log
I20260807 08:40:19.155064 17019 ts_tablet_manager.cc:1397] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 08:40:19.156210 17020 tablet_bootstrap.cc:654] T 3b7894fe36a1475bb2ab376acfdb0be2 P 3ffd435e99a84e969eb52e5e8270697b: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:19.157050 17020 log.cc:824] T 3b7894fe36a1475bb2ab376acfdb0be2 P 3ffd435e99a84e969eb52e5e8270697b: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:19.158041 17024 tablet_bootstrap.cc:492] T 3b7894fe36a1475bb2ab376acfdb0be2 P 7eaeed1bd2884ff1a20a897907db390f: Bootstrap starting.
I20260807 08:40:19.159010 17020 tablet_bootstrap.cc:492] T 3b7894fe36a1475bb2ab376acfdb0be2 P 3ffd435e99a84e969eb52e5e8270697b: No bootstrap required, opened a new log
I20260807 08:40:19.159191 17020 ts_tablet_manager.cc:1397] T 3b7894fe36a1475bb2ab376acfdb0be2 P 3ffd435e99a84e969eb52e5e8270697b: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260807 08:40:19.159639 17019 raft_consensus.cc:348] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eaeed1bd2884ff1a20a897907db390f" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39547 } } peers { permanent_uuid: "9a888333f0be4ec0892844bec224461d" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41233 } } peers { permanent_uuid: "3ffd435e99a84e969eb52e5e8270697b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33125 } }
I20260807 08:40:19.159873 17019 raft_consensus.cc:374] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:19.159941 17019 raft_consensus.cc:729] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a888333f0be4ec0892844bec224461d, State: Initialized, Role: FOLLOWER
I20260807 08:40:19.160092 17024 tablet_bootstrap.cc:654] T 3b7894fe36a1475bb2ab376acfdb0be2 P 7eaeed1bd2884ff1a20a897907db390f: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:19.160414 17019 consensus_queue.cc:260] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eaeed1bd2884ff1a20a897907db390f" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39547 } } peers { permanent_uuid: "9a888333f0be4ec0892844bec224461d" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41233 } } peers { permanent_uuid: "3ffd435e99a84e969eb52e5e8270697b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33125 } }
I20260807 08:40:19.160876 17024 log.cc:824] T 3b7894fe36a1475bb2ab376acfdb0be2 P 7eaeed1bd2884ff1a20a897907db390f: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:19.161325 17019 ts_tablet_manager.cc:1428] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 08:40:19.161509 16983 heartbeater.cc:503] Master 127.8.208.254:35737 was elected leader, sending a full tablet report...
I20260807 08:40:19.162909 17024 tablet_bootstrap.cc:492] T 3b7894fe36a1475bb2ab376acfdb0be2 P 7eaeed1bd2884ff1a20a897907db390f: No bootstrap required, opened a new log
I20260807 08:40:19.163070 17024 ts_tablet_manager.cc:1397] T 3b7894fe36a1475bb2ab376acfdb0be2 P 7eaeed1bd2884ff1a20a897907db390f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 08:40:19.163594 17020 raft_consensus.cc:348] T 3b7894fe36a1475bb2ab376acfdb0be2 P 3ffd435e99a84e969eb52e5e8270697b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eaeed1bd2884ff1a20a897907db390f" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39547 } } peers { permanent_uuid: "9a888333f0be4ec0892844bec224461d" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41233 } } peers { permanent_uuid: "3ffd435e99a84e969eb52e5e8270697b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33125 } }
I20260807 08:40:19.163826 17020 raft_consensus.cc:374] T 3b7894fe36a1475bb2ab376acfdb0be2 P 3ffd435e99a84e969eb52e5e8270697b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:19.163887 17020 raft_consensus.cc:729] T 3b7894fe36a1475bb2ab376acfdb0be2 P 3ffd435e99a84e969eb52e5e8270697b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ffd435e99a84e969eb52e5e8270697b, State: Initialized, Role: FOLLOWER
I20260807 08:40:19.164287 17020 consensus_queue.cc:260] T 3b7894fe36a1475bb2ab376acfdb0be2 P 3ffd435e99a84e969eb52e5e8270697b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eaeed1bd2884ff1a20a897907db390f" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39547 } } peers { permanent_uuid: "9a888333f0be4ec0892844bec224461d" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41233 } } peers { permanent_uuid: "3ffd435e99a84e969eb52e5e8270697b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33125 } }
I20260807 08:40:19.165135 17020 ts_tablet_manager.cc:1428] T 3b7894fe36a1475bb2ab376acfdb0be2 P 3ffd435e99a84e969eb52e5e8270697b: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260807 08:40:19.165900 16829 heartbeater.cc:503] Master 127.8.208.254:35737 was elected leader, sending a full tablet report...
I20260807 08:40:19.167241 17024 raft_consensus.cc:348] T 3b7894fe36a1475bb2ab376acfdb0be2 P 7eaeed1bd2884ff1a20a897907db390f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eaeed1bd2884ff1a20a897907db390f" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39547 } } peers { permanent_uuid: "9a888333f0be4ec0892844bec224461d" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41233 } } peers { permanent_uuid: "3ffd435e99a84e969eb52e5e8270697b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33125 } }
I20260807 08:40:19.167474 17024 raft_consensus.cc:374] T 3b7894fe36a1475bb2ab376acfdb0be2 P 7eaeed1bd2884ff1a20a897907db390f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:19.167526 17024 raft_consensus.cc:729] T 3b7894fe36a1475bb2ab376acfdb0be2 P 7eaeed1bd2884ff1a20a897907db390f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eaeed1bd2884ff1a20a897907db390f, State: Initialized, Role: FOLLOWER
I20260807 08:40:19.167919 17024 consensus_queue.cc:260] T 3b7894fe36a1475bb2ab376acfdb0be2 P 7eaeed1bd2884ff1a20a897907db390f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eaeed1bd2884ff1a20a897907db390f" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39547 } } peers { permanent_uuid: "9a888333f0be4ec0892844bec224461d" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41233 } } peers { permanent_uuid: "3ffd435e99a84e969eb52e5e8270697b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33125 } }
I20260807 08:40:19.168588 16682 heartbeater.cc:503] Master 127.8.208.254:35737 was elected leader, sending a full tablet report...
I20260807 08:40:19.168761 17024 ts_tablet_manager.cc:1428] T 3b7894fe36a1475bb2ab376acfdb0be2 P 7eaeed1bd2884ff1a20a897907db390f: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260807 08:40:19.337798 16985 tablet.cc:2369] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 08:40:19.378278 16831 tablet.cc:2369] T 3b7894fe36a1475bb2ab376acfdb0be2 P 3ffd435e99a84e969eb52e5e8270697b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 08:40:19.408602 16684 tablet.cc:2369] T 3b7894fe36a1475bb2ab376acfdb0be2 P 7eaeed1bd2884ff1a20a897907db390f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 08:40:19.538095 17025 raft_consensus.cc:482] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:40:19.538271 17025 raft_consensus.cc:504] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eaeed1bd2884ff1a20a897907db390f" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39547 } } peers { permanent_uuid: "9a888333f0be4ec0892844bec224461d" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41233 } } peers { permanent_uuid: "3ffd435e99a84e969eb52e5e8270697b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33125 } }
I20260807 08:40:19.539275 17025 leader_election.cc:288] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eaeed1bd2884ff1a20a897907db390f (127.8.208.193:39547), 3ffd435e99a84e969eb52e5e8270697b (127.8.208.194:33125)
I20260807 08:40:19.542972 17018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.539613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:57497 (local address 127.8.208.194:33125)
0807 08:40:19.539729 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:19.539734 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:19.539815 (+ 81us) server_negotiation.cc:407] Connection header received
0807 08:40:19.540007 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:19.540009 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:19.540051 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:19.540122 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:19.540394 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.540869 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.541868 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.542389 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.542486 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.542524 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:19.542774 (+ 250us) server_negotiation.cc:299] Negotiation successful
0807 08:40:19.542842 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 08:40:19.542973 17016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.539543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:45777 (local address 127.8.208.193:39547)
0807 08:40:19.539649 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:19.539654 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:19.539670 (+ 16us) server_negotiation.cc:407] Connection header received
0807 08:40:19.539776 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:19.539780 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:19.539824 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:19.539893 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:19.540272 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.540786 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.541765 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.542320 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.542466 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.542517 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:19.542774 (+ 257us) server_negotiation.cc:299] Negotiation successful
0807 08:40:19.542842 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 08:40:19.543001 16986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.539474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:39547 (local address 127.8.208.195:45777)
0807 08:40:19.539576 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:19.539590 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:19.539670 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:19.540015 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:19.540017 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:19.540033 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:19.540160 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:19.540167 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.540894 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.540899 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:19.541641 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:19.541649 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.542466 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.542470 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:19.542628 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.542674 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 08:40:19.542745 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 08:40:19.542828 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":51}
I20260807 08:40:19.543005 16987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.539484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:33125 (local address 127.8.208.195:57497)
0807 08:40:19.539719 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:19.539732 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:19.539812 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:19.540140 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:19.540142 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:19.540155 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:19.540275 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:19.540281 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.540972 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.540974 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:19.541727 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:19.541736 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.542484 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.542486 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:19.542613 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.542677 (+ 64us) client_negotiation.cc:769] Sending connection context
0807 08:40:19.542745 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 08:40:19.542828 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":251}
I20260807 08:40:19.543637 16630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b7894fe36a1475bb2ab376acfdb0be2" candidate_uuid: "9a888333f0be4ec0892844bec224461d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eaeed1bd2884ff1a20a897907db390f" is_pre_election: true
I20260807 08:40:19.543820 16776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b7894fe36a1475bb2ab376acfdb0be2" candidate_uuid: "9a888333f0be4ec0892844bec224461d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ffd435e99a84e969eb52e5e8270697b" is_pre_election: true
I20260807 08:40:19.543924 16630 raft_consensus.cc:2454] T 3b7894fe36a1475bb2ab376acfdb0be2 P 7eaeed1bd2884ff1a20a897907db390f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a888333f0be4ec0892844bec224461d in term 0.
I20260807 08:40:19.544106 16776 raft_consensus.cc:2454] T 3b7894fe36a1475bb2ab376acfdb0be2 P 3ffd435e99a84e969eb52e5e8270697b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a888333f0be4ec0892844bec224461d in term 0.
I20260807 08:40:19.544379 16856 leader_election.cc:302] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eaeed1bd2884ff1a20a897907db390f, 9a888333f0be4ec0892844bec224461d; no voters:
I20260807 08:40:19.544658 17025 raft_consensus.cc:2781] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:40:19.544736 17025 raft_consensus.cc:482] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:40:19.544775 17025 raft_consensus.cc:3037] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:19.545709 17025 raft_consensus.cc:504] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eaeed1bd2884ff1a20a897907db390f" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39547 } } peers { permanent_uuid: "9a888333f0be4ec0892844bec224461d" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41233 } } peers { permanent_uuid: "3ffd435e99a84e969eb52e5e8270697b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33125 } }
I20260807 08:40:19.546136 17025 leader_election.cc:288] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d [CANDIDATE]: Term 1 election: Requested vote from peers 7eaeed1bd2884ff1a20a897907db390f (127.8.208.193:39547), 3ffd435e99a84e969eb52e5e8270697b (127.8.208.194:33125)
I20260807 08:40:19.546463 16776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b7894fe36a1475bb2ab376acfdb0be2" candidate_uuid: "9a888333f0be4ec0892844bec224461d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ffd435e99a84e969eb52e5e8270697b"
I20260807 08:40:19.546473 16630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b7894fe36a1475bb2ab376acfdb0be2" candidate_uuid: "9a888333f0be4ec0892844bec224461d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eaeed1bd2884ff1a20a897907db390f"
I20260807 08:40:19.546584 16776 raft_consensus.cc:3037] T 3b7894fe36a1475bb2ab376acfdb0be2 P 3ffd435e99a84e969eb52e5e8270697b [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:19.546584 16630 raft_consensus.cc:3037] T 3b7894fe36a1475bb2ab376acfdb0be2 P 7eaeed1bd2884ff1a20a897907db390f [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:19.547804 16776 raft_consensus.cc:2454] T 3b7894fe36a1475bb2ab376acfdb0be2 P 3ffd435e99a84e969eb52e5e8270697b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a888333f0be4ec0892844bec224461d in term 1.
I20260807 08:40:19.547804 16630 raft_consensus.cc:2454] T 3b7894fe36a1475bb2ab376acfdb0be2 P 7eaeed1bd2884ff1a20a897907db390f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a888333f0be4ec0892844bec224461d in term 1.
I20260807 08:40:19.548107 16856 leader_election.cc:302] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3ffd435e99a84e969eb52e5e8270697b, 7eaeed1bd2884ff1a20a897907db390f, 9a888333f0be4ec0892844bec224461d; no voters:
I20260807 08:40:19.548302 17025 raft_consensus.cc:2781] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:19.548475 17025 raft_consensus.cc:686] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d [term 1 LEADER]: Becoming Leader. State: Replica: 9a888333f0be4ec0892844bec224461d, State: Running, Role: LEADER
I20260807 08:40:19.548871 17025 consensus_queue.cc:237] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eaeed1bd2884ff1a20a897907db390f" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39547 } } peers { permanent_uuid: "9a888333f0be4ec0892844bec224461d" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41233 } } peers { permanent_uuid: "3ffd435e99a84e969eb52e5e8270697b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33125 } }
I20260807 08:40:19.551999 15645 catalog_manager.cc:5495] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a888333f0be4ec0892844bec224461d (127.8.208.195). New cstate: current_term: 1 leader_uuid: "9a888333f0be4ec0892844bec224461d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eaeed1bd2884ff1a20a897907db390f" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a888333f0be4ec0892844bec224461d" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ffd435e99a84e969eb52e5e8270697b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33125 } health_report { overall_health: UNKNOWN } } }
I20260807 08:40:19.588126 17015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.584970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43702 (local address 127.8.208.195:41233)
0807 08:40:19.585067 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:19.585071 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:19.585088 (+ 17us) server_negotiation.cc:407] Connection header received
0807 08:40:19.585232 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:19.585234 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:19.585278 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:19.585348 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:40:19.585567 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.586165 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.587065 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.587235 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.587304 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.587527 (+ 223us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:40:19.587861 (+ 334us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:40:19.587942 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:19.588000 (+ 58us) server_negotiation.cc:299] Negotiation successful
0807 08:40:19.588041 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 08:40:19.592753 16630 raft_consensus.cc:1261] T 3b7894fe36a1475bb2ab376acfdb0be2 P 7eaeed1bd2884ff1a20a897907db390f [term 1 FOLLOWER]: Refusing update from remote peer 9a888333f0be4ec0892844bec224461d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:40:19.592813 16776 raft_consensus.cc:1261] T 3b7894fe36a1475bb2ab376acfdb0be2 P 3ffd435e99a84e969eb52e5e8270697b [term 1 FOLLOWER]: Refusing update from remote peer 9a888333f0be4ec0892844bec224461d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:40:19.593367 17029 consensus_queue.cc:1035] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eaeed1bd2884ff1a20a897907db390f" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:40:19.593511 17025 consensus_queue.cc:1035] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ffd435e99a84e969eb52e5e8270697b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:40:19.608239 15645 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:40:19.608371 15645 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:40:19.609579 17033 mvcc.cc:205] Tried to move back new op lower bound from 7315832912246321152 to 7315832912074252288. Current Snapshot: MvccSnapshot[applied={T|T < 7315832912246321152}]
I20260807 08:40:19.613880 15645 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1da71c42e9a941adbd04972d66e00568: Sending DeleteTablet for 3 replicas of tablet 3b7894fe36a1475bb2ab376acfdb0be2
I20260807 08:40:19.614643 16907 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b7894fe36a1475bb2ab376acfdb0be2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:19 UTC) from {username='oryx', principal='oryx/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:43698
I20260807 08:40:19.614732 16755 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b7894fe36a1475bb2ab376acfdb0be2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:19 UTC) from {username='oryx', principal='oryx/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:37620
I20260807 08:40:19.615114 17043 tablet_replica.cc:330] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d: stopping tablet replica
I20260807 08:40:19.615398 17043 raft_consensus.cc:2229] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d [term 1 LEADER]: Raft consensus shutting down.
I20260807 08:40:19.615739 17043 raft_consensus.cc:2258] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:19.616051 17044 tablet_replica.cc:330] T 3b7894fe36a1475bb2ab376acfdb0be2 P 3ffd435e99a84e969eb52e5e8270697b: stopping tablet replica
I20260807 08:40:19.616333 17044 raft_consensus.cc:2229] T 3b7894fe36a1475bb2ab376acfdb0be2 P 3ffd435e99a84e969eb52e5e8270697b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:40:19.616315 16608 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b7894fe36a1475bb2ab376acfdb0be2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:19 UTC) from {username='oryx', principal='oryx/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:38042
I20260807 08:40:19.616621 16609 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b7894fe36a1475bb2ab376acfdb0be2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:19 UTC) from {username='oryx', principal='oryx/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:38042
I20260807 08:40:19.616643 17044 raft_consensus.cc:2258] T 3b7894fe36a1475bb2ab376acfdb0be2 P 3ffd435e99a84e969eb52e5e8270697b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:19.618305 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 15610
I20260807 08:40:19.623093 17043 ts_tablet_manager.cc:1905] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:19.625379 17046 tablet_replica.cc:330] T 3b7894fe36a1475bb2ab376acfdb0be2 P 7eaeed1bd2884ff1a20a897907db390f: stopping tablet replica
I20260807 08:40:19.625667 17046 raft_consensus.cc:2229] T 3b7894fe36a1475bb2ab376acfdb0be2 P 7eaeed1bd2884ff1a20a897907db390f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:40:19.625982 17046 raft_consensus.cc:2258] T 3b7894fe36a1475bb2ab376acfdb0be2 P 7eaeed1bd2884ff1a20a897907db390f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:19.626044 17043 ts_tablet_manager.cc:1918] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:40:19.626147 17043 log.cc:1196] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/3b7894fe36a1475bb2ab376acfdb0be2
I20260807 08:40:19.626531 17043 ts_tablet_manager.cc:1939] T 3b7894fe36a1475bb2ab376acfdb0be2 P 9a888333f0be4ec0892844bec224461d: Deleting consensus metadata
I20260807 08:40:19.628235 17048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.617170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40284 (local address 127.8.208.253:32955)
0807 08:40:19.617352 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:19.617355 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:19.617365 (+ 10us) server_negotiation.cc:407] Connection header received
0807 08:40:19.617412 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:19.617416 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:19.617466 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:19.617550 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:19.619907 (+ 2357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.620599 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.621343 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.621577 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.621690 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.623688 (+ 1998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:19.623691 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:19.623693 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:19.623714 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:19.625410 (+ 1696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:19.626349 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:19.626353 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:19.626355 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:19.626467 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:19.626892 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:19.626906 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:19.626907 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:19.627107 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:19.627221 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:19.627944 (+ 723us) server_negotiation.cc:299] Negotiation successful
0807 08:40:19.628065 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":68,"threads_started":1}
I20260807 08:40:19.629772 17044 ts_tablet_manager.cc:1905] T 3b7894fe36a1475bb2ab376acfdb0be2 P 3ffd435e99a84e969eb52e5e8270697b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:19.631055 17046 ts_tablet_manager.cc:1905] T 3b7894fe36a1475bb2ab376acfdb0be2 P 7eaeed1bd2884ff1a20a897907db390f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:19.632364 17044 ts_tablet_manager.cc:1918] T 3b7894fe36a1475bb2ab376acfdb0be2 P 3ffd435e99a84e969eb52e5e8270697b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:40:19.632470 17044 log.cc:1196] T 3b7894fe36a1475bb2ab376acfdb0be2 P 3ffd435e99a84e969eb52e5e8270697b: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/wal/wals/3b7894fe36a1475bb2ab376acfdb0be2
I20260807 08:40:19.632771 17044 ts_tablet_manager.cc:1939] T 3b7894fe36a1475bb2ab376acfdb0be2 P 3ffd435e99a84e969eb52e5e8270697b: Deleting consensus metadata
W20260807 08:40:19.634011 16706 connection.cc:535] server connection from 127.0.0.1:37620 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 08:40:19.634541 17046 ts_tablet_manager.cc:1918] T 3b7894fe36a1475bb2ab376acfdb0be2 P 7eaeed1bd2884ff1a20a897907db390f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260807 08:40:19.634548 16854 connection.cc:535] server connection from 127.0.0.1:43698 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 08:40:19.634702 17046 log.cc:1196] T 3b7894fe36a1475bb2ab376acfdb0be2 P 7eaeed1bd2884ff1a20a897907db390f: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-0/wal/wals/3b7894fe36a1475bb2ab376acfdb0be2
I20260807 08:40:19.635164 17046 ts_tablet_manager.cc:1939] T 3b7894fe36a1475bb2ab376acfdb0be2 P 7eaeed1bd2884ff1a20a897907db390f: Deleting consensus metadata
W20260807 08:40:19.635358 16466 connection.cc:535] server connection from 127.0.0.1:58140 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 08:40:19.635615 16857 connection.cc:535] client connection to 127.8.208.254:35737 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 08:40:19.635906 16983 heartbeater.cc:644] Failed to heartbeat to 127.8.208.254:35737 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 08:40:19.636369 17047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.616804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58156 (local address 127.8.208.252:34643)
0807 08:40:19.617000 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:19.617004 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:19.627772 (+ 10768us) server_negotiation.cc:407] Connection header received
0807 08:40:19.627870 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:19.627873 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:19.627916 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:19.627988 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:19.628776 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.629386 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.630256 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.630567 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.630638 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.632347 (+ 1709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:19.632351 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:19.632353 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:19.632388 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:19.634321 (+ 1933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:19.634818 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:19.634824 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:19.634829 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:19.634916 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:19.635241 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:19.635245 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:19.635246 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:19.635518 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:19.635629 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:19.636018 (+ 389us) server_negotiation.cc:299] Negotiation successful
0807 08:40:19.636180 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":86,"threads_started":1}
W20260807 08:40:19.636749 16558 connection.cc:441] server connection from 127.0.0.1:38042 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38042 (request call id 2) could send its response
W20260807 08:40:19.637226 16558 connection.cc:441] server connection from 127.0.0.1:38042 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38042 (request call id 1) could send its response
I20260807 08:40:19.648391 17048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.638644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40300 (local address 127.8.208.253:32955)
0807 08:40:19.638805 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:19.638809 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:19.639660 (+ 851us) server_negotiation.cc:407] Connection header received
0807 08:40:19.639803 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:19.639805 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:19.639845 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:19.639936 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:19.640765 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.641253 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.642435 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.642795 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.642868 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.644523 (+ 1655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:19.644527 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:19.644530 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:19.644573 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:19.646561 (+ 1988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:19.647155 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:19.647159 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:19.647160 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:19.647239 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:19.647502 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:19.647507 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:19.647509 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:19.647742 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:19.647878 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:19.648156 (+ 278us) server_negotiation.cc:299] Negotiation successful
0807 08:40:19.648262 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 08:40:19.650520 17047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:19.639225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58172 (local address 127.8.208.252:34643)
0807 08:40:19.639362 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:19.639366 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:19.642200 (+ 2834us) server_negotiation.cc:407] Connection header received
0807 08:40:19.642347 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:19.642364 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:19.642418 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:19.642527 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:19.643246 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.643901 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.644801 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:19.645155 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:19.645259 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:19.647156 (+ 1897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:19.647160 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:19.647163 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:19.647187 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:19.648835 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:19.649295 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:19.649298 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:19.649300 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:19.649383 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:19.649670 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:19.649673 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:19.649675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:19.649939 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:19.650055 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:19.650286 (+ 231us) server_negotiation.cc:299] Negotiation successful
0807 08:40:19.650391 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 08:40:20.604837 17058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:20.604285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.8.208.194:33661)
0807 08:40:20.604622 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:20.604717 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":98,"threads_started":1}
W20260807 08:40:20.605245 16829 heartbeater.cc:644] Failed to heartbeat to 127.8.208.254:35737 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
I20260807 08:40:20.618019 17059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:20.617542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.8.208.193:50787)
0807 08:40:20.617845 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:20.617933 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":81,"threads_started":1}
W20260807 08:40:20.618316 16682 heartbeater.cc:644] Failed to heartbeat to 127.8.208.254:35737 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
I20260807 08:40:20.636878 17060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:20.636474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.8.208.195:55557)
0807 08:40:20.636721 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:20.636793 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":65,"threads_started":1}
I20260807 08:40:21.114675 17061 raft_consensus.cc:482] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1da71c42e9a941adbd04972d66e00568)
I20260807 08:40:21.114903 17061 raft_consensus.cc:504] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: false } }
I20260807 08:40:21.115759 17061 leader_election.cc:288] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1da71c42e9a941adbd04972d66e00568 (127.8.208.254:35737), 3a23667e3d3343d283b0dffb86ed369c (127.8.208.252:34643)
I20260807 08:40:21.116410 17062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.115954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.0.0.1:40770)
0807 08:40:21.116189 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.116282 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":82,"threads_started":1}
W20260807 08:40:21.116657 16272 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
I20260807 08:40:21.117514 17062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.117293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.0.0.1:40778)
0807 08:40:21.117418 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.117461 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260807 08:40:21.117681 16272 leader_election.cc:334] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1da71c42e9a941adbd04972d66e00568 (127.8.208.254:35737): Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
I20260807 08:40:21.119860 17063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.116293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:34643 (local address 127.0.0.1:58176)
0807 08:40:21.116545 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.116562 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:21.116669 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:21.117115 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:21.117118 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:21.117138 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:21.117250 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:21.117255 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:21.118168 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:21.118171 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:21.118978 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:21.118987 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:21.119580 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:21.119582 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:21.119645 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:21.119665 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 08:40:21.119720 (+ 55us) client_negotiation.cc:240] Negotiation successful
0807 08:40:21.119771 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":70,"threads_started":1}
I20260807 08:40:21.119951 17064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.116484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58176 (local address 127.8.208.252:34643)
0807 08:40:21.116880 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:21.116884 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:21.116895 (+ 11us) server_negotiation.cc:407] Connection header received
0807 08:40:21.116959 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:21.116961 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:21.116997 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:21.117072 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:21.117368 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:21.118075 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:21.119085 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:21.119484 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:21.119566 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:21.119617 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:21.119751 (+ 134us) server_negotiation.cc:299] Negotiation successful
0807 08:40:21.119814 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":84,"threads_started":1}
I20260807 08:40:21.120374 16493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3a23667e3d3343d283b0dffb86ed369c" is_pre_election: true
I20260807 08:40:21.120849 16272 leader_election.cc:302] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb0067b7a44f41bb9ce80d4797ec363b; no voters: 1da71c42e9a941adbd04972d66e00568, 3a23667e3d3343d283b0dffb86ed369c
I20260807 08:40:21.121075 17061 raft_consensus.cc:2726] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 08:40:21.123396 17066 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1da71c42e9a941adbd04972d66e00568)
I20260807 08:40:21.123517 17066 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: false } }
I20260807 08:40:21.124150 17066 leader_election.cc:288] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1da71c42e9a941adbd04972d66e00568 (127.8.208.254:35737), bb0067b7a44f41bb9ce80d4797ec363b (127.8.208.253:32955)
I20260807 08:40:21.124728 17068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.124269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.0.0.1:40780)
0807 08:40:21.124505 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.124576 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":51,"threads_started":1}
W20260807 08:40:21.124909 16468 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
I20260807 08:40:21.125682 17068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.125512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.0.0.1:40786)
0807 08:40:21.125600 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.125640 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260807 08:40:21.125888 16468 leader_election.cc:334] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1da71c42e9a941adbd04972d66e00568 (127.8.208.254:35737): Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
I20260807 08:40:21.127712 17067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.124294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:32955 (local address 127.0.0.1:40310)
0807 08:40:21.124535 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.124545 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:21.124647 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:21.124962 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:21.124964 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:21.124979 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:21.125117 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:21.125122 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:21.126049 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:21.126053 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:21.126849 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:21.126858 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:21.127436 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:21.127439 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:21.127509 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:21.127527 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 08:40:21.127581 (+ 54us) client_negotiation.cc:240] Negotiation successful
0807 08:40:21.127630 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":65,"threads_started":1}
I20260807 08:40:21.127745 17069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.124481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40310 (local address 127.8.208.253:32955)
0807 08:40:21.124765 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:21.124771 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:21.124780 (+ 9us) server_negotiation.cc:407] Connection header received
0807 08:40:21.124829 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:21.124831 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:21.124865 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:21.124952 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:21.125232 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:21.125919 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:21.126972 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:21.127336 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:21.127412 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:21.127455 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:21.127609 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 08:40:21.127658 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":123,"threads_started":1}
I20260807 08:40:21.128175 16296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3a23667e3d3343d283b0dffb86ed369c" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" is_pre_election: true
I20260807 08:40:21.128353 16296 raft_consensus.cc:2454] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a23667e3d3343d283b0dffb86ed369c in term 1.
I20260807 08:40:21.128677 16466 leader_election.cc:302] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a23667e3d3343d283b0dffb86ed369c, bb0067b7a44f41bb9ce80d4797ec363b; no voters: 1da71c42e9a941adbd04972d66e00568
I20260807 08:40:21.128847 17066 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 08:40:21.128904 17066 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1da71c42e9a941adbd04972d66e00568)
I20260807 08:40:21.128930 17066 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [term 1 FOLLOWER]: Advancing to term 2
I20260807 08:40:21.129974 17066 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: false } }
I20260807 08:40:21.130287 17066 leader_election.cc:288] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [CANDIDATE]: Term 2 election: Requested vote from peers 1da71c42e9a941adbd04972d66e00568 (127.8.208.254:35737), bb0067b7a44f41bb9ce80d4797ec363b (127.8.208.253:32955)
I20260807 08:40:21.130618 17067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.130406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.0.0.1:40794)
0807 08:40:21.130513 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.130562 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260807 08:40:21.130606 16296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3a23667e3d3343d283b0dffb86ed369c" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "bb0067b7a44f41bb9ce80d4797ec363b"
I20260807 08:40:21.130759 16296 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [term 1 FOLLOWER]: Advancing to term 2
I20260807 08:40:21.131302 17067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.131112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.0.0.1:40800)
0807 08:40:21.131205 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.131254 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 08:40:21.131419 16468 leader_election.cc:334] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1da71c42e9a941adbd04972d66e00568 (127.8.208.254:35737): Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
I20260807 08:40:21.131827 16296 raft_consensus.cc:2454] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a23667e3d3343d283b0dffb86ed369c in term 2.
I20260807 08:40:21.132110 16466 leader_election.cc:302] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a23667e3d3343d283b0dffb86ed369c, bb0067b7a44f41bb9ce80d4797ec363b; no voters: 1da71c42e9a941adbd04972d66e00568
I20260807 08:40:21.132296 17066 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [term 2 FOLLOWER]: Leader election won for term 2
I20260807 08:40:21.132503 17066 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [term 2 LEADER]: Becoming Leader. State: Replica: 3a23667e3d3343d283b0dffb86ed369c, State: Running, Role: LEADER
I20260807 08:40:21.132740 17066 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: false } }
I20260807 08:40:21.134187 17071 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a23667e3d3343d283b0dffb86ed369c. Latest consensus state: current_term: 2 leader_uuid: "3a23667e3d3343d283b0dffb86ed369c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: false } } }
I20260807 08:40:21.134318 17071 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:21.134619 17074 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:40:21.136971 17074 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:40:21.137418 17074 catalog_manager.cc:1259] Loaded cluster ID: 823e534d40b54b65a027caf24944f346
I20260807 08:40:21.137467 17074 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:40:21.137997 17074 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:40:21.138368 17074 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c: Loaded TSK: 0
I20260807 08:40:21.138978 17074 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:40:21.158233 16483 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58172:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 08:40:21.161209 16483 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:40:21.164072 17067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.163824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.0.0.1:40824)
0807 08:40:21.163938 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.164003 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 08:40:21.164136 16296 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [term 2 FOLLOWER]: Refusing update from remote peer 3a23667e3d3343d283b0dffb86ed369c: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260807 08:40:21.164641 17071 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 08:40:21.164707 17067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.164510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.0.0.1:40838)
0807 08:40:21.164614 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.164662 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 08:40:21.164845 16468 consensus_peers.cc:487] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c -> Peer 1da71c42e9a941adbd04972d66e00568 (127.8.208.254:35737): Couldn't send request to peer 1da71c42e9a941adbd04972d66e00568. Status: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 08:40:21.166029 17061 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a23667e3d3343d283b0dffb86ed369c. Latest consensus state: current_term: 2 leader_uuid: "3a23667e3d3343d283b0dffb86ed369c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: false } } }
I20260807 08:40:21.166162 17061 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:40:21.167227 17071 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "3a23667e3d3343d283b0dffb86ed369c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: false } } }
I20260807 08:40:21.167555 17061 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "3a23667e3d3343d283b0dffb86ed369c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1da71c42e9a941adbd04972d66e00568" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35737 } } peers { permanent_uuid: "bb0067b7a44f41bb9ce80d4797ec363b" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 32955 } attrs { promote: false } } peers { permanent_uuid: "3a23667e3d3343d283b0dffb86ed369c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34643 } attrs { promote: false } } }
I20260807 08:40:21.167613 17071 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:21.167667 17061 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb0067b7a44f41bb9ce80d4797ec363b [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:40:21.177708 17067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.173045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:39547 (local address 127.0.0.1:38046)
0807 08:40:21.173155 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.173172 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:21.173278 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:21.174626 (+ 1348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:21.174628 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:21.174644 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:21.174716 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:21.174721 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:21.175727 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:21.175730 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:21.176525 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:21.176533 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:21.177328 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:21.177331 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:21.177418 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:21.177445 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 08:40:21.177520 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 08:40:21.177600 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47,"mutex_wait_us":40}
I20260807 08:40:21.177723 17081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.173172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38046 (local address 127.8.208.193:39547)
0807 08:40:21.174280 (+ 1108us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:21.174286 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:21.174304 (+ 18us) server_negotiation.cc:407] Connection header received
0807 08:40:21.174395 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:21.174397 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:21.174443 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:21.174619 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:21.174855 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:21.175584 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:21.176648 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:21.177218 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:21.177329 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:21.177387 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:21.177547 (+ 160us) server_negotiation.cc:299] Negotiation successful
0807 08:40:21.177614 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1017,"thread_start_us":66,"threads_started":1}
I20260807 08:40:21.178602 17068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.173312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:41233 (local address 127.0.0.1:43718)
0807 08:40:21.173423 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.173437 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:21.173518 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:21.174311 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:21.174314 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:21.174331 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:21.174494 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:21.174501 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:21.175622 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:21.175626 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:21.176952 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:21.176976 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:21.178161 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:21.178166 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:21.178281 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:21.178311 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 08:40:21.178380 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 08:40:21.178454 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":36}
I20260807 08:40:21.178642 16609 tablet_service.cc:1467] Processing CreateTablet for tablet 51961a5f05ac4d9d9f656775f1513189 (DEFAULT_TABLE table=test-table [id=85c75c75ce1e47c7a695e601e7dd281c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:21.178938 16609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51961a5f05ac4d9d9f656775f1513189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:21.179162 17082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.173566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:33125 (local address 127.0.0.1:37626)
0807 08:40:21.173847 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.173862 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:21.173958 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:21.174523 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:21.174530 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:21.174558 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:21.174676 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:21.174684 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:21.175549 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:21.175556 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:21.177643 (+ 2087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:21.177653 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:21.178726 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:21.178732 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:21.178879 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:21.178904 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 08:40:21.178958 (+ 54us) client_negotiation.cc:240] Negotiation successful
0807 08:40:21.179029 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":63,"thread_start_us":120,"threads_started":1}
I20260807 08:40:21.179252 17083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.173607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43718 (local address 127.8.208.195:41233)
0807 08:40:21.174044 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:21.174048 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:21.174069 (+ 21us) server_negotiation.cc:407] Connection header received
0807 08:40:21.174134 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:21.174136 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:21.174184 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:21.174604 (+ 420us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:21.174720 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:21.175526 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:21.177133 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:21.178019 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:21.178900 (+ 881us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:21.178983 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:21.179023 (+ 40us) server_negotiation.cc:299] Negotiation successful
0807 08:40:21.179106 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":97,"threads_started":1}
I20260807 08:40:21.179780 17084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.173982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37626 (local address 127.8.208.194:33125)
0807 08:40:21.174265 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:21.174270 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:21.174284 (+ 14us) server_negotiation.cc:407] Connection header received
0807 08:40:21.174333 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:21.174336 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:21.174395 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:21.174480 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:21.174826 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:21.175419 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:21.177802 (+ 2383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:21.178564 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:21.179370 (+ 806us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:21.179450 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:21.179491 (+ 41us) server_negotiation.cc:299] Negotiation successful
0807 08:40:21.179608 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":95,"threads_started":1}
I20260807 08:40:21.179728 16907 tablet_service.cc:1467] Processing CreateTablet for tablet 51961a5f05ac4d9d9f656775f1513189 (DEFAULT_TABLE table=test-table [id=85c75c75ce1e47c7a695e601e7dd281c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:21.179991 16907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51961a5f05ac4d9d9f656775f1513189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:21.181432 17085 tablet_bootstrap.cc:492] T 51961a5f05ac4d9d9f656775f1513189 P 7eaeed1bd2884ff1a20a897907db390f: Bootstrap starting.
I20260807 08:40:21.181878 16755 tablet_service.cc:1467] Processing CreateTablet for tablet 51961a5f05ac4d9d9f656775f1513189 (DEFAULT_TABLE table=test-table [id=85c75c75ce1e47c7a695e601e7dd281c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:21.182174 16755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51961a5f05ac4d9d9f656775f1513189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:21.182572 17086 tablet_bootstrap.cc:492] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d: Bootstrap starting.
I20260807 08:40:21.182650 17085 tablet_bootstrap.cc:654] T 51961a5f05ac4d9d9f656775f1513189 P 7eaeed1bd2884ff1a20a897907db390f: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:21.183275 17086 tablet_bootstrap.cc:654] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:21.183871 17085 tablet_bootstrap.cc:492] T 51961a5f05ac4d9d9f656775f1513189 P 7eaeed1bd2884ff1a20a897907db390f: No bootstrap required, opened a new log
I20260807 08:40:21.184038 17085 ts_tablet_manager.cc:1397] T 51961a5f05ac4d9d9f656775f1513189 P 7eaeed1bd2884ff1a20a897907db390f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 08:40:21.184288 17086 tablet_bootstrap.cc:492] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d: No bootstrap required, opened a new log
I20260807 08:40:21.184396 17086 ts_tablet_manager.cc:1397] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 08:40:21.184541 17085 raft_consensus.cc:348] T 51961a5f05ac4d9d9f656775f1513189 P 7eaeed1bd2884ff1a20a897907db390f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eaeed1bd2884ff1a20a897907db390f" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39547 } } peers { permanent_uuid: "9a888333f0be4ec0892844bec224461d" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41233 } } peers { permanent_uuid: "3ffd435e99a84e969eb52e5e8270697b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33125 } }
I20260807 08:40:21.184692 17085 raft_consensus.cc:374] T 51961a5f05ac4d9d9f656775f1513189 P 7eaeed1bd2884ff1a20a897907db390f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:21.184741 17085 raft_consensus.cc:729] T 51961a5f05ac4d9d9f656775f1513189 P 7eaeed1bd2884ff1a20a897907db390f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eaeed1bd2884ff1a20a897907db390f, State: Initialized, Role: FOLLOWER
I20260807 08:40:21.184767 17086 raft_consensus.cc:348] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eaeed1bd2884ff1a20a897907db390f" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39547 } } peers { permanent_uuid: "9a888333f0be4ec0892844bec224461d" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41233 } } peers { permanent_uuid: "3ffd435e99a84e969eb52e5e8270697b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33125 } }
I20260807 08:40:21.184875 17086 raft_consensus.cc:374] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:21.184916 17086 raft_consensus.cc:729] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a888333f0be4ec0892844bec224461d, State: Initialized, Role: FOLLOWER
I20260807 08:40:21.184899 17085 consensus_queue.cc:260] T 51961a5f05ac4d9d9f656775f1513189 P 7eaeed1bd2884ff1a20a897907db390f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eaeed1bd2884ff1a20a897907db390f" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39547 } } peers { permanent_uuid: "9a888333f0be4ec0892844bec224461d" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41233 } } peers { permanent_uuid: "3ffd435e99a84e969eb52e5e8270697b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33125 } }
I20260807 08:40:21.185046 17086 consensus_queue.cc:260] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eaeed1bd2884ff1a20a897907db390f" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39547 } } peers { permanent_uuid: "9a888333f0be4ec0892844bec224461d" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41233 } } peers { permanent_uuid: "3ffd435e99a84e969eb52e5e8270697b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33125 } }
I20260807 08:40:21.185307 17085 ts_tablet_manager.cc:1428] T 51961a5f05ac4d9d9f656775f1513189 P 7eaeed1bd2884ff1a20a897907db390f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 08:40:21.185343 17086 ts_tablet_manager.cc:1428] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 08:40:21.185468 17090 tablet_bootstrap.cc:492] T 51961a5f05ac4d9d9f656775f1513189 P 3ffd435e99a84e969eb52e5e8270697b: Bootstrap starting.
I20260807 08:40:21.186571 17090 tablet_bootstrap.cc:654] T 51961a5f05ac4d9d9f656775f1513189 P 3ffd435e99a84e969eb52e5e8270697b: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:21.186796 17093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.186293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.8.208.195:48627)
0807 08:40:21.186599 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.186673 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":112,"threads_started":1}
I20260807 08:40:21.187702 17095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.187282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.8.208.195:44061)
0807 08:40:21.187533 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.187594 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":124,"threads_started":1}
I20260807 08:40:21.187894 16681 heartbeater.cc:503] Master 127.8.208.252:34643 was elected leader, sending a full tablet report...
I20260807 08:40:21.188401 17090 tablet_bootstrap.cc:492] T 51961a5f05ac4d9d9f656775f1513189 P 3ffd435e99a84e969eb52e5e8270697b: No bootstrap required, opened a new log
I20260807 08:40:21.188503 17090 ts_tablet_manager.cc:1397] T 51961a5f05ac4d9d9f656775f1513189 P 3ffd435e99a84e969eb52e5e8270697b: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260807 08:40:21.188869 17096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.188522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.8.208.193:57299)
0807 08:40:21.188729 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.188779 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":88,"threads_started":1}
I20260807 08:40:21.189009 17090 raft_consensus.cc:348] T 51961a5f05ac4d9d9f656775f1513189 P 3ffd435e99a84e969eb52e5e8270697b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eaeed1bd2884ff1a20a897907db390f" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39547 } } peers { permanent_uuid: "9a888333f0be4ec0892844bec224461d" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41233 } } peers { permanent_uuid: "3ffd435e99a84e969eb52e5e8270697b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33125 } }
I20260807 08:40:21.189263 17090 raft_consensus.cc:374] T 51961a5f05ac4d9d9f656775f1513189 P 3ffd435e99a84e969eb52e5e8270697b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:21.189334 17090 raft_consensus.cc:729] T 51961a5f05ac4d9d9f656775f1513189 P 3ffd435e99a84e969eb52e5e8270697b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ffd435e99a84e969eb52e5e8270697b, State: Initialized, Role: FOLLOWER
I20260807 08:40:21.189525 17090 consensus_queue.cc:260] T 51961a5f05ac4d9d9f656775f1513189 P 3ffd435e99a84e969eb52e5e8270697b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eaeed1bd2884ff1a20a897907db390f" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39547 } } peers { permanent_uuid: "9a888333f0be4ec0892844bec224461d" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41233 } } peers { permanent_uuid: "3ffd435e99a84e969eb52e5e8270697b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33125 } }
I20260807 08:40:21.189838 17098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.189455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.8.208.193:51827)
0807 08:40:21.189673 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.189720 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":115,"threads_started":1}
I20260807 08:40:21.189888 17090 ts_tablet_manager.cc:1428] T 51961a5f05ac4d9d9f656775f1513189 P 3ffd435e99a84e969eb52e5e8270697b: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260807 08:40:21.190450 16982 heartbeater.cc:503] Master 127.8.208.252:34643 was elected leader, sending a full tablet report...
I20260807 08:40:21.191744 16828 heartbeater.cc:503] Master 127.8.208.252:34643 was elected leader, sending a full tablet report...
I20260807 08:40:21.192063 17101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.190398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.8.208.194:49957)
0807 08:40:21.191863 (+ 1465us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.191961 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1376,"thread_start_us":87,"threads_started":1}
I20260807 08:40:21.192689 17101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.192479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.8.208.194:54579)
0807 08:40:21.192586 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.192632 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 08:40:21.369746 17092 raft_consensus.cc:482] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:40:21.369932 17092 raft_consensus.cc:504] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eaeed1bd2884ff1a20a897907db390f" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39547 } } peers { permanent_uuid: "9a888333f0be4ec0892844bec224461d" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41233 } } peers { permanent_uuid: "3ffd435e99a84e969eb52e5e8270697b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33125 } }
I20260807 08:40:21.370396 17092 leader_election.cc:288] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eaeed1bd2884ff1a20a897907db390f (127.8.208.193:39547), 3ffd435e99a84e969eb52e5e8270697b (127.8.208.194:33125)
I20260807 08:40:21.370736 16630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51961a5f05ac4d9d9f656775f1513189" candidate_uuid: "9a888333f0be4ec0892844bec224461d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eaeed1bd2884ff1a20a897907db390f" is_pre_election: true
I20260807 08:40:21.370878 16630 raft_consensus.cc:2454] T 51961a5f05ac4d9d9f656775f1513189 P 7eaeed1bd2884ff1a20a897907db390f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a888333f0be4ec0892844bec224461d in term 0.
I20260807 08:40:21.370838 16776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51961a5f05ac4d9d9f656775f1513189" candidate_uuid: "9a888333f0be4ec0892844bec224461d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ffd435e99a84e969eb52e5e8270697b" is_pre_election: true
I20260807 08:40:21.371025 16776 raft_consensus.cc:2454] T 51961a5f05ac4d9d9f656775f1513189 P 3ffd435e99a84e969eb52e5e8270697b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a888333f0be4ec0892844bec224461d in term 0.
I20260807 08:40:21.371240 16856 leader_election.cc:302] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eaeed1bd2884ff1a20a897907db390f, 9a888333f0be4ec0892844bec224461d; no voters:
I20260807 08:40:21.371423 17092 raft_consensus.cc:2781] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:40:21.371510 17092 raft_consensus.cc:482] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:40:21.371563 17092 raft_consensus.cc:3037] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:21.372651 17092 raft_consensus.cc:504] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eaeed1bd2884ff1a20a897907db390f" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39547 } } peers { permanent_uuid: "9a888333f0be4ec0892844bec224461d" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41233 } } peers { permanent_uuid: "3ffd435e99a84e969eb52e5e8270697b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33125 } }
I20260807 08:40:21.373030 17092 leader_election.cc:288] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d [CANDIDATE]: Term 1 election: Requested vote from peers 7eaeed1bd2884ff1a20a897907db390f (127.8.208.193:39547), 3ffd435e99a84e969eb52e5e8270697b (127.8.208.194:33125)
I20260807 08:40:21.373394 16630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51961a5f05ac4d9d9f656775f1513189" candidate_uuid: "9a888333f0be4ec0892844bec224461d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eaeed1bd2884ff1a20a897907db390f"
I20260807 08:40:21.373394 16776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51961a5f05ac4d9d9f656775f1513189" candidate_uuid: "9a888333f0be4ec0892844bec224461d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ffd435e99a84e969eb52e5e8270697b"
I20260807 08:40:21.373529 16776 raft_consensus.cc:3037] T 51961a5f05ac4d9d9f656775f1513189 P 3ffd435e99a84e969eb52e5e8270697b [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:21.373529 16630 raft_consensus.cc:3037] T 51961a5f05ac4d9d9f656775f1513189 P 7eaeed1bd2884ff1a20a897907db390f [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:21.374783 16630 raft_consensus.cc:2454] T 51961a5f05ac4d9d9f656775f1513189 P 7eaeed1bd2884ff1a20a897907db390f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a888333f0be4ec0892844bec224461d in term 1.
I20260807 08:40:21.374782 16776 raft_consensus.cc:2454] T 51961a5f05ac4d9d9f656775f1513189 P 3ffd435e99a84e969eb52e5e8270697b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a888333f0be4ec0892844bec224461d in term 1.
I20260807 08:40:21.375063 16857 leader_election.cc:302] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ffd435e99a84e969eb52e5e8270697b, 9a888333f0be4ec0892844bec224461d; no voters:
I20260807 08:40:21.375243 17092 raft_consensus.cc:2781] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:21.375438 17092 raft_consensus.cc:686] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d [term 1 LEADER]: Becoming Leader. State: Replica: 9a888333f0be4ec0892844bec224461d, State: Running, Role: LEADER
I20260807 08:40:21.375604 17092 consensus_queue.cc:237] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eaeed1bd2884ff1a20a897907db390f" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39547 } } peers { permanent_uuid: "9a888333f0be4ec0892844bec224461d" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41233 } } peers { permanent_uuid: "3ffd435e99a84e969eb52e5e8270697b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33125 } }
I20260807 08:40:21.376261 17095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.375979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.8.208.195:39607)
0807 08:40:21.376108 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.376169 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260807 08:40:21.377502 16482 catalog_manager.cc:5495] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a888333f0be4ec0892844bec224461d (127.8.208.195). New cstate: current_term: 1 leader_uuid: "9a888333f0be4ec0892844bec224461d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eaeed1bd2884ff1a20a897907db390f" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a888333f0be4ec0892844bec224461d" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ffd435e99a84e969eb52e5e8270697b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33125 } health_report { overall_health: UNKNOWN } } }
I20260807 08:40:21.410795 17083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.407890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43732 (local address 127.8.208.195:41233)
0807 08:40:21.408010 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:21.408013 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:21.408026 (+ 13us) server_negotiation.cc:407] Connection header received
0807 08:40:21.408117 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:21.408119 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:21.408160 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:21.408223 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:40:21.408424 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:21.408857 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:21.409540 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:21.409777 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:21.409936 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:21.410160 (+ 224us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:40:21.410273 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:40:21.410343 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:21.410561 (+ 218us) server_negotiation.cc:299] Negotiation successful
0807 08:40:21.410644 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 08:40:21.412734 16630 raft_consensus.cc:1261] T 51961a5f05ac4d9d9f656775f1513189 P 7eaeed1bd2884ff1a20a897907db390f [term 1 FOLLOWER]: Refusing update from remote peer 9a888333f0be4ec0892844bec224461d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:40:21.412729 16776 raft_consensus.cc:1261] T 51961a5f05ac4d9d9f656775f1513189 P 3ffd435e99a84e969eb52e5e8270697b [term 1 FOLLOWER]: Refusing update from remote peer 9a888333f0be4ec0892844bec224461d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:40:21.413183 17092 consensus_queue.cc:1035] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eaeed1bd2884ff1a20a897907db390f" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:40:21.413343 17102 consensus_queue.cc:1035] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ffd435e99a84e969eb52e5e8270697b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:40:21.414789 17098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.414535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.8.208.193:35505)
0807 08:40:21.414666 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.414714 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260807 08:40:21.417549 17101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.417288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.8.208.194:52023)
0807 08:40:21.417433 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.417484 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260807 08:40:21.419013 17101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.418623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.8.208.194:58521)
0807 08:40:21.418907 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.418954 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193}
I20260807 08:40:21.419302 17095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.418991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.8.208.195:58157)
0807 08:40:21.419193 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.419238 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140}
I20260807 08:40:21.419596 17098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.419366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.8.208.193:48253)
0807 08:40:21.419495 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.419540 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260807 08:40:21.421962 17095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.421718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35737 (local address 127.8.208.195:51461)
0807 08:40:21.421857 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.421905 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:35737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260807 08:40:21.423867 17107 mvcc.cc:205] Tried to move back new op lower bound from 7315832919702839296 to 7315832919556087808. Current Snapshot: MvccSnapshot[applied={T|T < 7315832919702839296}]
I20260807 08:40:21.424118 16482 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58172:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:40:21.424248 16482 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58172:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:40:21.427681 16482 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3a23667e3d3343d283b0dffb86ed369c: Sending DeleteTablet for 3 replicas of tablet 51961a5f05ac4d9d9f656775f1513189
I20260807 08:40:21.428216 16609 tablet_service.cc:1514] Processing DeleteTablet for tablet 51961a5f05ac4d9d9f656775f1513189 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:21 UTC) from {username='oryx', principal='oryx/127.8.208.252@KRBTEST.COM'} at 127.0.0.1:38046
I20260807 08:40:21.428522 16907 tablet_service.cc:1514] Processing DeleteTablet for tablet 51961a5f05ac4d9d9f656775f1513189 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:21 UTC) from {username='oryx', principal='oryx/127.8.208.252@KRBTEST.COM'} at 127.0.0.1:43718
I20260807 08:40:21.428522 16755 tablet_service.cc:1514] Processing DeleteTablet for tablet 51961a5f05ac4d9d9f656775f1513189 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:21 UTC) from {username='oryx', principal='oryx/127.8.208.252@KRBTEST.COM'} at 127.0.0.1:37626
I20260807 08:40:21.428821 17119 tablet_replica.cc:330] T 51961a5f05ac4d9d9f656775f1513189 P 3ffd435e99a84e969eb52e5e8270697b: stopping tablet replica
I20260807 08:40:21.428930 17118 tablet_replica.cc:330] T 51961a5f05ac4d9d9f656775f1513189 P 7eaeed1bd2884ff1a20a897907db390f: stopping tablet replica
I20260807 08:40:21.429016 17119 raft_consensus.cc:2229] T 51961a5f05ac4d9d9f656775f1513189 P 3ffd435e99a84e969eb52e5e8270697b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:40:21.429047 17118 raft_consensus.cc:2229] T 51961a5f05ac4d9d9f656775f1513189 P 7eaeed1bd2884ff1a20a897907db390f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:40:21.429158 17118 raft_consensus.cc:2258] T 51961a5f05ac4d9d9f656775f1513189 P 7eaeed1bd2884ff1a20a897907db390f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:21.429174 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 16440
I20260807 08:40:21.429244 17119 raft_consensus.cc:2258] T 51961a5f05ac4d9d9f656775f1513189 P 3ffd435e99a84e969eb52e5e8270697b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:21.429467 17120 tablet_replica.cc:330] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d: stopping tablet replica
I20260807 08:40:21.429620 17120 raft_consensus.cc:2229] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d [term 1 LEADER]: Raft consensus shutting down.
I20260807 08:40:21.429878 17120 raft_consensus.cc:2258] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:21.431758 17119 ts_tablet_manager.cc:1905] T 51961a5f05ac4d9d9f656775f1513189 P 3ffd435e99a84e969eb52e5e8270697b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:21.434597 17120 ts_tablet_manager.cc:1905] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:21.434654 17119 ts_tablet_manager.cc:1918] T 51961a5f05ac4d9d9f656775f1513189 P 3ffd435e99a84e969eb52e5e8270697b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:40:21.434710 17119 log.cc:1196] T 51961a5f05ac4d9d9f656775f1513189 P 3ffd435e99a84e969eb52e5e8270697b: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-1/wal/wals/51961a5f05ac4d9d9f656775f1513189
I20260807 08:40:21.434990 17119 ts_tablet_manager.cc:1939] T 51961a5f05ac4d9d9f656775f1513189 P 3ffd435e99a84e969eb52e5e8270697b: Deleting consensus metadata
I20260807 08:40:21.435565 16468 catalog_manager.cc:4841] TS 3ffd435e99a84e969eb52e5e8270697b (127.8.208.194:33125): tablet 51961a5f05ac4d9d9f656775f1513189 (table test-table [id=85c75c75ce1e47c7a695e601e7dd281c]) successfully deleted
I20260807 08:40:21.437083 17120 ts_tablet_manager.cc:1918] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:40:21.437166 17120 log.cc:1196] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/51961a5f05ac4d9d9f656775f1513189
I20260807 08:40:21.437436 17120 ts_tablet_manager.cc:1939] T 51961a5f05ac4d9d9f656775f1513189 P 9a888333f0be4ec0892844bec224461d: Deleting consensus metadata
I20260807 08:40:21.437988 16466 catalog_manager.cc:4841] TS 9a888333f0be4ec0892844bec224461d (127.8.208.195:41233): tablet 51961a5f05ac4d9d9f656775f1513189 (table test-table [id=85c75c75ce1e47c7a695e601e7dd281c]) successfully deleted
I20260807 08:40:21.439812 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 16690
I20260807 08:40:21.441463 17082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:21.439907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:39547 (local address 127.0.0.1:38058)
0807 08:40:21.441324 (+ 1417us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:21.441386 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.193:39547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1323}
W20260807 08:40:21.443005 16467 catalog_manager.cc:4584] TS 7eaeed1bd2884ff1a20a897907db390f (127.8.208.193:39547): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 51961a5f05ac4d9d9f656775f1513189: Network error: Client connection negotiation failed: client connection to 127.8.208.193:39547: connect: Connection refused (error 111)
I20260807 08:40:21.447454 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 16835
I20260807 08:40:21.455049 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 16140
I20260807 08:40:21.461213 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 16256
2026-08-07T08:40:21Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5600 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:40:21 dist-test-slave-6nmv krb5kdc[17123](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:40:21 dist-test-slave-6nmv krb5kdc[17123](info): set up 2 sockets
Aug 07 08:40:21 dist-test-slave-6nmv krb5kdc[17123](info): commencing operation
krb5kdc: starting...
W20260807 08:40:22.438733 9027 mini_kdc.cc:121] Time spent starting KDC: real 0.953s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:40:22 dist-test-slave-6nmv krb5kdc[17123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:40:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:40:22Z Disabled control of system clock
WARNING: no policy specified for oryx/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.254.keytab.
Entry for principal oryx/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.254.keytab.
I20260807 08:40:22.546495 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:39489
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.254.keytab
--principal=oryx/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:33943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:39489
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:22.647132 17136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:22.647382 17136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:22.647464 17136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:22.651087 17136 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:40:22.651147 17136 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 08:40:22.651173 17136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:22.651209 17136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:22.651240 17136 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:40:22.651270 17136 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:40:22.655867 17136 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:33943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:39489
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.254.keytab
--principal=oryx/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:39489
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17136
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:22.656786 17136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:22.657698 17136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:22.664893 17144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:22.664916 17141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:22.665047 17136 server_base.cc:1034] running on GCE node
W20260807 08:40:22.664916 17142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:22.665581 17136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:22.666548 17136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:22.667698 17136 hybrid_clock.cc:648] HybridClock initialized: now 1786092022667678 us; error 35 us; skew 500 ppm
Aug 07 08:40:22 dist-test-slave-6nmv krb5kdc[17123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092022, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:22.670025 17136 init.cc:377] Logged in from keytab as oryx/127.8.208.254@KRBTEST.COM (short username oryx)
I20260807 08:40:22.670833 17136 webserver.cc:460] Webserver started at http://127.8.208.254:37743/ using document root <none> and password file <none>
I20260807 08:40:22.671293 17136 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:22.671344 17136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:22.671542 17136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:22.673326 17136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "73cb4cfd17f640238ced4e76202e128c"
format_stamp: "Formatted at 2026-08-07 08:40:22 on dist-test-slave-6nmv"
server_key: "6780954ea8b68e2fb5f50e8401b5450f"
server_key_iv: "3072be3273fce62b7d107643a8b0b8ba"
server_key_version: "encryptionkey@0"
I20260807 08:40:22.673856 17136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "73cb4cfd17f640238ced4e76202e128c"
format_stamp: "Formatted at 2026-08-07 08:40:22 on dist-test-slave-6nmv"
server_key: "6780954ea8b68e2fb5f50e8401b5450f"
server_key_iv: "3072be3273fce62b7d107643a8b0b8ba"
server_key_version: "encryptionkey@0"
I20260807 08:40:22.677048 17136 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 08:40:22.679132 17151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:22.680127 17136 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 08:40:22.680234 17136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "73cb4cfd17f640238ced4e76202e128c"
format_stamp: "Formatted at 2026-08-07 08:40:22 on dist-test-slave-6nmv"
server_key: "6780954ea8b68e2fb5f50e8401b5450f"
server_key_iv: "3072be3273fce62b7d107643a8b0b8ba"
server_key_version: "encryptionkey@0"
I20260807 08:40:22.680315 17136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:22.695751 17136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:22.698192 17136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:22.698383 17136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:22.705183 17136 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:39489
I20260807 08:40:22.705210 17216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:39489 every 8 connection(s)
I20260807 08:40:22.706039 17136 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:40:22.708392 17217 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:22.711158 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 17136
I20260807 08:40:22.711288 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:40:22.711553 9027 external_mini_cluster.cc:1428] Setting key 4daabf64829ca4059fdf24ae2b9f6f25
I20260807 08:40:22.713816 17217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c: Bootstrap starting.
I20260807 08:40:22.716260 17217 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:22.717067 17217 log.cc:824] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:22.718828 17217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c: No bootstrap required, opened a new log
Aug 07 08:40:22 dist-test-slave-6nmv krb5kdc[17123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM
I20260807 08:40:22.722338 17217 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73cb4cfd17f640238ced4e76202e128c" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39489 } }
I20260807 08:40:22.722564 17217 raft_consensus.cc:374] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:22.722635 17217 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73cb4cfd17f640238ced4e76202e128c, State: Initialized, Role: FOLLOWER
I20260807 08:40:22.723058 17217 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73cb4cfd17f640238ced4e76202e128c" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39489 } }
I20260807 08:40:22.723181 17217 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:40:22.723253 17217 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:40:22.723353 17217 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:22.724107 17217 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73cb4cfd17f640238ced4e76202e128c" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39489 } }
I20260807 08:40:22.724388 17217 leader_election.cc:302] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73cb4cfd17f640238ced4e76202e128c; no voters:
I20260807 08:40:22.724666 17217 leader_election.cc:288] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:40:22.724725 17222 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:22.724751 17220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:22.712815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51190 (local address 127.8.208.254:39489)
0807 08:40:22.713161 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:22.713178 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:22.713213 (+ 35us) server_negotiation.cc:407] Connection header received
0807 08:40:22.713916 (+ 703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:22.713936 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:22.714272 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:22.714593 (+ 321us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:22.715211 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:22.716671 (+ 1460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:22.717519 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:22.717972 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:22.718120 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:22.720536 (+ 2416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:22.720540 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:22.720549 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:22.720577 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:22.722046 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:22.722479 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:22.722482 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:22.722486 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:22.722642 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:22.722928 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:22.722931 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:22.722931 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:22.723382 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:22.723547 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:22.723836 (+ 289us) server_negotiation.cc:299] Negotiation successful
0807 08:40:22.724065 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":92,"threads_started":1}
I20260807 08:40:22.724897 17222 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c [term 1 LEADER]: Becoming Leader. State: Replica: 73cb4cfd17f640238ced4e76202e128c, State: Running, Role: LEADER
I20260807 08:40:22.725134 17222 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73cb4cfd17f640238ced4e76202e128c" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39489 } }
I20260807 08:40:22.725725 17217 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:40:22.726193 17222 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "73cb4cfd17f640238ced4e76202e128c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73cb4cfd17f640238ced4e76202e128c" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39489 } } }
I20260807 08:40:22.726305 17222 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:22.726715 17227 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:40:22.727113 17224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73cb4cfd17f640238ced4e76202e128c. Latest consensus state: current_term: 1 leader_uuid: "73cb4cfd17f640238ced4e76202e128c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73cb4cfd17f640238ced4e76202e128c" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39489 } } }
I20260807 08:40:22.727219 17224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:22.729497 17227 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:40:22.734411 17227 catalog_manager.cc:1347] Generated new cluster ID: 037d891de925421d8f085b65307c4226
I20260807 08:40:22.734472 17227 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:40:22.746199 17227 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:40:22.747298 17227 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:40:22.751210 17227 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c: Generated new TSK 0
I20260807 08:40:22.751770 17227 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.8.208.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.208.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.208.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.193.keytab.
Entry for principal oryx/127.8.208.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.193.keytab.
I20260807 08:40:22.782500 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:39489
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.193.keytab
--principal=oryx/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:33943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:22.889886 17246 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:22.890103 17246 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:22.890141 17246 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:22.894093 17246 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:22.894135 17246 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:22.894197 17246 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 08:40:22.894271 17246 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:40:22.898729 17246 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:33943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.193.keytab
--principal=oryx/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.208.254:39489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17246
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:22.899600 17246 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:22.900552 17246 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:22.909777 17255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:22.909830 17252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:22.909888 17246 server_base.cc:1034] running on GCE node
W20260807 08:40:22.909838 17251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:22.910352 17246 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:22.910951 17246 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:22.912107 17246 hybrid_clock.cc:648] HybridClock initialized: now 1786092022912098 us; error 25 us; skew 500 ppm
Aug 07 08:40:22 dist-test-slave-6nmv krb5kdc[17123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092022, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:22.914532 17246 init.cc:377] Logged in from keytab as oryx/127.8.208.193@KRBTEST.COM (short username oryx)
I20260807 08:40:22.915261 17246 webserver.cc:460] Webserver started at http://127.8.208.193:37075/ using document root <none> and password file <none>
I20260807 08:40:22.915771 17246 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:22.915827 17246 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:22.916095 17246 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:22.918114 17246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "2c48c3311f0040b59f1f324488d189a1"
format_stamp: "Formatted at 2026-08-07 08:40:22 on dist-test-slave-6nmv"
server_key: "02b6be3c450254eebda5fe28ff3673da"
server_key_iv: "2aea15ca7c1b2cd97489b853df21a2fc"
server_key_version: "encryptionkey@0"
I20260807 08:40:22.918651 17246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "2c48c3311f0040b59f1f324488d189a1"
format_stamp: "Formatted at 2026-08-07 08:40:22 on dist-test-slave-6nmv"
server_key: "02b6be3c450254eebda5fe28ff3673da"
server_key_iv: "2aea15ca7c1b2cd97489b853df21a2fc"
server_key_version: "encryptionkey@0"
I20260807 08:40:22.921809 17246 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 08:40:22.923872 17262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:22.924876 17246 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:22.924958 17246 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "2c48c3311f0040b59f1f324488d189a1"
format_stamp: "Formatted at 2026-08-07 08:40:22 on dist-test-slave-6nmv"
server_key: "02b6be3c450254eebda5fe28ff3673da"
server_key_iv: "2aea15ca7c1b2cd97489b853df21a2fc"
server_key_version: "encryptionkey@0"
I20260807 08:40:22.925076 17246 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:22.933450 17246 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:22.936009 17246 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:22.936199 17246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:22.937481 17246 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:22.937528 17246 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:22.937598 17246 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:22.937629 17246 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 08:40:22 dist-test-slave-6nmv krb5kdc[17123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092022, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM
I20260807 08:40:22.948128 17246 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:41709
I20260807 08:40:22.948159 17388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:41709 every 8 connection(s)
I20260807 08:40:22.948870 17246 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:40:22.951512 17220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:22.938318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:60757 (local address 127.8.208.254:39489)
0807 08:40:22.938438 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:22.938442 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:22.939346 (+ 904us) server_negotiation.cc:407] Connection header received
0807 08:40:22.940204 (+ 858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:22.940207 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:22.940280 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:22.940353 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:22.941759 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:22.942628 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:22.944222 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:22.944581 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:22.944680 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:22.948224 (+ 3544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:22.948228 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:22.948230 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:22.948258 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:22.949830 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:22.950279 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:22.950282 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:22.950284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:22.950366 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:22.950691 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:22.950693 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:22.950694 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:22.950849 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:22.950919 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:22.951300 (+ 381us) server_negotiation.cc:299] Negotiation successful
0807 08:40:22.951393 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 08:40:22.952214 17271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:22.938753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:39489 (local address 127.8.208.193:60757)
0807 08:40:22.939188 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:22.939225 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:22.940006 (+ 781us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:22.940534 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:22.940542 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:22.941008 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:22.941598 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:22.941638 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:22.942735 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:22.942738 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:22.944114 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:22.944124 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:22.944731 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:22.944736 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:22.944956 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:22.946245 (+ 1289us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:22.946272 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:22.948013 (+ 1741us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:22.949942 (+ 1929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:22.949946 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:22.949955 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:22.950179 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:22.950458 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:22.950461 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:22.950463 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:22.950609 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:22.950928 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:22.950933 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:22.951124 (+ 191us) client_negotiation.cc:769] Sending connection context
0807 08:40:22.951255 (+ 131us) client_negotiation.cc:240] Negotiation successful
0807 08:40:22.951456 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":124,"threads_started":1}
I20260807 08:40:22.953425 17389 heartbeater.cc:347] Connected to a master server at 127.8.208.254:39489
I20260807 08:40:22.953641 17389 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:22.954156 17389 heartbeater.cc:511] Master 127.8.208.254:39489 requested a full tablet report, sending...
I20260807 08:40:22.955770 17168 ts_manager.cc:194] Registered new tserver with Master: 2c48c3311f0040b59f1f324488d189a1 (127.8.208.193:41709)
I20260807 08:40:22.956975 17168 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.208.193@KRBTEST.COM'} at 127.8.208.193:60757
I20260807 08:40:22.958848 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 17246
I20260807 08:40:22.958977 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
I20260807 08:40:22.959233 9027 external_mini_cluster.cc:1428] Setting key 289c94166f287ec4978fd402d51c59f0
I20260807 08:40:22.963546 17396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:22.955671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:39489 (local address 127.8.208.193:54761)
0807 08:40:22.955936 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:22.955968 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:22.956053 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:22.957729 (+ 1676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:22.957732 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:22.957947 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:22.958027 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:22.958032 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:22.958667 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:22.958670 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:22.959230 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:22.959238 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:22.959734 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:22.959737 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:22.959815 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:22.960194 (+ 379us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:22.960207 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:22.960542 (+ 335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:22.962232 (+ 1690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:22.962234 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:22.962235 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:22.962411 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:22.962712 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:22.962716 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:22.962718 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:22.962789 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:22.963107 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:22.963110 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:22.963188 (+ 78us) client_negotiation.cc:769] Sending connection context
0807 08:40:22.963282 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 08:40:22.963396 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":109,"threads_started":1}
I20260807 08:40:22.963544 17220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:22.955652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:54761 (local address 127.8.208.254:39489)
0807 08:40:22.957560 (+ 1908us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:22.957564 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:22.957574 (+ 10us) server_negotiation.cc:407] Connection header received
0807 08:40:22.957606 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:22.957608 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:22.957635 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:22.957713 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:22.958128 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:22.958544 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:22.959367 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:22.959624 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:22.959726 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:22.960667 (+ 941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:22.960670 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:22.960672 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:22.960693 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:22.962137 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:22.962513 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:22.962517 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:22.962518 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:22.962592 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:22.962871 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:22.962875 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:22.962876 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:22.963020 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:22.963114 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:22.963330 (+ 216us) server_negotiation.cc:299] Negotiation successful
0807 08:40:22.963436 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1834}
WARNING: no policy specified for oryx/127.8.208.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.208.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.208.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.194.keytab.
Entry for principal oryx/127.8.208.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.194.keytab.
I20260807 08:40:22.984258 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:39489
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.194.keytab
--principal=oryx/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:33943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:23.086908 17399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:23.087152 17399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:23.087237 17399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:23.090776 17399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:23.090838 17399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:23.090914 17399 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 08:40:23.090991 17399 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:40:23.095503 17399 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:33943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.194.keytab
--principal=oryx/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.208.254:39489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17399
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:23.096338 17399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:23.097251 17399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:23.105417 17409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:23.105499 17405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:23.105551 17399 server_base.cc:1034] running on GCE node
W20260807 08:40:23.105681 17406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:23.106073 17399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:23.106626 17399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:23.107846 17399 hybrid_clock.cc:648] HybridClock initialized: now 1786092023107806 us; error 53 us; skew 500 ppm
Aug 07 08:40:23 dist-test-slave-6nmv krb5kdc[17123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092023, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:23.110311 17399 init.cc:377] Logged in from keytab as oryx/127.8.208.194@KRBTEST.COM (short username oryx)
I20260807 08:40:23.111078 17399 webserver.cc:460] Webserver started at http://127.8.208.194:37245/ using document root <none> and password file <none>
I20260807 08:40:23.111548 17399 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:23.111614 17399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:23.111830 17399 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:23.113483 17399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "cdbc65865eef4a2381b6d3ac692315f5"
format_stamp: "Formatted at 2026-08-07 08:40:23 on dist-test-slave-6nmv"
server_key: "918c6708eeffbe30180e8049d7052d24"
server_key_iv: "6a154c1cb536a813785612e4cedaf52f"
server_key_version: "encryptionkey@0"
I20260807 08:40:23.113992 17399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "cdbc65865eef4a2381b6d3ac692315f5"
format_stamp: "Formatted at 2026-08-07 08:40:23 on dist-test-slave-6nmv"
server_key: "918c6708eeffbe30180e8049d7052d24"
server_key_iv: "6a154c1cb536a813785612e4cedaf52f"
server_key_version: "encryptionkey@0"
I20260807 08:40:23.117246 17399 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20260807 08:40:23.119292 17416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:23.120326 17399 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260807 08:40:23.120419 17399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "cdbc65865eef4a2381b6d3ac692315f5"
format_stamp: "Formatted at 2026-08-07 08:40:23 on dist-test-slave-6nmv"
server_key: "918c6708eeffbe30180e8049d7052d24"
server_key_iv: "6a154c1cb536a813785612e4cedaf52f"
server_key_version: "encryptionkey@0"
I20260807 08:40:23.120493 17399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:23.130904 17399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:23.134177 17399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:23.134333 17399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:23.135530 17399 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:23.135576 17399 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:23.135629 17399 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:23.135658 17399 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 08:40:23 dist-test-slave-6nmv krb5kdc[17123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092023, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM
I20260807 08:40:23.144810 17399 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:42239
I20260807 08:40:23.145097 17542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:42239 every 8 connection(s)
I20260807 08:40:23.145694 17399 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:40:23.147789 17220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:23.136299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:41859 (local address 127.8.208.254:39489)
0807 08:40:23.136487 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:23.136493 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:23.137162 (+ 669us) server_negotiation.cc:407] Connection header received
0807 08:40:23.138101 (+ 939us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:23.138104 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:23.138160 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:23.138232 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:23.139496 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.140290 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.141775 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.142118 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.142207 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:23.144512 (+ 2305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:23.144515 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:23.144517 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:23.144544 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:23.146043 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:23.146587 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:23.146590 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:23.146592 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:23.146693 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:23.146971 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:23.146973 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:23.146974 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:23.147140 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:23.147226 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:23.147583 (+ 357us) server_negotiation.cc:299] Negotiation successful
0807 08:40:23.147666 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260807 08:40:23.148427 17427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:23.136578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:39489 (local address 127.8.208.194:41859)
0807 08:40:23.137008 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:23.137053 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:23.137903 (+ 850us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:23.138399 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:23.138406 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:23.138813 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:23.139348 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:23.139367 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.140403 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.140406 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:23.141671 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:23.141683 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.142233 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.142236 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:23.142384 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:23.142836 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:23.142849 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:23.144350 (+ 1501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:23.146172 (+ 1822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:23.146177 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:23.146189 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:23.146505 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:23.146776 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:23.146778 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:23.146779 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:23.146889 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:23.147236 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:23.147240 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:23.147403 (+ 163us) client_negotiation.cc:769] Sending connection context
0807 08:40:23.147529 (+ 126us) client_negotiation.cc:240] Negotiation successful
0807 08:40:23.147710 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":129,"threads_started":1}
I20260807 08:40:23.149457 17543 heartbeater.cc:347] Connected to a master server at 127.8.208.254:39489
I20260807 08:40:23.149590 17543 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:23.150014 17543 heartbeater.cc:511] Master 127.8.208.254:39489 requested a full tablet report, sending...
I20260807 08:40:23.150944 17168 ts_manager.cc:194] Registered new tserver with Master: cdbc65865eef4a2381b6d3ac692315f5 (127.8.208.194:42239)
I20260807 08:40:23.151288 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 17399
I20260807 08:40:23.151435 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:40:23.151625 17168 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.208.194@KRBTEST.COM'} at 127.8.208.194:41859
I20260807 08:40:23.151780 9027 external_mini_cluster.cc:1428] Setting key bba64d22c4d5941a3224aa63fd2f070e
I20260807 08:40:23.158776 17220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:23.151452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:48155 (local address 127.8.208.254:39489)
0807 08:40:23.151536 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:23.151539 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:23.151676 (+ 137us) server_negotiation.cc:407] Connection header received
0807 08:40:23.151790 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:23.151792 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:23.151826 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:23.151899 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:23.152484 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.153120 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.154195 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.154449 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.154525 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:23.155718 (+ 1193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:23.155722 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:23.155724 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:23.155747 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:23.157168 (+ 1421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:23.157558 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:23.157561 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:23.157562 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:23.157649 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:23.157971 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:23.157975 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:23.157976 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:23.158164 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:23.158267 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:23.158534 (+ 267us) server_negotiation.cc:299] Negotiation successful
0807 08:40:23.158636 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 08:40:23.158788 17551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:23.151229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:39489 (local address 127.8.208.194:48155)
0807 08:40:23.151567 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:23.151581 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:23.151683 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:23.152029 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:23.152032 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:23.152230 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:23.152371 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:23.152381 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.153276 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.153279 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:23.154078 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:23.154092 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.154561 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.154584 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:23.154726 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:23.155241 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:23.155261 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:23.155582 (+ 321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:23.157275 (+ 1693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:23.157279 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:23.157281 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:23.157463 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:23.157740 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:23.157743 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:23.157744 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:23.157878 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:23.158259 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:23.158262 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:23.158351 (+ 89us) client_negotiation.cc:769] Sending connection context
0807 08:40:23.158477 (+ 126us) client_negotiation.cc:240] Negotiation successful
0807 08:40:23.158608 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"mutex_wait_us":3,"thread_start_us":86,"threads_started":1}
WARNING: no policy specified for oryx/127.8.208.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.208.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.208.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.195.keytab.
Entry for principal oryx/127.8.208.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.195.keytab.
I20260807 08:40:23.178061 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:39489
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.195.keytab
--principal=oryx/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:33943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:23.276089 17554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:23.276296 17554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:23.276336 17554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:23.279770 17554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:23.279812 17554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:23.279871 17554 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 08:40:23.279948 17554 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:40:23.284858 17554 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:33943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.195.keytab
--principal=oryx/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.208.254:39489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17554
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:23.285624 17554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:23.286525 17554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:23.294752 17564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:23.294747 17562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:23.294745 17561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:23.294862 17554 server_base.cc:1034] running on GCE node
I20260807 08:40:23.295260 17554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:23.295732 17554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:23.296943 17554 hybrid_clock.cc:648] HybridClock initialized: now 1786092023296922 us; error 51 us; skew 500 ppm
Aug 07 08:40:23 dist-test-slave-6nmv krb5kdc[17123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092023, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:23.299508 17554 init.cc:377] Logged in from keytab as oryx/127.8.208.195@KRBTEST.COM (short username oryx)
I20260807 08:40:23.300206 17554 webserver.cc:460] Webserver started at http://127.8.208.195:43419/ using document root <none> and password file <none>
I20260807 08:40:23.300604 17554 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:23.300652 17554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:23.300799 17554 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:23.302640 17554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "1f537e96b001420fb83f81a5ddb2a6a0"
format_stamp: "Formatted at 2026-08-07 08:40:23 on dist-test-slave-6nmv"
server_key: "5a5a39385b790b31a8ccf19b4633b8f4"
server_key_iv: "a9111c48f26b3ffe10003cce35f35148"
server_key_version: "encryptionkey@0"
I20260807 08:40:23.303097 17554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "1f537e96b001420fb83f81a5ddb2a6a0"
format_stamp: "Formatted at 2026-08-07 08:40:23 on dist-test-slave-6nmv"
server_key: "5a5a39385b790b31a8ccf19b4633b8f4"
server_key_iv: "a9111c48f26b3ffe10003cce35f35148"
server_key_version: "encryptionkey@0"
I20260807 08:40:23.306363 17554 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 08:40:23.308403 17571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:23.309413 17554 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:23.309535 17554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "1f537e96b001420fb83f81a5ddb2a6a0"
format_stamp: "Formatted at 2026-08-07 08:40:23 on dist-test-slave-6nmv"
server_key: "5a5a39385b790b31a8ccf19b4633b8f4"
server_key_iv: "a9111c48f26b3ffe10003cce35f35148"
server_key_version: "encryptionkey@0"
I20260807 08:40:23.309624 17554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:23.323168 17554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:23.325392 17554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:23.325562 17554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:23.327092 17554 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:23.327184 17554 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:23.327252 17554 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:23.327296 17554 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:23.336123 17554 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:40893
I20260807 08:40:23.336421 17693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:40893 every 8 connection(s)
Aug 07 08:40:23 dist-test-slave-6nmv krb5kdc[17123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092023, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM
I20260807 08:40:23.337261 17554 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:40:23.340389 17220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:23.327753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:50967 (local address 127.8.208.254:39489)
0807 08:40:23.327874 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:23.327880 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:23.328770 (+ 890us) server_negotiation.cc:407] Connection header received
0807 08:40:23.329673 (+ 903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:23.329679 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:23.329745 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:23.329858 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:23.331115 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.332020 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.333957 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.334279 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.334395 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:23.337401 (+ 3006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:23.337406 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:23.337410 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:23.337451 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:23.338824 (+ 1373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:23.339225 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:23.339228 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:23.339229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:23.339298 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:23.339595 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:23.339597 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:23.339598 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:23.339748 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:23.339818 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:23.340193 (+ 375us) server_negotiation.cc:299] Negotiation successful
0807 08:40:23.340280 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 08:40:23.341085 17580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:23.328219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:39489 (local address 127.8.208.195:50967)
0807 08:40:23.328642 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:23.328676 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:23.329451 (+ 775us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:23.329985 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:23.330010 (+ 25us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:23.330394 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:23.330962 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:23.330979 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.332479 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.332484 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:23.333800 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:23.333831 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.334832 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.334837 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:23.335023 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:23.335533 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:23.335547 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:23.337217 (+ 1670us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:23.338913 (+ 1696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:23.338917 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:23.338925 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:23.339148 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:23.339367 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:23.339369 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:23.339370 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:23.339521 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:23.339830 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:23.339834 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:23.340019 (+ 185us) client_negotiation.cc:769] Sending connection context
0807 08:40:23.340149 (+ 130us) client_negotiation.cc:240] Negotiation successful
0807 08:40:23.340340 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":126,"threads_started":1}
I20260807 08:40:23.342121 17694 heartbeater.cc:347] Connected to a master server at 127.8.208.254:39489
I20260807 08:40:23.342252 17694 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:23.342706 17694 heartbeater.cc:511] Master 127.8.208.254:39489 requested a full tablet report, sending...
I20260807 08:40:23.343057 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 17554
I20260807 08:40:23.343178 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:40:23.343488 9027 external_mini_cluster.cc:1428] Setting key 707013127153211b82e6dbb16c1992de
I20260807 08:40:23.343667 17169 ts_manager.cc:194] Registered new tserver with Master: 1f537e96b001420fb83f81a5ddb2a6a0 (127.8.208.195:40893)
I20260807 08:40:23.344313 17169 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.208.195@KRBTEST.COM'} at 127.8.208.195:50967
I20260807 08:40:23.345412 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 08:40:23.351349 17701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:23.344062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:39489 (local address 127.8.208.195:58403)
0807 08:40:23.344605 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:23.344635 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:23.344753 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:23.344975 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:23.344978 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:23.345153 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:23.345241 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:23.345246 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.346181 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.346184 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:23.346696 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:23.346702 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.347324 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.347326 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:23.347381 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:23.347806 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:23.347823 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:23.348233 (+ 410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:23.349841 (+ 1608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:23.349846 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:23.349849 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:23.350103 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:23.350380 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:23.350386 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:23.350390 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:23.350492 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:23.350872 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:23.350876 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:23.350972 (+ 96us) client_negotiation.cc:769] Sending connection context
0807 08:40:23.351066 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 08:40:23.351197 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":85,"threads_started":1}
I20260807 08:40:23.351411 17220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:23.344191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:58403 (local address 127.8.208.254:39489)
0807 08:40:23.344335 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:23.344339 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:23.344699 (+ 360us) server_negotiation.cc:407] Connection header received
0807 08:40:23.344835 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:23.344838 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:23.344874 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:23.344943 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:23.345363 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.346020 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.346811 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.347205 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.347333 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:23.348360 (+ 1027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:23.348363 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:23.348364 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:23.348383 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:23.349736 (+ 1353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:23.350188 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:23.350190 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:23.350191 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:23.350282 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:23.350593 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:23.350596 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:23.350597 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:23.350788 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:23.350856 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:23.351158 (+ 302us) server_negotiation.cc:299] Negotiation successful
0807 08:40:23.351256 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
Aug 07 08:40:23 dist-test-slave-6nmv krb5kdc[17123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092023, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 08:40:23 dist-test-slave-6nmv krb5kdc[17123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:23 dist-test-slave-6nmv krb5kdc[17123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 08:40:23.367301 17220 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:23.362526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51194 (local address 127.8.208.254:39489)
0807 08:40:23.362625 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:23.362628 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:23.362637 (+ 9us) server_negotiation.cc:407] Connection header received
0807 08:40:23.362660 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:23.362661 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:23.362687 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:23.362743 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:23.363287 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.363667 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.364326 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.364489 (+ 163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.364549 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:23.367209 (+ 2660us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51194: BlockingRecv error: recv got EOF from 127.0.0.1:51194 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 07 08:40:23 dist-test-slave-6nmv krb5kdc[17123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092023, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM
I20260807 08:40:23.374800 17220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:23.368654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51202 (local address 127.8.208.254:39489)
0807 08:40:23.368806 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:23.368809 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:23.368887 (+ 78us) server_negotiation.cc:407] Connection header received
0807 08:40:23.368959 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:23.368961 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:23.368989 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:23.369043 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:23.369490 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.369919 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.370523 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.370688 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.370748 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:23.372617 (+ 1869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:23.372620 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:23.372621 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:23.372639 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:23.373647 (+ 1008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:23.374036 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:23.374038 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:23.374039 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:23.374101 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:23.374279 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:23.374280 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:23.374281 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:23.374393 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:23.374480 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:23.374604 (+ 124us) server_negotiation.cc:299] Negotiation successful
0807 08:40:23.374670 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 08:40:23.377024 17169 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51202:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 08:40:23.379658 17169 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:40:23.391806 17718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:23.386840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:41709 (local address 127.0.0.1:43356)
0807 08:40:23.387173 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:23.387221 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:23.387334 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:23.387934 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:23.387939 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:23.387958 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:23.388062 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:23.388070 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.389276 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.389278 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:23.390289 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:23.390297 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.391231 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.391234 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:23.391351 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:23.391393 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 08:40:23.391549 (+ 156us) client_negotiation.cc:240] Negotiation successful
0807 08:40:23.391686 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":32,"thread_start_us":88,"threads_started":1}
I20260807 08:40:23.391824 17719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:23.387027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43356 (local address 127.8.208.193:41709)
0807 08:40:23.387468 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:23.387480 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:23.387501 (+ 21us) server_negotiation.cc:407] Connection header received
0807 08:40:23.387578 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:23.387585 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:23.387768 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:23.387940 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:23.388187 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.389153 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.390396 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.390934 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.391035 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:23.391185 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:23.391584 (+ 399us) server_negotiation.cc:299] Negotiation successful
0807 08:40:23.391702 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":127,"threads_started":1}
I20260807 08:40:23.392158 17720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:23.387274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:40893 (local address 127.0.0.1:42098)
0807 08:40:23.387545 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:23.387559 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:23.387630 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:23.388587 (+ 957us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:23.388590 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:23.388606 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:23.388683 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:23.388687 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.389920 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.389922 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:23.390883 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:23.390892 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.391794 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.391797 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:23.391884 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:23.391905 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 08:40:23.391967 (+ 62us) client_negotiation.cc:240] Negotiation successful
0807 08:40:23.392031 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"mutex_wait_us":18,"thread_start_us":73,"threads_started":1}
I20260807 08:40:23.392577 17721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:23.387496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:42239 (local address 127.0.0.1:58120)
0807 08:40:23.388342 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:23.388354 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:23.388429 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:23.388882 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:23.388885 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:23.388901 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:23.388972 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:23.388977 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.389746 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.389751 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:23.390840 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:23.390850 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.392195 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.392199 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:23.392300 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:23.392323 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 08:40:23.392387 (+ 64us) client_negotiation.cc:240] Negotiation successful
0807 08:40:23.392446 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":789,"mutex_wait_us":3,"thread_start_us":90,"threads_started":1}
I20260807 08:40:23.392807 17722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:23.387629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42098 (local address 127.8.208.195:40893)
0807 08:40:23.388194 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:23.388203 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:23.388223 (+ 20us) server_negotiation.cc:407] Connection header received
0807 08:40:23.388281 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:23.388285 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:23.388452 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:23.388801 (+ 349us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:23.388893 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.389771 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.391000 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.391663 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.392406 (+ 743us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:23.392534 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:23.392577 (+ 43us) server_negotiation.cc:299] Negotiation successful
0807 08:40:23.392663 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":94,"threads_started":1}
I20260807 08:40:23.392813 17723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:23.387880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58120 (local address 127.8.208.194:42239)
0807 08:40:23.388149 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:23.388158 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:23.388513 (+ 355us) server_negotiation.cc:407] Connection header received
0807 08:40:23.388586 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:23.388592 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:23.388749 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:23.388906 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:23.389048 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.389642 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.390975 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.391913 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.392002 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:23.392135 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:23.392454 (+ 319us) server_negotiation.cc:299] Negotiation successful
0807 08:40:23.392545 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":109,"threads_started":1}
I20260807 08:40:23.394953 17316 tablet_service.cc:1467] Processing CreateTablet for tablet 5d6023759f994281af92ba494c2c064c (DEFAULT_TABLE table=test-table [id=bc4c3d1d9850410588d21b03cf9ca7ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:23.395089 17620 tablet_service.cc:1467] Processing CreateTablet for tablet 5d6023759f994281af92ba494c2c064c (DEFAULT_TABLE table=test-table [id=bc4c3d1d9850410588d21b03cf9ca7ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:23.395533 17470 tablet_service.cc:1467] Processing CreateTablet for tablet 5d6023759f994281af92ba494c2c064c (DEFAULT_TABLE table=test-table [id=bc4c3d1d9850410588d21b03cf9ca7ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:23.395851 17620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d6023759f994281af92ba494c2c064c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:23.395880 17316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d6023759f994281af92ba494c2c064c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:23.396337 17470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d6023759f994281af92ba494c2c064c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:23.401484 17725 tablet_bootstrap.cc:492] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0: Bootstrap starting.
I20260807 08:40:23.402647 17726 tablet_bootstrap.cc:492] T 5d6023759f994281af92ba494c2c064c P 2c48c3311f0040b59f1f324488d189a1: Bootstrap starting.
I20260807 08:40:23.404422 17726 tablet_bootstrap.cc:654] T 5d6023759f994281af92ba494c2c064c P 2c48c3311f0040b59f1f324488d189a1: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:23.404422 17725 tablet_bootstrap.cc:654] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:23.405193 17726 log.cc:824] T 5d6023759f994281af92ba494c2c064c P 2c48c3311f0040b59f1f324488d189a1: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:23.405192 17725 log.cc:824] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:23.405750 17727 tablet_bootstrap.cc:492] T 5d6023759f994281af92ba494c2c064c P cdbc65865eef4a2381b6d3ac692315f5: Bootstrap starting.
I20260807 08:40:23.407053 17725 tablet_bootstrap.cc:492] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0: No bootstrap required, opened a new log
I20260807 08:40:23.407117 17726 tablet_bootstrap.cc:492] T 5d6023759f994281af92ba494c2c064c P 2c48c3311f0040b59f1f324488d189a1: No bootstrap required, opened a new log
I20260807 08:40:23.407275 17725 ts_tablet_manager.cc:1397] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260807 08:40:23.407301 17726 ts_tablet_manager.cc:1397] T 5d6023759f994281af92ba494c2c064c P 2c48c3311f0040b59f1f324488d189a1: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 08:40:23.407784 17727 tablet_bootstrap.cc:654] T 5d6023759f994281af92ba494c2c064c P cdbc65865eef4a2381b6d3ac692315f5: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:23.408545 17727 log.cc:824] T 5d6023759f994281af92ba494c2c064c P cdbc65865eef4a2381b6d3ac692315f5: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:23.410257 17727 tablet_bootstrap.cc:492] T 5d6023759f994281af92ba494c2c064c P cdbc65865eef4a2381b6d3ac692315f5: No bootstrap required, opened a new log
I20260807 08:40:23.410403 17727 ts_tablet_manager.cc:1397] T 5d6023759f994281af92ba494c2c064c P cdbc65865eef4a2381b6d3ac692315f5: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260807 08:40:23.410468 17725 raft_consensus.cc:348] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:23.410683 17725 raft_consensus.cc:374] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:23.410729 17725 raft_consensus.cc:729] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f537e96b001420fb83f81a5ddb2a6a0, State: Initialized, Role: FOLLOWER
I20260807 08:40:23.410848 17726 raft_consensus.cc:348] T 5d6023759f994281af92ba494c2c064c P 2c48c3311f0040b59f1f324488d189a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:23.411058 17726 raft_consensus.cc:374] T 5d6023759f994281af92ba494c2c064c P 2c48c3311f0040b59f1f324488d189a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:23.411113 17726 raft_consensus.cc:729] T 5d6023759f994281af92ba494c2c064c P 2c48c3311f0040b59f1f324488d189a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c48c3311f0040b59f1f324488d189a1, State: Initialized, Role: FOLLOWER
I20260807 08:40:23.411139 17725 consensus_queue.cc:260] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:23.411512 17726 consensus_queue.cc:260] T 5d6023759f994281af92ba494c2c064c P 2c48c3311f0040b59f1f324488d189a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:23.411711 17694 heartbeater.cc:503] Master 127.8.208.254:39489 was elected leader, sending a full tablet report...
I20260807 08:40:23.412140 17389 heartbeater.cc:503] Master 127.8.208.254:39489 was elected leader, sending a full tablet report...
I20260807 08:40:23.412485 17726 ts_tablet_manager.cc:1428] T 5d6023759f994281af92ba494c2c064c P 2c48c3311f0040b59f1f324488d189a1: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 08:40:23.413086 17725 ts_tablet_manager.cc:1428] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 08:40:23.413709 17727 raft_consensus.cc:348] T 5d6023759f994281af92ba494c2c064c P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:23.413973 17727 raft_consensus.cc:374] T 5d6023759f994281af92ba494c2c064c P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:23.414042 17727 raft_consensus.cc:729] T 5d6023759f994281af92ba494c2c064c P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdbc65865eef4a2381b6d3ac692315f5, State: Initialized, Role: FOLLOWER
I20260807 08:40:23.414434 17727 consensus_queue.cc:260] T 5d6023759f994281af92ba494c2c064c P cdbc65865eef4a2381b6d3ac692315f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:23.415058 17543 heartbeater.cc:503] Master 127.8.208.254:39489 was elected leader, sending a full tablet report...
I20260807 08:40:23.415259 17727 ts_tablet_manager.cc:1428] T 5d6023759f994281af92ba494c2c064c P cdbc65865eef4a2381b6d3ac692315f5: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260807 08:40:23.450115 17390 tablet.cc:2369] T 5d6023759f994281af92ba494c2c064c P 2c48c3311f0040b59f1f324488d189a1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 08:40:23.494166 17731 raft_consensus.cc:482] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:40:23.494321 17731 raft_consensus.cc:504] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:23.495486 17731 leader_election.cc:288] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c48c3311f0040b59f1f324488d189a1 (127.8.208.193:41709), cdbc65865eef4a2381b6d3ac692315f5 (127.8.208.194:42239)
I20260807 08:40:23.499531 17719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:23.495760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:38059 (local address 127.8.208.193:41709)
0807 08:40:23.495888 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:23.495892 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:23.495905 (+ 13us) server_negotiation.cc:407] Connection header received
0807 08:40:23.496080 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:23.496083 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:23.496131 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:23.496214 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:23.496601 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.497394 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.498517 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.499063 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.499144 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:23.499181 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:23.499386 (+ 205us) server_negotiation.cc:299] Negotiation successful
0807 08:40:23.499435 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 08:40:23.499559 17580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:23.495695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:41709 (local address 127.8.208.195:38059)
0807 08:40:23.495831 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:23.495847 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:23.495935 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:23.496297 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:23.496300 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:23.496322 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:23.496478 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:23.496485 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.497490 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.497493 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:23.498393 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:23.498401 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.499164 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.499168 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:23.499266 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:23.499289 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 08:40:23.499368 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 08:40:23.499438 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":1}
I20260807 08:40:23.500028 17734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:23.495955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:42239 (local address 127.8.208.195:33439)
0807 08:40:23.496347 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:23.496359 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:23.496448 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:23.496685 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:23.496687 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:23.496704 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:23.497198 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:23.497207 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.498067 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.498068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:23.498872 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:23.498881 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.499752 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.499755 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:23.499833 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:23.499847 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 08:40:23.499897 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 08:40:23.499945 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":182,"threads_started":1}
I20260807 08:40:23.500082 17723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:23.496165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:33439 (local address 127.8.208.194:42239)
0807 08:40:23.496295 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:23.496299 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:23.496456 (+ 157us) server_negotiation.cc:407] Connection header received
0807 08:40:23.496519 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:23.496525 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:23.496583 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:23.496655 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:23.497331 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.497975 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.499012 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.499535 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.499635 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:23.499684 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:23.499923 (+ 239us) server_negotiation.cc:299] Negotiation successful
0807 08:40:23.499988 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 08:40:23.500090 17340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d6023759f994281af92ba494c2c064c" candidate_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c48c3311f0040b59f1f324488d189a1" is_pre_election: true
I20260807 08:40:23.500344 17340 raft_consensus.cc:2454] T 5d6023759f994281af92ba494c2c064c P 2c48c3311f0040b59f1f324488d189a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f537e96b001420fb83f81a5ddb2a6a0 in term 0.
I20260807 08:40:23.500624 17494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d6023759f994281af92ba494c2c064c" candidate_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdbc65865eef4a2381b6d3ac692315f5" is_pre_election: true
I20260807 08:40:23.500757 17572 leader_election.cc:302] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f537e96b001420fb83f81a5ddb2a6a0, 2c48c3311f0040b59f1f324488d189a1; no voters:
I20260807 08:40:23.500805 17494 raft_consensus.cc:2454] T 5d6023759f994281af92ba494c2c064c P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f537e96b001420fb83f81a5ddb2a6a0 in term 0.
I20260807 08:40:23.500985 17731 raft_consensus.cc:2781] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:40:23.501070 17731 raft_consensus.cc:482] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:40:23.501140 17731 raft_consensus.cc:3037] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:23.502169 17731 raft_consensus.cc:504] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:23.502463 17731 leader_election.cc:288] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0 [CANDIDATE]: Term 1 election: Requested vote from peers 2c48c3311f0040b59f1f324488d189a1 (127.8.208.193:41709), cdbc65865eef4a2381b6d3ac692315f5 (127.8.208.194:42239)
I20260807 08:40:23.502739 17340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d6023759f994281af92ba494c2c064c" candidate_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c48c3311f0040b59f1f324488d189a1"
I20260807 08:40:23.502853 17494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d6023759f994281af92ba494c2c064c" candidate_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdbc65865eef4a2381b6d3ac692315f5"
I20260807 08:40:23.502863 17340 raft_consensus.cc:3037] T 5d6023759f994281af92ba494c2c064c P 2c48c3311f0040b59f1f324488d189a1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:23.502982 17494 raft_consensus.cc:3037] T 5d6023759f994281af92ba494c2c064c P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:23.503862 17340 raft_consensus.cc:2454] T 5d6023759f994281af92ba494c2c064c P 2c48c3311f0040b59f1f324488d189a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f537e96b001420fb83f81a5ddb2a6a0 in term 1.
I20260807 08:40:23.504055 17494 raft_consensus.cc:2454] T 5d6023759f994281af92ba494c2c064c P cdbc65865eef4a2381b6d3ac692315f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f537e96b001420fb83f81a5ddb2a6a0 in term 1.
I20260807 08:40:23.504146 17572 leader_election.cc:302] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f537e96b001420fb83f81a5ddb2a6a0, 2c48c3311f0040b59f1f324488d189a1; no voters:
I20260807 08:40:23.504449 17731 raft_consensus.cc:2781] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:23.504680 17731 raft_consensus.cc:686] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0 [term 1 LEADER]: Becoming Leader. State: Replica: 1f537e96b001420fb83f81a5ddb2a6a0, State: Running, Role: LEADER
I20260807 08:40:23.504997 17731 consensus_queue.cc:237] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:23.507692 17167 catalog_manager.cc:5495] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f537e96b001420fb83f81a5ddb2a6a0 (127.8.208.195). New cstate: current_term: 1 leader_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } health_report { overall_health: HEALTHY } } }
I20260807 08:40:23.541618 17722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:23.538606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42108 (local address 127.8.208.195:40893)
0807 08:40:23.538723 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:23.538726 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:23.538739 (+ 13us) server_negotiation.cc:407] Connection header received
0807 08:40:23.538863 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:23.538865 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:23.538912 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:23.538998 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:40:23.539208 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.539638 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.540433 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.540631 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.540703 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:23.540916 (+ 213us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:40:23.541293 (+ 377us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:40:23.541367 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:23.541421 (+ 54us) server_negotiation.cc:299] Negotiation successful
0807 08:40:23.541465 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 08:40:23.546823 17340 raft_consensus.cc:1261] T 5d6023759f994281af92ba494c2c064c P 2c48c3311f0040b59f1f324488d189a1 [term 1 FOLLOWER]: Refusing update from remote peer 1f537e96b001420fb83f81a5ddb2a6a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:40:23.547214 17494 raft_consensus.cc:1261] T 5d6023759f994281af92ba494c2c064c P cdbc65865eef4a2381b6d3ac692315f5 [term 1 FOLLOWER]: Refusing update from remote peer 1f537e96b001420fb83f81a5ddb2a6a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:40:23.547534 17731 consensus_queue.cc:1035] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:40:23.547811 17735 consensus_queue.cc:1035] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:40:23.553395 17738 mvcc.cc:205] Tried to move back new op lower bound from 7315832928440987648 to 7315832928278777856. Current Snapshot: MvccSnapshot[applied={T|T < 7315832928440987648}]
I20260807 08:40:23.554304 17740 mvcc.cc:205] Tried to move back new op lower bound from 7315832928440987648 to 7315832928278777856. Current Snapshot: MvccSnapshot[applied={T|T < 7315832928440987648}]
I20260807 08:40:23.557040 17739 mvcc.cc:205] Tried to move back new op lower bound from 7315832928440987648 to 7315832928278777856. Current Snapshot: MvccSnapshot[applied={T|T < 7315832928440987648}]
I20260807 08:40:23.561426 17167 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51202:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:40:23.561592 17167 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51202:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:40:23.563773 17167 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c: Sending DeleteTablet for 3 replicas of tablet 5d6023759f994281af92ba494c2c064c
I20260807 08:40:23.564582 17316 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d6023759f994281af92ba494c2c064c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:23 UTC) from {username='oryx', principal='oryx/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:43356
I20260807 08:40:23.564592 17470 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d6023759f994281af92ba494c2c064c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:23 UTC) from {username='oryx', principal='oryx/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:58120
I20260807 08:40:23.564942 17167 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51202:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 08:40:23.565003 17620 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d6023759f994281af92ba494c2c064c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:23 UTC) from {username='oryx', principal='oryx/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:42098
W20260807 08:40:23.565310 17167 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:40:23.565382 17750 tablet_replica.cc:330] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0: stopping tablet replica
I20260807 08:40:23.565609 17748 tablet_replica.cc:330] T 5d6023759f994281af92ba494c2c064c P 2c48c3311f0040b59f1f324488d189a1: stopping tablet replica
I20260807 08:40:23.565636 17750 raft_consensus.cc:2229] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0 [term 1 LEADER]: Raft consensus shutting down.
I20260807 08:40:23.566021 17750 raft_consensus.cc:2258] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:23.566030 17748 raft_consensus.cc:2229] T 5d6023759f994281af92ba494c2c064c P 2c48c3311f0040b59f1f324488d189a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:40:23.566413 17748 raft_consensus.cc:2258] T 5d6023759f994281af92ba494c2c064c P 2c48c3311f0040b59f1f324488d189a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:23.567508 17750 ts_tablet_manager.cc:1905] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:23.568717 17748 ts_tablet_manager.cc:1905] T 5d6023759f994281af92ba494c2c064c P 2c48c3311f0040b59f1f324488d189a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:23.570348 17750 ts_tablet_manager.cc:1918] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:40:23.570442 17750 log.cc:1196] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/5d6023759f994281af92ba494c2c064c
I20260807 08:40:23.570737 17750 ts_tablet_manager.cc:1939] T 5d6023759f994281af92ba494c2c064c P 1f537e96b001420fb83f81a5ddb2a6a0: Deleting consensus metadata
I20260807 08:40:23.570852 17316 tablet_service.cc:1467] Processing CreateTablet for tablet 58a3cd15c8c34592954a95aa31f9176c (DEFAULT_TABLE table=test-table [id=78ec4d759354452db9d64fefe125aa0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:23.571105 17316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58a3cd15c8c34592954a95aa31f9176c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:23.571717 17748 ts_tablet_manager.cc:1918] T 5d6023759f994281af92ba494c2c064c P 2c48c3311f0040b59f1f324488d189a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:40:23.572000 17749 tablet_replica.cc:330] T 5d6023759f994281af92ba494c2c064c P cdbc65865eef4a2381b6d3ac692315f5: stopping tablet replica
I20260807 08:40:23.572070 17154 catalog_manager.cc:4841] TS 1f537e96b001420fb83f81a5ddb2a6a0 (127.8.208.195:40893): tablet 5d6023759f994281af92ba494c2c064c (table test-table [id=bc4c3d1d9850410588d21b03cf9ca7ca]) successfully deleted
I20260807 08:40:23.572192 17748 log.cc:1196] T 5d6023759f994281af92ba494c2c064c P 2c48c3311f0040b59f1f324488d189a1: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-0/wal/wals/5d6023759f994281af92ba494c2c064c
I20260807 08:40:23.572539 17749 raft_consensus.cc:2229] T 5d6023759f994281af92ba494c2c064c P cdbc65865eef4a2381b6d3ac692315f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:40:23.572837 17749 raft_consensus.cc:2258] T 5d6023759f994281af92ba494c2c064c P cdbc65865eef4a2381b6d3ac692315f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:23.573282 17726 tablet_bootstrap.cc:492] T 58a3cd15c8c34592954a95aa31f9176c P 2c48c3311f0040b59f1f324488d189a1: Bootstrap starting.
I20260807 08:40:23.573335 17748 ts_tablet_manager.cc:1939] T 5d6023759f994281af92ba494c2c064c P 2c48c3311f0040b59f1f324488d189a1: Deleting consensus metadata
I20260807 08:40:23.573513 17470 tablet_service.cc:1467] Processing CreateTablet for tablet 58a3cd15c8c34592954a95aa31f9176c (DEFAULT_TABLE table=test-table [id=78ec4d759354452db9d64fefe125aa0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:23.573732 17470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58a3cd15c8c34592954a95aa31f9176c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:23.574183 17726 tablet_bootstrap.cc:654] T 58a3cd15c8c34592954a95aa31f9176c P 2c48c3311f0040b59f1f324488d189a1: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:23.575290 17749 ts_tablet_manager.cc:1905] T 5d6023759f994281af92ba494c2c064c P cdbc65865eef4a2381b6d3ac692315f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:23.575964 17727 tablet_bootstrap.cc:492] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5: Bootstrap starting.
I20260807 08:40:23.576148 17620 tablet_service.cc:1467] Processing CreateTablet for tablet 58a3cd15c8c34592954a95aa31f9176c (DEFAULT_TABLE table=test-table [id=78ec4d759354452db9d64fefe125aa0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:23.576386 17620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58a3cd15c8c34592954a95aa31f9176c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:23.576860 17727 tablet_bootstrap.cc:654] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:23.577536 17749 ts_tablet_manager.cc:1918] T 5d6023759f994281af92ba494c2c064c P cdbc65865eef4a2381b6d3ac692315f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:40:23.577633 17749 log.cc:1196] T 5d6023759f994281af92ba494c2c064c P cdbc65865eef4a2381b6d3ac692315f5: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-1/wal/wals/5d6023759f994281af92ba494c2c064c
I20260807 08:40:23.577986 17749 ts_tablet_manager.cc:1939] T 5d6023759f994281af92ba494c2c064c P cdbc65865eef4a2381b6d3ac692315f5: Deleting consensus metadata
I20260807 08:40:23.578679 17725 tablet_bootstrap.cc:492] T 58a3cd15c8c34592954a95aa31f9176c P 1f537e96b001420fb83f81a5ddb2a6a0: Bootstrap starting.
I20260807 08:40:23.579128 17726 tablet_bootstrap.cc:492] T 58a3cd15c8c34592954a95aa31f9176c P 2c48c3311f0040b59f1f324488d189a1: No bootstrap required, opened a new log
I20260807 08:40:23.579196 17726 ts_tablet_manager.cc:1397] T 58a3cd15c8c34592954a95aa31f9176c P 2c48c3311f0040b59f1f324488d189a1: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260807 08:40:23.579372 17725 tablet_bootstrap.cc:654] T 58a3cd15c8c34592954a95aa31f9176c P 1f537e96b001420fb83f81a5ddb2a6a0: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:23.579577 17726 raft_consensus.cc:348] T 58a3cd15c8c34592954a95aa31f9176c P 2c48c3311f0040b59f1f324488d189a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:23.579681 17726 raft_consensus.cc:374] T 58a3cd15c8c34592954a95aa31f9176c P 2c48c3311f0040b59f1f324488d189a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:23.579707 17726 raft_consensus.cc:729] T 58a3cd15c8c34592954a95aa31f9176c P 2c48c3311f0040b59f1f324488d189a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c48c3311f0040b59f1f324488d189a1, State: Initialized, Role: FOLLOWER
I20260807 08:40:23.579802 17726 consensus_queue.cc:260] T 58a3cd15c8c34592954a95aa31f9176c P 2c48c3311f0040b59f1f324488d189a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:23.580013 17726 ts_tablet_manager.cc:1428] T 58a3cd15c8c34592954a95aa31f9176c P 2c48c3311f0040b59f1f324488d189a1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 08:40:23.580107 17152 catalog_manager.cc:4841] TS 2c48c3311f0040b59f1f324488d189a1 (127.8.208.193:41709): tablet 5d6023759f994281af92ba494c2c064c (table test-table [id=bc4c3d1d9850410588d21b03cf9ca7ca]) successfully deleted
I20260807 08:40:23.580200 17152 catalog_manager.cc:4841] TS cdbc65865eef4a2381b6d3ac692315f5 (127.8.208.194:42239): tablet 5d6023759f994281af92ba494c2c064c (table test-table [id=bc4c3d1d9850410588d21b03cf9ca7ca]) successfully deleted
I20260807 08:40:23.580806 17725 tablet_bootstrap.cc:492] T 58a3cd15c8c34592954a95aa31f9176c P 1f537e96b001420fb83f81a5ddb2a6a0: No bootstrap required, opened a new log
I20260807 08:40:23.580888 17725 ts_tablet_manager.cc:1397] T 58a3cd15c8c34592954a95aa31f9176c P 1f537e96b001420fb83f81a5ddb2a6a0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 08:40:23.581197 17727 tablet_bootstrap.cc:492] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5: No bootstrap required, opened a new log
I20260807 08:40:23.581259 17727 ts_tablet_manager.cc:1397] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260807 08:40:23.581230 17725 raft_consensus.cc:348] T 58a3cd15c8c34592954a95aa31f9176c P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:23.581295 17725 raft_consensus.cc:374] T 58a3cd15c8c34592954a95aa31f9176c P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:23.581314 17725 raft_consensus.cc:729] T 58a3cd15c8c34592954a95aa31f9176c P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f537e96b001420fb83f81a5ddb2a6a0, State: Initialized, Role: FOLLOWER
I20260807 08:40:23.581475 17725 consensus_queue.cc:260] T 58a3cd15c8c34592954a95aa31f9176c P 1f537e96b001420fb83f81a5ddb2a6a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:23.581642 17727 raft_consensus.cc:348] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:23.581707 17725 ts_tablet_manager.cc:1428] T 58a3cd15c8c34592954a95aa31f9176c P 1f537e96b001420fb83f81a5ddb2a6a0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 08:40:23.581727 17727 raft_consensus.cc:374] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:23.581753 17727 raft_consensus.cc:729] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdbc65865eef4a2381b6d3ac692315f5, State: Initialized, Role: FOLLOWER
I20260807 08:40:23.581920 17727 consensus_queue.cc:260] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:23.582147 17727 ts_tablet_manager.cc:1428] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20260807 08:40:23.588217 17695 tablet.cc:2369] T 58a3cd15c8c34592954a95aa31f9176c P 1f537e96b001420fb83f81a5ddb2a6a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 08:40:23.646895 17546 tablet.cc:2369] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 08:40:23.925016 17733 raft_consensus.cc:482] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:40:23.925170 17733 raft_consensus.cc:504] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:23.926577 17733 leader_election.cc:288] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c48c3311f0040b59f1f324488d189a1 (127.8.208.193:41709), 1f537e96b001420fb83f81a5ddb2a6a0 (127.8.208.195:40893)
I20260807 08:40:23.931388 17722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:23.926980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:43075 (local address 127.8.208.195:40893)
0807 08:40:23.927205 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:23.927212 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:23.927236 (+ 24us) server_negotiation.cc:407] Connection header received
0807 08:40:23.927424 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:23.927427 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:23.927479 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:23.927579 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:23.927937 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.928662 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.930266 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.930803 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.930930 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:23.930982 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:23.931188 (+ 206us) server_negotiation.cc:299] Negotiation successful
0807 08:40:23.931249 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260807 08:40:23.931388 17719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:23.926924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:44669 (local address 127.8.208.193:41709)
0807 08:40:23.927163 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:23.927169 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:23.927265 (+ 96us) server_negotiation.cc:407] Connection header received
0807 08:40:23.927424 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:23.927427 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:23.927479 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:23.927566 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:23.927938 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.928661 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.930265 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.930803 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.930930 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:23.930982 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:23.931188 (+ 206us) server_negotiation.cc:299] Negotiation successful
0807 08:40:23.931249 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260807 08:40:23.931475 17756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:23.926852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:40893 (local address 127.8.208.194:43075)
0807 08:40:23.927166 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:23.927191 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:23.927302 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:23.927585 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:23.927588 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:23.927625 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:23.927797 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:23.927804 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.928796 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.928798 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:23.930143 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:23.930154 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.930931 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.930934 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:23.931072 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:23.931109 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 08:40:23.931177 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 08:40:23.931292 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"mutex_wait_us":180,"spinlock_wait_cycles":5248,"thread_start_us":78,"threads_started":1}
I20260807 08:40:23.931646 17755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:23.926839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:41709 (local address 127.8.208.194:44669)
0807 08:40:23.927153 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:23.927168 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:23.927311 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:23.927585 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:23.927588 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:23.927623 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:23.927798 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:23.927804 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.928776 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.928780 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:23.930143 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:23.930154 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:23.930930 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:23.930934 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:23.931068 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:23.931113 (+ 45us) client_negotiation.cc:769] Sending connection context
0807 08:40:23.931177 (+ 64us) client_negotiation.cc:240] Negotiation successful
0807 08:40:23.931294 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":193,"spinlock_wait_cycles":26368,"thread_start_us":82,"threads_started":1}
I20260807 08:40:23.932092 17340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58a3cd15c8c34592954a95aa31f9176c" candidate_uuid: "cdbc65865eef4a2381b6d3ac692315f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c48c3311f0040b59f1f324488d189a1" is_pre_election: true
I20260807 08:40:23.932058 17644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58a3cd15c8c34592954a95aa31f9176c" candidate_uuid: "cdbc65865eef4a2381b6d3ac692315f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" is_pre_election: true
I20260807 08:40:23.932253 17340 raft_consensus.cc:2454] T 58a3cd15c8c34592954a95aa31f9176c P 2c48c3311f0040b59f1f324488d189a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdbc65865eef4a2381b6d3ac692315f5 in term 0.
I20260807 08:40:23.932307 17644 raft_consensus.cc:2454] T 58a3cd15c8c34592954a95aa31f9176c P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdbc65865eef4a2381b6d3ac692315f5 in term 0.
I20260807 08:40:23.932600 17417 leader_election.cc:302] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c48c3311f0040b59f1f324488d189a1, cdbc65865eef4a2381b6d3ac692315f5; no voters:
I20260807 08:40:23.932884 17733 raft_consensus.cc:2781] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:40:23.932945 17733 raft_consensus.cc:482] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:40:23.932973 17733 raft_consensus.cc:3037] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:23.934021 17733 raft_consensus.cc:504] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:23.934319 17733 leader_election.cc:288] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5 [CANDIDATE]: Term 1 election: Requested vote from peers 2c48c3311f0040b59f1f324488d189a1 (127.8.208.193:41709), 1f537e96b001420fb83f81a5ddb2a6a0 (127.8.208.195:40893)
I20260807 08:40:23.934590 17340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58a3cd15c8c34592954a95aa31f9176c" candidate_uuid: "cdbc65865eef4a2381b6d3ac692315f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c48c3311f0040b59f1f324488d189a1"
I20260807 08:40:23.934651 17644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58a3cd15c8c34592954a95aa31f9176c" candidate_uuid: "cdbc65865eef4a2381b6d3ac692315f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f537e96b001420fb83f81a5ddb2a6a0"
I20260807 08:40:23.934718 17340 raft_consensus.cc:3037] T 58a3cd15c8c34592954a95aa31f9176c P 2c48c3311f0040b59f1f324488d189a1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:23.934738 17644 raft_consensus.cc:3037] T 58a3cd15c8c34592954a95aa31f9176c P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:23.935742 17340 raft_consensus.cc:2454] T 58a3cd15c8c34592954a95aa31f9176c P 2c48c3311f0040b59f1f324488d189a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdbc65865eef4a2381b6d3ac692315f5 in term 1.
I20260807 08:40:23.935742 17644 raft_consensus.cc:2454] T 58a3cd15c8c34592954a95aa31f9176c P 1f537e96b001420fb83f81a5ddb2a6a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdbc65865eef4a2381b6d3ac692315f5 in term 1.
I20260807 08:40:23.936064 17419 leader_election.cc:302] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1f537e96b001420fb83f81a5ddb2a6a0, 2c48c3311f0040b59f1f324488d189a1, cdbc65865eef4a2381b6d3ac692315f5; no voters:
I20260807 08:40:23.936260 17733 raft_consensus.cc:2781] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:23.936448 17733 raft_consensus.cc:686] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5 [term 1 LEADER]: Becoming Leader. State: Replica: cdbc65865eef4a2381b6d3ac692315f5, State: Running, Role: LEADER
I20260807 08:40:23.936697 17733 consensus_queue.cc:237] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:23.938696 17168 catalog_manager.cc:5495] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to cdbc65865eef4a2381b6d3ac692315f5 (127.8.208.194). New cstate: current_term: 1 leader_uuid: "cdbc65865eef4a2381b6d3ac692315f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } health_report { overall_health: UNKNOWN } } }
Aug 07 08:40:24 dist-test-slave-6nmv krb5kdc[17123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092022, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.254@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM
I20260807 08:40:24.059175 17764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:24.051218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:39489 (local address 127.0.0.1:51210)
0807 08:40:24.051474 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:24.051492 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:24.051615 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:24.051847 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:24.051849 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:24.052222 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:24.052313 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:24.052319 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.052994 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.052996 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:24.053521 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:24.053529 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.054006 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.054009 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:24.054069 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:24.054695 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:24.054707 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:24.056160 (+ 1453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:24.057686 (+ 1526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:24.057695 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:24.057700 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:24.058020 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:24.058300 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:24.058302 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:24.058304 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:24.058403 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:24.058695 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:24.058699 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:24.058811 (+ 112us) client_negotiation.cc:769] Sending connection context
0807 08:40:24.058911 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 08:40:24.059016 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":74,"threads_started":1}
I20260807 08:40:24.059186 17765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:24.051336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51210 (local address 127.8.208.254:39489)
0807 08:40:24.051585 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:24.051591 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:24.051612 (+ 21us) server_negotiation.cc:407] Connection header received
0807 08:40:24.051706 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:24.051707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:24.051740 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:24.051806 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:24.052418 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.052909 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.053630 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.053873 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.053975 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:24.056271 (+ 2296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:24.056274 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:24.056276 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:24.056296 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:24.057567 (+ 1271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:24.058150 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:24.058153 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:24.058154 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:24.058224 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:24.058469 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:24.058471 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:24.058471 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:24.058610 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:24.058677 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:24.058970 (+ 293us) server_negotiation.cc:299] Negotiation successful
0807 08:40:24.059060 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":115,"threads_started":1}
I20260807 08:40:24.062593 17168 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:51210:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 08:40:24.063200 17168 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:40:24.067894 17470 tablet_service.cc:1467] Processing CreateTablet for tablet 31eaee956f67449cabaf20012d4a7764 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5c21042311db4c02a24c0e60e03e3d0f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 08:40:24.067857 17316 tablet_service.cc:1467] Processing CreateTablet for tablet 31eaee956f67449cabaf20012d4a7764 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5c21042311db4c02a24c0e60e03e3d0f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 08:40:24.067962 17620 tablet_service.cc:1467] Processing CreateTablet for tablet 31eaee956f67449cabaf20012d4a7764 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5c21042311db4c02a24c0e60e03e3d0f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 08:40:24.068279 17470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31eaee956f67449cabaf20012d4a7764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:24.068277 17316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31eaee956f67449cabaf20012d4a7764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:24.068348 17620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31eaee956f67449cabaf20012d4a7764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:24.070755 17725 tablet_bootstrap.cc:492] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0: Bootstrap starting.
I20260807 08:40:24.071156 17727 tablet_bootstrap.cc:492] T 31eaee956f67449cabaf20012d4a7764 P cdbc65865eef4a2381b6d3ac692315f5: Bootstrap starting.
I20260807 08:40:24.071682 17725 tablet_bootstrap.cc:654] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:24.071885 17727 tablet_bootstrap.cc:654] T 31eaee956f67449cabaf20012d4a7764 P cdbc65865eef4a2381b6d3ac692315f5: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:24.072711 17726 tablet_bootstrap.cc:492] T 31eaee956f67449cabaf20012d4a7764 P 2c48c3311f0040b59f1f324488d189a1: Bootstrap starting.
I20260807 08:40:24.073060 17725 tablet_bootstrap.cc:492] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0: No bootstrap required, opened a new log
I20260807 08:40:24.073122 17725 ts_tablet_manager.cc:1397] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 08:40:24.073375 17726 tablet_bootstrap.cc:654] T 31eaee956f67449cabaf20012d4a7764 P 2c48c3311f0040b59f1f324488d189a1: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:24.073447 17725 raft_consensus.cc:348] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.073527 17725 raft_consensus.cc:374] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:24.073549 17725 raft_consensus.cc:729] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f537e96b001420fb83f81a5ddb2a6a0, State: Initialized, Role: FOLLOWER
I20260807 08:40:24.073643 17725 consensus_queue.cc:260] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.073948 17725 ts_tablet_manager.cc:1428] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 08:40:24.073922 17744 tablet_replica.cc:439] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } } }
I20260807 08:40:24.074045 17744 tablet_replica.cc:442] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 08:40:24.074690 17726 tablet_bootstrap.cc:492] T 31eaee956f67449cabaf20012d4a7764 P 2c48c3311f0040b59f1f324488d189a1: No bootstrap required, opened a new log
I20260807 08:40:24.074785 17726 ts_tablet_manager.cc:1397] T 31eaee956f67449cabaf20012d4a7764 P 2c48c3311f0040b59f1f324488d189a1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 08:40:24.075222 17726 raft_consensus.cc:348] T 31eaee956f67449cabaf20012d4a7764 P 2c48c3311f0040b59f1f324488d189a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.075330 17726 raft_consensus.cc:374] T 31eaee956f67449cabaf20012d4a7764 P 2c48c3311f0040b59f1f324488d189a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:24.075367 17726 raft_consensus.cc:729] T 31eaee956f67449cabaf20012d4a7764 P 2c48c3311f0040b59f1f324488d189a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c48c3311f0040b59f1f324488d189a1, State: Initialized, Role: FOLLOWER
I20260807 08:40:24.075475 17726 consensus_queue.cc:260] T 31eaee956f67449cabaf20012d4a7764 P 2c48c3311f0040b59f1f324488d189a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.075723 17732 tablet_replica.cc:439] T 31eaee956f67449cabaf20012d4a7764 P 2c48c3311f0040b59f1f324488d189a1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } } }
I20260807 08:40:24.075867 17732 tablet_replica.cc:442] T 31eaee956f67449cabaf20012d4a7764 P 2c48c3311f0040b59f1f324488d189a1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 08:40:24.075750 17726 ts_tablet_manager.cc:1428] T 31eaee956f67449cabaf20012d4a7764 P 2c48c3311f0040b59f1f324488d189a1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 08:40:24.076215 17727 tablet_bootstrap.cc:492] T 31eaee956f67449cabaf20012d4a7764 P cdbc65865eef4a2381b6d3ac692315f5: No bootstrap required, opened a new log
I20260807 08:40:24.076306 17727 ts_tablet_manager.cc:1397] T 31eaee956f67449cabaf20012d4a7764 P cdbc65865eef4a2381b6d3ac692315f5: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260807 08:40:24.076766 17727 raft_consensus.cc:348] T 31eaee956f67449cabaf20012d4a7764 P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.076891 17727 raft_consensus.cc:374] T 31eaee956f67449cabaf20012d4a7764 P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:24.076941 17727 raft_consensus.cc:729] T 31eaee956f67449cabaf20012d4a7764 P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdbc65865eef4a2381b6d3ac692315f5, State: Initialized, Role: FOLLOWER
I20260807 08:40:24.077076 17727 consensus_queue.cc:260] T 31eaee956f67449cabaf20012d4a7764 P cdbc65865eef4a2381b6d3ac692315f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.077361 17727 ts_tablet_manager.cc:1428] T 31eaee956f67449cabaf20012d4a7764 P cdbc65865eef4a2381b6d3ac692315f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 08:40:24.077307 17733 tablet_replica.cc:439] T 31eaee956f67449cabaf20012d4a7764 P cdbc65865eef4a2381b6d3ac692315f5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } } }
I20260807 08:40:24.077461 17733 tablet_replica.cc:442] T 31eaee956f67449cabaf20012d4a7764 P cdbc65865eef4a2381b6d3ac692315f5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 08:40:24.156522 17744 raft_consensus.cc:482] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:40:24.156662 17744 raft_consensus.cc:504] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.157055 17744 leader_election.cc:288] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c48c3311f0040b59f1f324488d189a1 (127.8.208.193:41709), cdbc65865eef4a2381b6d3ac692315f5 (127.8.208.194:42239)
I20260807 08:40:24.157488 17494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31eaee956f67449cabaf20012d4a7764" candidate_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdbc65865eef4a2381b6d3ac692315f5" is_pre_election: true
I20260807 08:40:24.157503 17340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31eaee956f67449cabaf20012d4a7764" candidate_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c48c3311f0040b59f1f324488d189a1" is_pre_election: true
I20260807 08:40:24.157630 17494 raft_consensus.cc:2454] T 31eaee956f67449cabaf20012d4a7764 P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f537e96b001420fb83f81a5ddb2a6a0 in term 0.
I20260807 08:40:24.157639 17340 raft_consensus.cc:2454] T 31eaee956f67449cabaf20012d4a7764 P 2c48c3311f0040b59f1f324488d189a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f537e96b001420fb83f81a5ddb2a6a0 in term 0.
I20260807 08:40:24.157907 17572 leader_election.cc:302] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f537e96b001420fb83f81a5ddb2a6a0, 2c48c3311f0040b59f1f324488d189a1; no voters:
I20260807 08:40:24.158063 17744 raft_consensus.cc:2781] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:40:24.158113 17744 raft_consensus.cc:482] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:40:24.158150 17744 raft_consensus.cc:3037] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:24.159152 17744 raft_consensus.cc:504] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.159484 17744 leader_election.cc:288] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0 [CANDIDATE]: Term 1 election: Requested vote from peers 2c48c3311f0040b59f1f324488d189a1 (127.8.208.193:41709), cdbc65865eef4a2381b6d3ac692315f5 (127.8.208.194:42239)
I20260807 08:40:24.159791 17340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31eaee956f67449cabaf20012d4a7764" candidate_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c48c3311f0040b59f1f324488d189a1"
I20260807 08:40:24.159848 17494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31eaee956f67449cabaf20012d4a7764" candidate_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdbc65865eef4a2381b6d3ac692315f5"
I20260807 08:40:24.159947 17494 raft_consensus.cc:3037] T 31eaee956f67449cabaf20012d4a7764 P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:24.159943 17340 raft_consensus.cc:3037] T 31eaee956f67449cabaf20012d4a7764 P 2c48c3311f0040b59f1f324488d189a1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:24.160756 17340 raft_consensus.cc:2454] T 31eaee956f67449cabaf20012d4a7764 P 2c48c3311f0040b59f1f324488d189a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f537e96b001420fb83f81a5ddb2a6a0 in term 1.
I20260807 08:40:24.160847 17494 raft_consensus.cc:2454] T 31eaee956f67449cabaf20012d4a7764 P cdbc65865eef4a2381b6d3ac692315f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f537e96b001420fb83f81a5ddb2a6a0 in term 1.
I20260807 08:40:24.161078 17572 leader_election.cc:302] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f537e96b001420fb83f81a5ddb2a6a0, 2c48c3311f0040b59f1f324488d189a1; no voters:
I20260807 08:40:24.161270 17744 raft_consensus.cc:2781] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:24.161480 17744 raft_consensus.cc:686] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 1 LEADER]: Becoming Leader. State: Replica: 1f537e96b001420fb83f81a5ddb2a6a0, State: Running, Role: LEADER
I20260807 08:40:24.161625 17744 consensus_queue.cc:237] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.162266 17769 tablet_replica.cc:439] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0: TxnStatusTablet state changed. Reason: New leader 1f537e96b001420fb83f81a5ddb2a6a0. Latest consensus state: current_term: 1 leader_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } } }
I20260807 08:40:24.162366 17769 tablet_replica.cc:442] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0: This TxnStatusTablet replica's current role is: LEADER
I20260807 08:40:24.162598 17771 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 08:40:24.162765 17771 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 08:40:24.163302 17166 catalog_manager.cc:5495] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f537e96b001420fb83f81a5ddb2a6a0 (127.8.208.195). New cstate: current_term: 1 leader_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } health_report { overall_health: HEALTHY } } }
I20260807 08:40:24.175655 17722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:24.172598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42124 (local address 127.8.208.195:40893)
0807 08:40:24.172721 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:24.172724 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:24.172802 (+ 78us) server_negotiation.cc:407] Connection header received
0807 08:40:24.172975 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:24.172977 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:24.173012 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:24.173069 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:40:24.173307 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.173733 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.174747 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.174931 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.175001 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:24.175306 (+ 305us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:40:24.175361 (+ 55us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:40:24.175403 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:24.175530 (+ 127us) server_negotiation.cc:299] Negotiation successful
0807 08:40:24.175573 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 08:40:24.175719 17764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:24.172529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:40893 (local address 127.0.0.1:42124)
0807 08:40:24.172744 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:24.172758 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:24.172861 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:24.173110 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:24.173113 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:24.173120 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 08:40:24.173224 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:24.173230 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.173833 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.173836 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:24.174648 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:24.174658 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.175028 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.175031 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:24.175146 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:24.175193 (+ 47us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 08:40:24.175428 (+ 235us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 08:40:24.175456 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 08:40:24.175517 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 08:40:24.175597 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125}
I20260807 08:40:24.177990 17494 raft_consensus.cc:1261] T 31eaee956f67449cabaf20012d4a7764 P cdbc65865eef4a2381b6d3ac692315f5 [term 1 FOLLOWER]: Refusing update from remote peer 1f537e96b001420fb83f81a5ddb2a6a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:40:24.178076 17340 raft_consensus.cc:1261] T 31eaee956f67449cabaf20012d4a7764 P 2c48c3311f0040b59f1f324488d189a1 [term 1 FOLLOWER]: Refusing update from remote peer 1f537e96b001420fb83f81a5ddb2a6a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:40:24.178331 17769 consensus_queue.cc:1035] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:40:24.178457 17744 consensus_queue.cc:1035] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:40:24.179736 17733 tablet_replica.cc:439] T 31eaee956f67449cabaf20012d4a7764 P cdbc65865eef4a2381b6d3ac692315f5: TxnStatusTablet state changed. Reason: New leader 1f537e96b001420fb83f81a5ddb2a6a0. Latest consensus state: current_term: 1 leader_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } } }
I20260807 08:40:24.179756 17732 tablet_replica.cc:439] T 31eaee956f67449cabaf20012d4a7764 P 2c48c3311f0040b59f1f324488d189a1: TxnStatusTablet state changed. Reason: New leader 1f537e96b001420fb83f81a5ddb2a6a0. Latest consensus state: current_term: 1 leader_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } } }
I20260807 08:40:24.179832 17733 tablet_replica.cc:442] T 31eaee956f67449cabaf20012d4a7764 P cdbc65865eef4a2381b6d3ac692315f5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 08:40:24.179859 17732 tablet_replica.cc:442] T 31eaee956f67449cabaf20012d4a7764 P 2c48c3311f0040b59f1f324488d189a1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 08:40:24.181074 17744 tablet_replica.cc:439] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } } }
I20260807 08:40:24.181167 17744 tablet_replica.cc:442] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0: This TxnStatusTablet replica's current role is: LEADER
I20260807 08:40:24.182981 17732 tablet_replica.cc:439] T 31eaee956f67449cabaf20012d4a7764 P 2c48c3311f0040b59f1f324488d189a1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } } }
I20260807 08:40:24.183065 17732 tablet_replica.cc:442] T 31eaee956f67449cabaf20012d4a7764 P 2c48c3311f0040b59f1f324488d189a1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 08:40:24.186959 17769 tablet_replica.cc:439] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } } }
I20260807 08:40:24.187062 17769 tablet_replica.cc:442] T 31eaee956f67449cabaf20012d4a7764 P 1f537e96b001420fb83f81a5ddb2a6a0: This TxnStatusTablet replica's current role is: LEADER
I20260807 08:40:24.188432 17733 tablet_replica.cc:439] T 31eaee956f67449cabaf20012d4a7764 P cdbc65865eef4a2381b6d3ac692315f5: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } } }
I20260807 08:40:24.188546 17733 tablet_replica.cc:442] T 31eaee956f67449cabaf20012d4a7764 P cdbc65865eef4a2381b6d3ac692315f5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 08:40:24.190356 17784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:24.185401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58136 (local address 127.8.208.194:42239)
0807 08:40:24.185650 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:24.185654 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:24.185688 (+ 34us) server_negotiation.cc:407] Connection header received
0807 08:40:24.185853 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:24.185856 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:24.185915 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:24.186046 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:40:24.186560 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.187347 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.188709 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.189000 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.189087 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:24.189416 (+ 329us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:40:24.189905 (+ 489us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:40:24.190007 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:24.190142 (+ 135us) server_negotiation.cc:299] Negotiation successful
0807 08:40:24.190188 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":86,"threads_started":1}
I20260807 08:40:24.199501 17722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:24.196429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:53179 (local address 127.8.208.195:40893)
0807 08:40:24.196556 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:24.196560 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:24.196785 (+ 225us) server_negotiation.cc:407] Connection header received
0807 08:40:24.196891 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:24.196893 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:24.196941 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:24.196999 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:40:24.197230 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.197653 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.198702 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.198872 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.198941 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:24.199193 (+ 252us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:40:24.199242 (+ 49us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:40:24.199287 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:24.199395 (+ 108us) server_negotiation.cc:299] Negotiation successful
0807 08:40:24.199429 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 08:40:24.199820 17789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:24.196361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:40893 (local address 127.8.208.194:53179)
0807 08:40:24.196699 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:24.196713 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:24.196812 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:24.197034 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:24.197037 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:24.197045 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 08:40:24.197135 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:24.197140 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.197749 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.197752 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:24.198594 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:24.198604 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.198967 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.198970 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:24.199045 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:24.199085 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 08:40:24.199316 (+ 231us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 08:40:24.199321 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 08:40:24.199391 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 08:40:24.199458 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":145,"threads_started":1}
I20260807 08:40:24.205794 17340 raft_consensus.cc:1261] T 58a3cd15c8c34592954a95aa31f9176c P 2c48c3311f0040b59f1f324488d189a1 [term 1 FOLLOWER]: Refusing update from remote peer cdbc65865eef4a2381b6d3ac692315f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:40:24.205996 17644 raft_consensus.cc:1261] T 58a3cd15c8c34592954a95aa31f9176c P 1f537e96b001420fb83f81a5ddb2a6a0 [term 1 FOLLOWER]: Refusing update from remote peer cdbc65865eef4a2381b6d3ac692315f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:40:24.206247 17757 consensus_queue.cc:1035] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:40:24.206789 17757 consensus_queue.cc:1035] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:40:24.225605 17794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:24.222335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:42239 (local address 127.8.208.195:35979)
0807 08:40:24.222632 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:24.222644 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:24.222732 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:24.222908 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:24.222910 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:24.222916 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 08:40:24.222997 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:24.223001 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.223771 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.223774 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:24.224550 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:24.224559 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.225049 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.225051 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:24.225112 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:24.225145 (+ 33us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 08:40:24.225406 (+ 261us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 08:40:24.225411 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 08:40:24.225464 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 08:40:24.225516 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":113,"threads_started":1}
I20260807 08:40:24.225612 17784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:24.222398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:35979 (local address 127.8.208.194:42239)
0807 08:40:24.222514 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:24.222517 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:24.222708 (+ 191us) server_negotiation.cc:407] Connection header received
0807 08:40:24.222804 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:24.222806 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:24.222838 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:24.222889 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:40:24.223069 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.223664 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.224652 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.224953 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.225045 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:24.225266 (+ 221us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:40:24.225330 (+ 64us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:40:24.225397 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:24.225472 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 08:40:24.225513 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 08:40:24.246234 17166 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51202:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:40:24.246383 17166 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51202:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:40:24.248224 17166 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c: Sending DeleteTablet for 3 replicas of tablet 58a3cd15c8c34592954a95aa31f9176c
I20260807 08:40:24.248726 17316 tablet_service.cc:1514] Processing DeleteTablet for tablet 58a3cd15c8c34592954a95aa31f9176c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:24 UTC) from {username='oryx', principal='oryx/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:43356
I20260807 08:40:24.248805 17620 tablet_service.cc:1514] Processing DeleteTablet for tablet 58a3cd15c8c34592954a95aa31f9176c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:24 UTC) from {username='oryx', principal='oryx/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:42098
I20260807 08:40:24.249369 17470 tablet_service.cc:1514] Processing DeleteTablet for tablet 58a3cd15c8c34592954a95aa31f9176c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:24 UTC) from {username='oryx', principal='oryx/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:58120
I20260807 08:40:24.249666 17799 tablet_replica.cc:330] T 58a3cd15c8c34592954a95aa31f9176c P 1f537e96b001420fb83f81a5ddb2a6a0: stopping tablet replica
I20260807 08:40:24.249949 17799 raft_consensus.cc:2229] T 58a3cd15c8c34592954a95aa31f9176c P 1f537e96b001420fb83f81a5ddb2a6a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:40:24.250063 17799 raft_consensus.cc:2258] T 58a3cd15c8c34592954a95aa31f9176c P 1f537e96b001420fb83f81a5ddb2a6a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:24.250283 17800 tablet_replica.cc:330] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5: stopping tablet replica
I20260807 08:40:24.250406 17800 raft_consensus.cc:2229] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5 [term 1 LEADER]: Raft consensus shutting down.
I20260807 08:40:24.250651 17800 raft_consensus.cc:2258] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:24.251312 17800 ts_tablet_manager.cc:1905] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:24.253443 17798 tablet_replica.cc:330] T 58a3cd15c8c34592954a95aa31f9176c P 2c48c3311f0040b59f1f324488d189a1: stopping tablet replica
I20260807 08:40:24.253598 17798 raft_consensus.cc:2229] T 58a3cd15c8c34592954a95aa31f9176c P 2c48c3311f0040b59f1f324488d189a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:40:24.254132 17799 ts_tablet_manager.cc:1905] T 58a3cd15c8c34592954a95aa31f9176c P 1f537e96b001420fb83f81a5ddb2a6a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:24.256618 17799 ts_tablet_manager.cc:1918] T 58a3cd15c8c34592954a95aa31f9176c P 1f537e96b001420fb83f81a5ddb2a6a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 08:40:24.256714 17799 log.cc:1196] T 58a3cd15c8c34592954a95aa31f9176c P 1f537e96b001420fb83f81a5ddb2a6a0: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/58a3cd15c8c34592954a95aa31f9176c
I20260807 08:40:24.256983 17799 ts_tablet_manager.cc:1939] T 58a3cd15c8c34592954a95aa31f9176c P 1f537e96b001420fb83f81a5ddb2a6a0: Deleting consensus metadata
I20260807 08:40:24.257589 17798 raft_consensus.cc:2258] T 58a3cd15c8c34592954a95aa31f9176c P 2c48c3311f0040b59f1f324488d189a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:24.257628 17154 catalog_manager.cc:4841] TS 1f537e96b001420fb83f81a5ddb2a6a0 (127.8.208.195:40893): tablet 58a3cd15c8c34592954a95aa31f9176c (table test-table [id=78ec4d759354452db9d64fefe125aa0d]) successfully deleted
I20260807 08:40:24.258260 17798 ts_tablet_manager.cc:1905] T 58a3cd15c8c34592954a95aa31f9176c P 2c48c3311f0040b59f1f324488d189a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:24.260694 17800 ts_tablet_manager.cc:1918] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 08:40:24.260790 17800 log.cc:1196] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-1/wal/wals/58a3cd15c8c34592954a95aa31f9176c
I20260807 08:40:24.261044 17800 ts_tablet_manager.cc:1939] T 58a3cd15c8c34592954a95aa31f9176c P cdbc65865eef4a2381b6d3ac692315f5: Deleting consensus metadata
I20260807 08:40:24.261925 17152 catalog_manager.cc:4841] TS cdbc65865eef4a2381b6d3ac692315f5 (127.8.208.194:42239): tablet 58a3cd15c8c34592954a95aa31f9176c (table test-table [id=78ec4d759354452db9d64fefe125aa0d]) successfully deleted
I20260807 08:40:24.262884 17798 ts_tablet_manager.cc:1918] T 58a3cd15c8c34592954a95aa31f9176c P 2c48c3311f0040b59f1f324488d189a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 08:40:24.262980 17798 log.cc:1196] T 58a3cd15c8c34592954a95aa31f9176c P 2c48c3311f0040b59f1f324488d189a1: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-0/wal/wals/58a3cd15c8c34592954a95aa31f9176c
I20260807 08:40:24.263248 17798 ts_tablet_manager.cc:1939] T 58a3cd15c8c34592954a95aa31f9176c P 2c48c3311f0040b59f1f324488d189a1: Deleting consensus metadata
I20260807 08:40:24.263909 17152 catalog_manager.cc:4841] TS 2c48c3311f0040b59f1f324488d189a1 (127.8.208.193:41709): tablet 58a3cd15c8c34592954a95aa31f9176c (table test-table [id=78ec4d759354452db9d64fefe125aa0d]) successfully deleted
Aug 07 08:40:24 dist-test-slave-6nmv krb5kdc[17123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 08:40:24 dist-test-slave-6nmv krb5kdc[17123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:24 dist-test-slave-6nmv krb5kdc[17123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 08:40:24.281665 17765 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:24.275751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51218 (local address 127.8.208.254:39489)
0807 08:40:24.275875 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:24.275879 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:24.276148 (+ 269us) server_negotiation.cc:407] Connection header received
0807 08:40:24.276311 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:24.276314 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:24.276367 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:24.276452 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:24.277147 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.277650 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.278482 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.278697 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.278820 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:24.281524 (+ 2704us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51218: BlockingRecv error: recv got EOF from 127.0.0.1:51218 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 07 08:40:24 dist-test-slave-6nmv krb5kdc[17123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM
I20260807 08:40:24.290952 17765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:24.283284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51224 (local address 127.8.208.254:39489)
0807 08:40:24.283488 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:24.283493 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:24.283614 (+ 121us) server_negotiation.cc:407] Connection header received
0807 08:40:24.283772 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:24.283774 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:24.283811 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:24.283889 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:24.284511 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.284925 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.285598 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.285789 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.285926 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:24.288094 (+ 2168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:24.288098 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:24.288100 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:24.288126 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:24.289444 (+ 1318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:24.289840 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:24.289843 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:24.289845 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:24.289921 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:24.290184 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:24.290187 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:24.290188 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:24.290338 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:24.290459 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:24.290682 (+ 223us) server_negotiation.cc:299] Negotiation successful
0807 08:40:24.290783 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128}
I20260807 08:40:24.293459 17166 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51224:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 08:40:24.293957 17166 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:40:24.298246 17316 tablet_service.cc:1467] Processing CreateTablet for tablet baac687c78434494b99bf9531bd76695 (DEFAULT_TABLE table=test-table [id=cdc8f3a25e27464a80b32dbf6599e909]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:24.298516 17316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baac687c78434494b99bf9531bd76695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:24.300230 17726 tablet_bootstrap.cc:492] T baac687c78434494b99bf9531bd76695 P 2c48c3311f0040b59f1f324488d189a1: Bootstrap starting.
I20260807 08:40:24.300415 17620 tablet_service.cc:1467] Processing CreateTablet for tablet baac687c78434494b99bf9531bd76695 (DEFAULT_TABLE table=test-table [id=cdc8f3a25e27464a80b32dbf6599e909]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:24.300644 17620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baac687c78434494b99bf9531bd76695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:24.301091 17726 tablet_bootstrap.cc:654] T baac687c78434494b99bf9531bd76695 P 2c48c3311f0040b59f1f324488d189a1: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:24.302731 17725 tablet_bootstrap.cc:492] T baac687c78434494b99bf9531bd76695 P 1f537e96b001420fb83f81a5ddb2a6a0: Bootstrap starting.
I20260807 08:40:24.303092 17470 tablet_service.cc:1467] Processing CreateTablet for tablet baac687c78434494b99bf9531bd76695 (DEFAULT_TABLE table=test-table [id=cdc8f3a25e27464a80b32dbf6599e909]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:24.303453 17470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baac687c78434494b99bf9531bd76695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:24.303783 17725 tablet_bootstrap.cc:654] T baac687c78434494b99bf9531bd76695 P 1f537e96b001420fb83f81a5ddb2a6a0: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:24.305382 17725 tablet_bootstrap.cc:492] T baac687c78434494b99bf9531bd76695 P 1f537e96b001420fb83f81a5ddb2a6a0: No bootstrap required, opened a new log
I20260807 08:40:24.305464 17725 ts_tablet_manager.cc:1397] T baac687c78434494b99bf9531bd76695 P 1f537e96b001420fb83f81a5ddb2a6a0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 08:40:24.305907 17727 tablet_bootstrap.cc:492] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5: Bootstrap starting.
I20260807 08:40:24.305876 17725 raft_consensus.cc:348] T baac687c78434494b99bf9531bd76695 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.305979 17725 raft_consensus.cc:374] T baac687c78434494b99bf9531bd76695 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:24.306010 17725 raft_consensus.cc:729] T baac687c78434494b99bf9531bd76695 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f537e96b001420fb83f81a5ddb2a6a0, State: Initialized, Role: FOLLOWER
I20260807 08:40:24.306169 17725 consensus_queue.cc:260] T baac687c78434494b99bf9531bd76695 P 1f537e96b001420fb83f81a5ddb2a6a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.306466 17725 ts_tablet_manager.cc:1428] T baac687c78434494b99bf9531bd76695 P 1f537e96b001420fb83f81a5ddb2a6a0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 08:40:24.306905 17727 tablet_bootstrap.cc:654] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:24.309120 17726 tablet_bootstrap.cc:492] T baac687c78434494b99bf9531bd76695 P 2c48c3311f0040b59f1f324488d189a1: No bootstrap required, opened a new log
I20260807 08:40:24.309222 17726 ts_tablet_manager.cc:1397] T baac687c78434494b99bf9531bd76695 P 2c48c3311f0040b59f1f324488d189a1: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20260807 08:40:24.309561 17726 raft_consensus.cc:348] T baac687c78434494b99bf9531bd76695 P 2c48c3311f0040b59f1f324488d189a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.309665 17726 raft_consensus.cc:374] T baac687c78434494b99bf9531bd76695 P 2c48c3311f0040b59f1f324488d189a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:24.309722 17726 raft_consensus.cc:729] T baac687c78434494b99bf9531bd76695 P 2c48c3311f0040b59f1f324488d189a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c48c3311f0040b59f1f324488d189a1, State: Initialized, Role: FOLLOWER
I20260807 08:40:24.309887 17726 consensus_queue.cc:260] T baac687c78434494b99bf9531bd76695 P 2c48c3311f0040b59f1f324488d189a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.310142 17726 ts_tablet_manager.cc:1428] T baac687c78434494b99bf9531bd76695 P 2c48c3311f0040b59f1f324488d189a1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 08:40:24.314410 17727 tablet_bootstrap.cc:492] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5: No bootstrap required, opened a new log
I20260807 08:40:24.314507 17727 ts_tablet_manager.cc:1397] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260807 08:40:24.314839 17727 raft_consensus.cc:348] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.314946 17727 raft_consensus.cc:374] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:24.314982 17727 raft_consensus.cc:729] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdbc65865eef4a2381b6d3ac692315f5, State: Initialized, Role: FOLLOWER
I20260807 08:40:24.315100 17727 consensus_queue.cc:260] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.315336 17727 ts_tablet_manager.cc:1428] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 08:40:24.579963 17757 raft_consensus.cc:482] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:40:24.580080 17757 raft_consensus.cc:504] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.580452 17757 leader_election.cc:288] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c48c3311f0040b59f1f324488d189a1 (127.8.208.193:41709), 1f537e96b001420fb83f81a5ddb2a6a0 (127.8.208.195:40893)
I20260807 08:40:24.580868 17340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baac687c78434494b99bf9531bd76695" candidate_uuid: "cdbc65865eef4a2381b6d3ac692315f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c48c3311f0040b59f1f324488d189a1" is_pre_election: true
I20260807 08:40:24.580876 17644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baac687c78434494b99bf9531bd76695" candidate_uuid: "cdbc65865eef4a2381b6d3ac692315f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" is_pre_election: true
I20260807 08:40:24.581022 17644 raft_consensus.cc:2454] T baac687c78434494b99bf9531bd76695 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdbc65865eef4a2381b6d3ac692315f5 in term 0.
I20260807 08:40:24.581015 17340 raft_consensus.cc:2454] T baac687c78434494b99bf9531bd76695 P 2c48c3311f0040b59f1f324488d189a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdbc65865eef4a2381b6d3ac692315f5 in term 0.
I20260807 08:40:24.581311 17419 leader_election.cc:302] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f537e96b001420fb83f81a5ddb2a6a0, cdbc65865eef4a2381b6d3ac692315f5; no voters:
I20260807 08:40:24.581533 17757 raft_consensus.cc:2781] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:40:24.581583 17757 raft_consensus.cc:482] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:40:24.581606 17757 raft_consensus.cc:3037] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:24.582679 17757 raft_consensus.cc:504] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.582998 17757 leader_election.cc:288] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5 [CANDIDATE]: Term 1 election: Requested vote from peers 2c48c3311f0040b59f1f324488d189a1 (127.8.208.193:41709), 1f537e96b001420fb83f81a5ddb2a6a0 (127.8.208.195:40893)
I20260807 08:40:24.583273 17644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baac687c78434494b99bf9531bd76695" candidate_uuid: "cdbc65865eef4a2381b6d3ac692315f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f537e96b001420fb83f81a5ddb2a6a0"
I20260807 08:40:24.583282 17340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baac687c78434494b99bf9531bd76695" candidate_uuid: "cdbc65865eef4a2381b6d3ac692315f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c48c3311f0040b59f1f324488d189a1"
I20260807 08:40:24.583384 17644 raft_consensus.cc:3037] T baac687c78434494b99bf9531bd76695 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:24.583396 17340 raft_consensus.cc:3037] T baac687c78434494b99bf9531bd76695 P 2c48c3311f0040b59f1f324488d189a1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:24.584283 17644 raft_consensus.cc:2454] T baac687c78434494b99bf9531bd76695 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdbc65865eef4a2381b6d3ac692315f5 in term 1.
I20260807 08:40:24.584407 17340 raft_consensus.cc:2454] T baac687c78434494b99bf9531bd76695 P 2c48c3311f0040b59f1f324488d189a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdbc65865eef4a2381b6d3ac692315f5 in term 1.
I20260807 08:40:24.584556 17419 leader_election.cc:302] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f537e96b001420fb83f81a5ddb2a6a0, cdbc65865eef4a2381b6d3ac692315f5; no voters:
I20260807 08:40:24.584717 17757 raft_consensus.cc:2781] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:24.584802 17757 raft_consensus.cc:686] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5 [term 1 LEADER]: Becoming Leader. State: Replica: cdbc65865eef4a2381b6d3ac692315f5, State: Running, Role: LEADER
I20260807 08:40:24.584929 17757 consensus_queue.cc:237] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.586565 17166 catalog_manager.cc:5495] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to cdbc65865eef4a2381b6d3ac692315f5 (127.8.208.194). New cstate: current_term: 1 leader_uuid: "cdbc65865eef4a2381b6d3ac692315f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } health_report { overall_health: UNKNOWN } } }
I20260807 08:40:24.663691 17784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:24.660260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34300 (local address 127.8.208.194:42239)
0807 08:40:24.660411 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:24.660416 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:24.660476 (+ 60us) server_negotiation.cc:407] Connection header received
0807 08:40:24.660633 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:24.660637 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:24.660686 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:24.660766 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:40:24.661048 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.661547 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.662526 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.662782 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.662904 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:24.663192 (+ 288us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:40:24.663274 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:40:24.663373 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:24.663468 (+ 95us) server_negotiation.cc:299] Negotiation successful
0807 08:40:24.663537 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 08:40:24.665594 17340 raft_consensus.cc:1261] T baac687c78434494b99bf9531bd76695 P 2c48c3311f0040b59f1f324488d189a1 [term 1 FOLLOWER]: Refusing update from remote peer cdbc65865eef4a2381b6d3ac692315f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:40:24.665630 17644 raft_consensus.cc:1261] T baac687c78434494b99bf9531bd76695 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 1 FOLLOWER]: Refusing update from remote peer cdbc65865eef4a2381b6d3ac692315f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:40:24.666086 17733 consensus_queue.cc:1035] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:40:24.666283 17757 consensus_queue.cc:1035] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:40:24.673307 17169 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:40:24.673436 17169 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:40:24.675225 17169 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c: Sending DeleteTablet for 3 replicas of tablet baac687c78434494b99bf9531bd76695
I20260807 08:40:24.675770 17316 tablet_service.cc:1514] Processing DeleteTablet for tablet baac687c78434494b99bf9531bd76695 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:24 UTC) from {username='oryx', principal='oryx/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:43356
I20260807 08:40:24.675822 17470 tablet_service.cc:1514] Processing DeleteTablet for tablet baac687c78434494b99bf9531bd76695 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:24 UTC) from {username='oryx', principal='oryx/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:58120
I20260807 08:40:24.675984 17798 tablet_replica.cc:330] T baac687c78434494b99bf9531bd76695 P 2c48c3311f0040b59f1f324488d189a1: stopping tablet replica
I20260807 08:40:24.676105 17798 raft_consensus.cc:2229] T baac687c78434494b99bf9531bd76695 P 2c48c3311f0040b59f1f324488d189a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:40:24.676278 17798 raft_consensus.cc:2258] T baac687c78434494b99bf9531bd76695 P 2c48c3311f0040b59f1f324488d189a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:24.676448 17800 tablet_replica.cc:330] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5: stopping tablet replica
I20260807 08:40:24.676532 17800 raft_consensus.cc:2229] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5 [term 1 LEADER]: Raft consensus shutting down.
I20260807 08:40:24.676644 17800 raft_consensus.cc:2258] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:24.676543 17169 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51224:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 08:40:24.676965 17169 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:40:24.677407 17800 ts_tablet_manager.cc:1905] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:24.678236 17798 ts_tablet_manager.cc:1905] T baac687c78434494b99bf9531bd76695 P 2c48c3311f0040b59f1f324488d189a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:24.679844 17800 ts_tablet_manager.cc:1918] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:40:24.679916 17800 log.cc:1196] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-1/wal/wals/baac687c78434494b99bf9531bd76695
I20260807 08:40:24.679919 17620 tablet_service.cc:1514] Processing DeleteTablet for tablet baac687c78434494b99bf9531bd76695 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:24 UTC) from {username='oryx', principal='oryx/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:42098
I20260807 08:40:24.680083 17799 tablet_replica.cc:330] T baac687c78434494b99bf9531bd76695 P 1f537e96b001420fb83f81a5ddb2a6a0: stopping tablet replica
I20260807 08:40:24.680154 17800 ts_tablet_manager.cc:1939] T baac687c78434494b99bf9531bd76695 P cdbc65865eef4a2381b6d3ac692315f5: Deleting consensus metadata
I20260807 08:40:24.680187 17799 raft_consensus.cc:2229] T baac687c78434494b99bf9531bd76695 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:40:24.680303 17799 raft_consensus.cc:2258] T baac687c78434494b99bf9531bd76695 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:24.680737 17798 ts_tablet_manager.cc:1918] T baac687c78434494b99bf9531bd76695 P 2c48c3311f0040b59f1f324488d189a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:40:24.680821 17798 log.cc:1196] T baac687c78434494b99bf9531bd76695 P 2c48c3311f0040b59f1f324488d189a1: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-0/wal/wals/baac687c78434494b99bf9531bd76695
I20260807 08:40:24.681077 17798 ts_tablet_manager.cc:1939] T baac687c78434494b99bf9531bd76695 P 2c48c3311f0040b59f1f324488d189a1: Deleting consensus metadata
I20260807 08:40:24.681180 17799 ts_tablet_manager.cc:1905] T baac687c78434494b99bf9531bd76695 P 1f537e96b001420fb83f81a5ddb2a6a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:24.681609 17152 catalog_manager.cc:4841] TS cdbc65865eef4a2381b6d3ac692315f5 (127.8.208.194:42239): tablet baac687c78434494b99bf9531bd76695 (table test-table [id=cdc8f3a25e27464a80b32dbf6599e909]) successfully deleted
I20260807 08:40:24.681867 17152 catalog_manager.cc:4841] TS 2c48c3311f0040b59f1f324488d189a1 (127.8.208.193:41709): tablet baac687c78434494b99bf9531bd76695 (table test-table [id=cdc8f3a25e27464a80b32dbf6599e909]) successfully deleted
I20260807 08:40:24.683210 17316 tablet_service.cc:1467] Processing CreateTablet for tablet 177f4a66e78c4f9c99c966637b8a4755 (DEFAULT_TABLE table=test-table [id=5e4d40a3591b4dcb9d075f66b9f532f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:24.683322 17470 tablet_service.cc:1467] Processing CreateTablet for tablet 177f4a66e78c4f9c99c966637b8a4755 (DEFAULT_TABLE table=test-table [id=5e4d40a3591b4dcb9d075f66b9f532f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:24.683497 17316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 177f4a66e78c4f9c99c966637b8a4755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:24.683552 17470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 177f4a66e78c4f9c99c966637b8a4755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:24.683516 17620 tablet_service.cc:1467] Processing CreateTablet for tablet 177f4a66e78c4f9c99c966637b8a4755 (DEFAULT_TABLE table=test-table [id=5e4d40a3591b4dcb9d075f66b9f532f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:24.683596 17799 ts_tablet_manager.cc:1918] T baac687c78434494b99bf9531bd76695 P 1f537e96b001420fb83f81a5ddb2a6a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:40:24.683665 17799 log.cc:1196] T baac687c78434494b99bf9531bd76695 P 1f537e96b001420fb83f81a5ddb2a6a0: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/baac687c78434494b99bf9531bd76695
I20260807 08:40:24.683717 17620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 177f4a66e78c4f9c99c966637b8a4755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:24.683938 17799 ts_tablet_manager.cc:1939] T baac687c78434494b99bf9531bd76695 P 1f537e96b001420fb83f81a5ddb2a6a0: Deleting consensus metadata
I20260807 08:40:24.685640 17726 tablet_bootstrap.cc:492] T 177f4a66e78c4f9c99c966637b8a4755 P 2c48c3311f0040b59f1f324488d189a1: Bootstrap starting.
I20260807 08:40:24.685905 17725 tablet_bootstrap.cc:492] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0: Bootstrap starting.
I20260807 08:40:24.685910 17154 catalog_manager.cc:4841] TS 1f537e96b001420fb83f81a5ddb2a6a0 (127.8.208.195:40893): tablet baac687c78434494b99bf9531bd76695 (table test-table [id=cdc8f3a25e27464a80b32dbf6599e909]) successfully deleted
I20260807 08:40:24.686556 17725 tablet_bootstrap.cc:654] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:24.686662 17726 tablet_bootstrap.cc:654] T 177f4a66e78c4f9c99c966637b8a4755 P 2c48c3311f0040b59f1f324488d189a1: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:24.687160 17727 tablet_bootstrap.cc:492] T 177f4a66e78c4f9c99c966637b8a4755 P cdbc65865eef4a2381b6d3ac692315f5: Bootstrap starting.
I20260807 08:40:24.687577 17725 tablet_bootstrap.cc:492] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0: No bootstrap required, opened a new log
I20260807 08:40:24.687651 17725 ts_tablet_manager.cc:1397] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 08:40:24.687816 17727 tablet_bootstrap.cc:654] T 177f4a66e78c4f9c99c966637b8a4755 P cdbc65865eef4a2381b6d3ac692315f5: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:24.687959 17725 raft_consensus.cc:348] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.688035 17725 raft_consensus.cc:374] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:24.688056 17725 raft_consensus.cc:729] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f537e96b001420fb83f81a5ddb2a6a0, State: Initialized, Role: FOLLOWER
I20260807 08:40:24.688187 17725 consensus_queue.cc:260] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.688503 17725 ts_tablet_manager.cc:1428] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 08:40:24.688787 17727 tablet_bootstrap.cc:492] T 177f4a66e78c4f9c99c966637b8a4755 P cdbc65865eef4a2381b6d3ac692315f5: No bootstrap required, opened a new log
I20260807 08:40:24.688867 17727 ts_tablet_manager.cc:1397] T 177f4a66e78c4f9c99c966637b8a4755 P cdbc65865eef4a2381b6d3ac692315f5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 08:40:24.689294 17727 raft_consensus.cc:348] T 177f4a66e78c4f9c99c966637b8a4755 P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.689385 17727 raft_consensus.cc:374] T 177f4a66e78c4f9c99c966637b8a4755 P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:24.689415 17727 raft_consensus.cc:729] T 177f4a66e78c4f9c99c966637b8a4755 P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdbc65865eef4a2381b6d3ac692315f5, State: Initialized, Role: FOLLOWER
I20260807 08:40:24.689527 17727 consensus_queue.cc:260] T 177f4a66e78c4f9c99c966637b8a4755 P cdbc65865eef4a2381b6d3ac692315f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.689788 17727 ts_tablet_manager.cc:1428] T 177f4a66e78c4f9c99c966637b8a4755 P cdbc65865eef4a2381b6d3ac692315f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 08:40:24.690272 17726 tablet_bootstrap.cc:492] T 177f4a66e78c4f9c99c966637b8a4755 P 2c48c3311f0040b59f1f324488d189a1: No bootstrap required, opened a new log
I20260807 08:40:24.690354 17726 ts_tablet_manager.cc:1397] T 177f4a66e78c4f9c99c966637b8a4755 P 2c48c3311f0040b59f1f324488d189a1: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260807 08:40:24.690770 17726 raft_consensus.cc:348] T 177f4a66e78c4f9c99c966637b8a4755 P 2c48c3311f0040b59f1f324488d189a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.690864 17726 raft_consensus.cc:374] T 177f4a66e78c4f9c99c966637b8a4755 P 2c48c3311f0040b59f1f324488d189a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:24.690884 17726 raft_consensus.cc:729] T 177f4a66e78c4f9c99c966637b8a4755 P 2c48c3311f0040b59f1f324488d189a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c48c3311f0040b59f1f324488d189a1, State: Initialized, Role: FOLLOWER
I20260807 08:40:24.690999 17726 consensus_queue.cc:260] T 177f4a66e78c4f9c99c966637b8a4755 P 2c48c3311f0040b59f1f324488d189a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.691236 17726 ts_tablet_manager.cc:1428] T 177f4a66e78c4f9c99c966637b8a4755 P 2c48c3311f0040b59f1f324488d189a1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 08:40:24.761094 17790 raft_consensus.cc:482] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:40:24.761199 17790 raft_consensus.cc:504] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.761555 17790 leader_election.cc:288] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c48c3311f0040b59f1f324488d189a1 (127.8.208.193:41709), cdbc65865eef4a2381b6d3ac692315f5 (127.8.208.194:42239)
I20260807 08:40:24.761909 17340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "177f4a66e78c4f9c99c966637b8a4755" candidate_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c48c3311f0040b59f1f324488d189a1" is_pre_election: true
I20260807 08:40:24.762089 17340 raft_consensus.cc:2454] T 177f4a66e78c4f9c99c966637b8a4755 P 2c48c3311f0040b59f1f324488d189a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f537e96b001420fb83f81a5ddb2a6a0 in term 0.
I20260807 08:40:24.762086 17494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "177f4a66e78c4f9c99c966637b8a4755" candidate_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdbc65865eef4a2381b6d3ac692315f5" is_pre_election: true
I20260807 08:40:24.762261 17494 raft_consensus.cc:2454] T 177f4a66e78c4f9c99c966637b8a4755 P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f537e96b001420fb83f81a5ddb2a6a0 in term 0.
I20260807 08:40:24.762368 17572 leader_election.cc:302] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f537e96b001420fb83f81a5ddb2a6a0, 2c48c3311f0040b59f1f324488d189a1; no voters:
I20260807 08:40:24.762565 17790 raft_consensus.cc:2781] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:40:24.762647 17790 raft_consensus.cc:482] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:40:24.762698 17790 raft_consensus.cc:3037] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:24.763716 17790 raft_consensus.cc:504] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.764032 17790 leader_election.cc:288] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0 [CANDIDATE]: Term 1 election: Requested vote from peers 2c48c3311f0040b59f1f324488d189a1 (127.8.208.193:41709), cdbc65865eef4a2381b6d3ac692315f5 (127.8.208.194:42239)
I20260807 08:40:24.764351 17340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "177f4a66e78c4f9c99c966637b8a4755" candidate_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c48c3311f0040b59f1f324488d189a1"
I20260807 08:40:24.764479 17340 raft_consensus.cc:3037] T 177f4a66e78c4f9c99c966637b8a4755 P 2c48c3311f0040b59f1f324488d189a1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:24.764442 17494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "177f4a66e78c4f9c99c966637b8a4755" candidate_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdbc65865eef4a2381b6d3ac692315f5"
I20260807 08:40:24.764556 17494 raft_consensus.cc:3037] T 177f4a66e78c4f9c99c966637b8a4755 P cdbc65865eef4a2381b6d3ac692315f5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:24.765292 17340 raft_consensus.cc:2454] T 177f4a66e78c4f9c99c966637b8a4755 P 2c48c3311f0040b59f1f324488d189a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f537e96b001420fb83f81a5ddb2a6a0 in term 1.
I20260807 08:40:24.765440 17494 raft_consensus.cc:2454] T 177f4a66e78c4f9c99c966637b8a4755 P cdbc65865eef4a2381b6d3ac692315f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f537e96b001420fb83f81a5ddb2a6a0 in term 1.
I20260807 08:40:24.765555 17572 leader_election.cc:302] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f537e96b001420fb83f81a5ddb2a6a0, 2c48c3311f0040b59f1f324488d189a1; no voters:
I20260807 08:40:24.765766 17790 raft_consensus.cc:2781] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:24.765964 17790 raft_consensus.cc:686] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 1 LEADER]: Becoming Leader. State: Replica: 1f537e96b001420fb83f81a5ddb2a6a0, State: Running, Role: LEADER
I20260807 08:40:24.766106 17790 consensus_queue.cc:237] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } }
I20260807 08:40:24.767737 17169 catalog_manager.cc:5495] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f537e96b001420fb83f81a5ddb2a6a0 (127.8.208.195). New cstate: current_term: 1 leader_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f537e96b001420fb83f81a5ddb2a6a0" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40893 } health_report { overall_health: HEALTHY } } }
I20260807 08:40:24.797734 17829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:24.794745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41906 (local address 127.8.208.195:40893)
0807 08:40:24.794958 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:24.794962 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:24.794975 (+ 13us) server_negotiation.cc:407] Connection header received
0807 08:40:24.795059 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:24.795061 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:24.795109 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:24.795174 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:40:24.795378 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.795835 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.796719 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.797016 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.797096 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:24.797322 (+ 226us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:40:24.797396 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:40:24.797446 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:24.797519 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 08:40:24.797558 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":70,"threads_started":1}
I20260807 08:40:24.804738 17829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:24.802293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:40041 (local address 127.8.208.195:40893)
0807 08:40:24.802388 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:24.802391 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:24.802541 (+ 150us) server_negotiation.cc:407] Connection header received
0807 08:40:24.802603 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:24.802605 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:24.802637 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:24.802688 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:40:24.802879 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.803264 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.803904 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.804094 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.804159 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:24.804402 (+ 243us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:40:24.804454 (+ 52us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:40:24.804505 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:24.804581 (+ 76us) server_negotiation.cc:299] Negotiation successful
0807 08:40:24.804617 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":42}
I20260807 08:40:24.804754 17832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:24.802213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:40893 (local address 127.8.208.195:40041)
0807 08:40:24.802470 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:24.802481 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:24.802552 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:24.802707 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:24.802709 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:24.802714 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 08:40:24.802801 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:24.802804 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.803336 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.803338 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:24.803820 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:24.803826 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:24.804199 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:24.804202 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:24.804277 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:24.804300 (+ 23us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 08:40:24.804523 (+ 223us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 08:40:24.804528 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 08:40:24.804574 (+ 46us) client_negotiation.cc:240] Negotiation successful
0807 08:40:24.804636 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":12,"thread_start_us":72,"threads_started":1}
I20260807 08:40:24.810606 17340 raft_consensus.cc:1261] T 177f4a66e78c4f9c99c966637b8a4755 P 2c48c3311f0040b59f1f324488d189a1 [term 1 FOLLOWER]: Refusing update from remote peer 1f537e96b001420fb83f81a5ddb2a6a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:40:24.810618 17494 raft_consensus.cc:1261] T 177f4a66e78c4f9c99c966637b8a4755 P cdbc65865eef4a2381b6d3ac692315f5 [term 1 FOLLOWER]: Refusing update from remote peer 1f537e96b001420fb83f81a5ddb2a6a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:40:24.810966 17828 consensus_queue.cc:1035] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdbc65865eef4a2381b6d3ac692315f5" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:40:24.811101 17825 consensus_queue.cc:1035] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c48c3311f0040b59f1f324488d189a1" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 41709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:40:24.840418 17169 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:40:24.840559 17169 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:40:24.842344 17169 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 73cb4cfd17f640238ced4e76202e128c: Sending DeleteTablet for 3 replicas of tablet 177f4a66e78c4f9c99c966637b8a4755
I20260807 08:40:24.842916 17470 tablet_service.cc:1514] Processing DeleteTablet for tablet 177f4a66e78c4f9c99c966637b8a4755 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:24 UTC) from {username='oryx', principal='oryx/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:58120
I20260807 08:40:24.842944 17316 tablet_service.cc:1514] Processing DeleteTablet for tablet 177f4a66e78c4f9c99c966637b8a4755 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:24 UTC) from {username='oryx', principal='oryx/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:43356
I20260807 08:40:24.843117 17798 tablet_replica.cc:330] T 177f4a66e78c4f9c99c966637b8a4755 P 2c48c3311f0040b59f1f324488d189a1: stopping tablet replica
I20260807 08:40:24.843114 17800 tablet_replica.cc:330] T 177f4a66e78c4f9c99c966637b8a4755 P cdbc65865eef4a2381b6d3ac692315f5: stopping tablet replica
I20260807 08:40:24.843228 17800 raft_consensus.cc:2229] T 177f4a66e78c4f9c99c966637b8a4755 P cdbc65865eef4a2381b6d3ac692315f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:40:24.843240 17798 raft_consensus.cc:2229] T 177f4a66e78c4f9c99c966637b8a4755 P 2c48c3311f0040b59f1f324488d189a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:40:24.843369 17800 raft_consensus.cc:2258] T 177f4a66e78c4f9c99c966637b8a4755 P cdbc65865eef4a2381b6d3ac692315f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:24.843369 17798 raft_consensus.cc:2258] T 177f4a66e78c4f9c99c966637b8a4755 P 2c48c3311f0040b59f1f324488d189a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:24.843850 17620 tablet_service.cc:1514] Processing DeleteTablet for tablet 177f4a66e78c4f9c99c966637b8a4755 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:24 UTC) from {username='oryx', principal='oryx/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:42098
I20260807 08:40:24.844018 17799 tablet_replica.cc:330] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0: stopping tablet replica
I20260807 08:40:24.844067 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 17246
I20260807 08:40:24.844098 17800 ts_tablet_manager.cc:1905] T 177f4a66e78c4f9c99c966637b8a4755 P cdbc65865eef4a2381b6d3ac692315f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:24.844130 17799 raft_consensus.cc:2229] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 1 LEADER]: Raft consensus shutting down.
I20260807 08:40:24.844276 17799 raft_consensus.cc:2258] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:24.844353 17798 ts_tablet_manager.cc:1905] T 177f4a66e78c4f9c99c966637b8a4755 P 2c48c3311f0040b59f1f324488d189a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:24.846726 17799 ts_tablet_manager.cc:1905] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:24.846838 17800 ts_tablet_manager.cc:1918] T 177f4a66e78c4f9c99c966637b8a4755 P cdbc65865eef4a2381b6d3ac692315f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 08:40:24.846901 17800 log.cc:1196] T 177f4a66e78c4f9c99c966637b8a4755 P cdbc65865eef4a2381b6d3ac692315f5: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-1/wal/wals/177f4a66e78c4f9c99c966637b8a4755
I20260807 08:40:24.847170 17800 ts_tablet_manager.cc:1939] T 177f4a66e78c4f9c99c966637b8a4755 P cdbc65865eef4a2381b6d3ac692315f5: Deleting consensus metadata
I20260807 08:40:24.847775 17152 catalog_manager.cc:4841] TS cdbc65865eef4a2381b6d3ac692315f5 (127.8.208.194:42239): tablet 177f4a66e78c4f9c99c966637b8a4755 (table test-table [id=5e4d40a3591b4dcb9d075f66b9f532f0]) successfully deleted
I20260807 08:40:24.849942 17799 ts_tablet_manager.cc:1918] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 08:40:24.850026 17799 log.cc:1196] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/177f4a66e78c4f9c99c966637b8a4755
I20260807 08:40:24.850329 17799 ts_tablet_manager.cc:1939] T 177f4a66e78c4f9c99c966637b8a4755 P 1f537e96b001420fb83f81a5ddb2a6a0: Deleting consensus metadata
I20260807 08:40:24.850931 17154 catalog_manager.cc:4841] TS 1f537e96b001420fb83f81a5ddb2a6a0 (127.8.208.195:40893): tablet 177f4a66e78c4f9c99c966637b8a4755 (table test-table [id=5e4d40a3591b4dcb9d075f66b9f532f0]) successfully deleted
W20260807 08:40:24.856158 17152 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.208.193:41709 (error 108)
I20260807 08:40:24.856884 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 17399
I20260807 08:40:24.858057 17838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:24.856862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:41709 (local address 127.0.0.1:44540)
0807 08:40:24.857817 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:24.857933 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.193:41709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":867,"thread_start_us":70,"threads_started":1}
W20260807 08:40:24.858853 17152 catalog_manager.cc:4584] TS 2c48c3311f0040b59f1f324488d189a1 (127.8.208.193:41709): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 177f4a66e78c4f9c99c966637b8a4755: Network error: Client connection negotiation failed: client connection to 127.8.208.193:41709: connect: Connection refused (error 111)
I20260807 08:40:24.864303 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 17554
I20260807 08:40:24.872062 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 17136
2026-08-07T08:40:24Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3409 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:40:24 dist-test-slave-6nmv krb5kdc[17841](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:40:24 dist-test-slave-6nmv krb5kdc[17841](info): set up 2 sockets
Aug 07 08:40:24 dist-test-slave-6nmv krb5kdc[17841](info): commencing operation
krb5kdc: starting...
W20260807 08:40:25.859513 9027 mini_kdc.cc:121] Time spent starting KDC: real 0.964s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:40:25 dist-test-slave-6nmv krb5kdc[17841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092025, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:40:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:40:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:40:25.968803 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:43577
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:38627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:43577
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:26.067073 17855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:26.067291 17855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:26.067327 17855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:26.070789 17855 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:40:26.070830 17855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:26.070848 17855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:26.070863 17855 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:40:26.070883 17855 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:40:26.075582 17855 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:38627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:43577
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:43577
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:26.076398 17855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:26.077234 17855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:26.084697 17861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:26.084667 17863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:26.084666 17860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:26.084774 17855 server_base.cc:1034] running on GCE node
I20260807 08:40:26.085400 17855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:26.086388 17855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:26.087584 17855 hybrid_clock.cc:648] HybridClock initialized: now 1786092026087566 us; error 42 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-07T08:40:26Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1221 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:40:26 dist-test-slave-6nmv krb5kdc[17868](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:40:26 dist-test-slave-6nmv krb5kdc[17868](info): set up 2 sockets
Aug 07 08:40:26 dist-test-slave-6nmv krb5kdc[17868](info): commencing operation
krb5kdc: starting...
W20260807 08:40:27.106510 9027 mini_kdc.cc:121] Time spent starting KDC: real 0.989s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:40:27 dist-test-slave-6nmv krb5kdc[17868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:40:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:40:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:40:27.218640 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:42413
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:42413
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:27.319554 17882 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:27.319778 17882 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:27.319813 17882 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:27.323057 17882 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:40:27.323096 17882 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:27.323112 17882 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:27.323124 17882 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:40:27.323136 17882 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:40:27.327921 17882 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:42413
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:42413
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17882
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:27.328742 17882 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:27.329574 17882 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:27.337293 17888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:27.337294 17890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:27.337498 17882 server_base.cc:1034] running on GCE node
W20260807 08:40:27.337322 17887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:27.338203 17882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:27.339102 17882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:27.340251 17882 hybrid_clock.cc:648] HybridClock initialized: now 1786092027340226 us; error 39 us; skew 500 ppm
Aug 07 08:40:27 dist-test-slave-6nmv krb5kdc[17868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092027, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:27.348812 17882 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:40:27.349625 17882 webserver.cc:460] Webserver started at http://127.8.208.254:44593/ using document root <none> and password file <none>
I20260807 08:40:27.350162 17882 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:27.350224 17882 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:27.350373 17882 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:27.352252 17882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "609340ea53b348f68344e9f179a0aae6"
format_stamp: "Formatted at 2026-08-07 08:40:27 on dist-test-slave-6nmv"
server_key: "c500ef0e516f5880d8d83ad7b441e0ac"
server_key_iv: "06ff717e67f97c9dbd4b370574d56783"
server_key_version: "encryptionkey@0"
I20260807 08:40:27.352751 17882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "609340ea53b348f68344e9f179a0aae6"
format_stamp: "Formatted at 2026-08-07 08:40:27 on dist-test-slave-6nmv"
server_key: "c500ef0e516f5880d8d83ad7b441e0ac"
server_key_iv: "06ff717e67f97c9dbd4b370574d56783"
server_key_version: "encryptionkey@0"
I20260807 08:40:27.356087 17882 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 08:40:27.358282 17897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:27.359385 17882 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:40:27.359529 17882 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "609340ea53b348f68344e9f179a0aae6"
format_stamp: "Formatted at 2026-08-07 08:40:27 on dist-test-slave-6nmv"
server_key: "c500ef0e516f5880d8d83ad7b441e0ac"
server_key_iv: "06ff717e67f97c9dbd4b370574d56783"
server_key_version: "encryptionkey@0"
I20260807 08:40:27.359633 17882 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:27.384268 17882 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:27.386978 17882 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:27.387173 17882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:27.393748 17882 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:42413
I20260807 08:40:27.393762 17951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:42413 every 8 connection(s)
I20260807 08:40:27.394624 17882 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:40:27.397161 17952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:27.401937 17952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6: Bootstrap starting.
I20260807 08:40:27.403836 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 17882
I20260807 08:40:27.403954 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:40:27.404260 9027 external_mini_cluster.cc:1428] Setting key ef2ac5247b4572aaf2f210fd9e6bca86
I20260807 08:40:27.404314 17952 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:27.405104 17952 log.cc:824] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:27.407156 17952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6: No bootstrap required, opened a new log
I20260807 08:40:27.411190 17952 raft_consensus.cc:348] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "609340ea53b348f68344e9f179a0aae6" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 42413 } }
I20260807 08:40:27.411463 17952 raft_consensus.cc:374] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:27.411580 17952 raft_consensus.cc:729] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 609340ea53b348f68344e9f179a0aae6, State: Initialized, Role: FOLLOWER
I20260807 08:40:27.411998 17952 consensus_queue.cc:260] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "609340ea53b348f68344e9f179a0aae6" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 42413 } }
I20260807 08:40:27.412113 17952 raft_consensus.cc:388] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:40:27.412196 17952 raft_consensus.cc:482] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:40:27.412290 17952 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [term 0 FOLLOWER]: Advancing to term 1
Aug 07 08:40:27 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:27.413142 17952 raft_consensus.cc:504] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "609340ea53b348f68344e9f179a0aae6" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 42413 } }
I20260807 08:40:27.413473 17952 leader_election.cc:302] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 609340ea53b348f68344e9f179a0aae6; no voters:
I20260807 08:40:27.413775 17952 leader_election.cc:288] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:40:27.413868 17957 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:27.414086 17957 raft_consensus.cc:686] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [term 1 LEADER]: Becoming Leader. State: Replica: 609340ea53b348f68344e9f179a0aae6, State: Running, Role: LEADER
I20260807 08:40:27.414434 17957 consensus_queue.cc:237] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "609340ea53b348f68344e9f179a0aae6" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 42413 } }
I20260807 08:40:27.415027 17952 sys_catalog.cc:564] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:40:27.415956 17961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 609340ea53b348f68344e9f179a0aae6. Latest consensus state: current_term: 1 leader_uuid: "609340ea53b348f68344e9f179a0aae6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "609340ea53b348f68344e9f179a0aae6" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 42413 } } }
I20260807 08:40:27.416072 17961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:27.416494 17959 sys_catalog.cc:455] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "609340ea53b348f68344e9f179a0aae6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "609340ea53b348f68344e9f179a0aae6" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 42413 } } }
I20260807 08:40:27.416657 17959 sys_catalog.cc:458] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:27.418716 17956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:27.405262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58776 (local address 127.8.208.254:42413)
0807 08:40:27.405599 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:27.405611 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:27.405639 (+ 28us) server_negotiation.cc:407] Connection header received
0807 08:40:27.406401 (+ 762us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:27.406421 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:27.406786 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:27.407129 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:27.407861 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:27.409182 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:27.410057 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:27.410729 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:27.410879 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:27.413523 (+ 2644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:27.413528 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:27.413553 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:27.413580 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:27.415543 (+ 1963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:27.416070 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:27.416075 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:27.416080 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:27.416213 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:27.416556 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:27.416560 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:27.416562 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:27.417092 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:27.417308 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:27.417627 (+ 319us) server_negotiation.cc:299] Negotiation successful
0807 08:40:27.417935 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":128,"threads_started":1}
W20260807 08:40:27.420387 17975 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:40:27.420467 17975 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:40:27.420537 17968 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:40:27.421124 17968 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:40:27.425866 17968 catalog_manager.cc:1347] Generated new cluster ID: ce02802edb0b43df9042b0666705794f
I20260807 08:40:27.425938 17968 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:40:27.440104 17968 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:40:27.440847 17968 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:40:27.452397 17968 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6: Generated new TSK 0
I20260807 08:40:27.453033 17968 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.208.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
I20260807 08:40:27.482823 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:42413
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:27.584193 17981 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:27.584395 17981 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:27.584453 17981 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:27.588114 17981 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:27.588155 17981 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:27.588200 17981 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:40:27.592631 17981 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:42413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17981
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:27.593380 17981 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:27.594210 17981 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:27.602613 17986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:27.602628 17987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:27.602749 17981 server_base.cc:1034] running on GCE node
W20260807 08:40:27.602842 17989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:27.603250 17981 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:27.603786 17981 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:27.604971 17981 hybrid_clock.cc:648] HybridClock initialized: now 1786092027604956 us; error 26 us; skew 500 ppm
Aug 07 08:40:27 dist-test-slave-6nmv krb5kdc[17868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092027, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:27.607789 17981 init.cc:377] Logged in from keytab as kudu/127.8.208.193@KRBTEST.COM (short username kudu)
I20260807 08:40:27.608439 17981 webserver.cc:460] Webserver started at http://127.8.208.193:44153/ using document root <none> and password file <none>
I20260807 08:40:27.608855 17981 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:27.608901 17981 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:27.609041 17981 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:27.610698 17981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "e555176b605d4f52b26bc66ccb4a73af"
format_stamp: "Formatted at 2026-08-07 08:40:27 on dist-test-slave-6nmv"
server_key: "d507f5a3df83e13d6aeecafb9f9b7309"
server_key_iv: "075bba133573b9fda45fa00f1489bd35"
server_key_version: "encryptionkey@0"
I20260807 08:40:27.611179 17981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "e555176b605d4f52b26bc66ccb4a73af"
format_stamp: "Formatted at 2026-08-07 08:40:27 on dist-test-slave-6nmv"
server_key: "d507f5a3df83e13d6aeecafb9f9b7309"
server_key_iv: "075bba133573b9fda45fa00f1489bd35"
server_key_version: "encryptionkey@0"
I20260807 08:40:27.614370 17981 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 08:40:27.616503 17996 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:27.617679 17981 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:27.617774 17981 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "e555176b605d4f52b26bc66ccb4a73af"
format_stamp: "Formatted at 2026-08-07 08:40:27 on dist-test-slave-6nmv"
server_key: "d507f5a3df83e13d6aeecafb9f9b7309"
server_key_iv: "075bba133573b9fda45fa00f1489bd35"
server_key_version: "encryptionkey@0"
I20260807 08:40:27.617892 17981 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:27.628057 17981 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:27.630803 17981 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:27.630923 17981 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:27.631327 17981 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:27.632004 17981 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:27.632048 17981 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:27.632082 17981 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:27.632103 17981 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:27.640173 17981 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:46209
I20260807 08:40:27.640220 18115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:46209 every 8 connection(s)
I20260807 08:40:27.640914 17981 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:40:27.648025 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 17981
I20260807 08:40:27.648157 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
I20260807 08:40:27.648485 9027 external_mini_cluster.cc:1428] Setting key ff2ddf89f5a9cb1740c4e0d1b5b15923
Aug 07 08:40:27 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092027, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:27.653393 17956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:27.642362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:39273 (local address 127.8.208.254:42413)
0807 08:40:27.642502 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:27.642506 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:27.643182 (+ 676us) server_negotiation.cc:407] Connection header received
0807 08:40:27.644223 (+ 1041us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:27.644225 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:27.644270 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:27.644336 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:27.645317 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:27.645798 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:27.646786 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:27.647017 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:27.647090 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:27.649372 (+ 2282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:27.649376 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:27.649379 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:27.649407 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:27.651452 (+ 2045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:27.652029 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:27.652032 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:27.652033 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:27.652106 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:27.652458 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:27.652460 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:27.652461 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:27.652603 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:27.652671 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:27.653206 (+ 535us) server_negotiation.cc:299] Negotiation successful
0807 08:40:27.653291 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 08:40:27.654323 18118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:27.642670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.193:39273)
0807 08:40:27.643035 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:27.643070 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:27.644058 (+ 988us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:27.644473 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:27.644479 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:27.644776 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:27.645202 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:27.645213 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:27.645906 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:27.645908 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:27.646687 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:27.646694 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:27.647135 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:27.647137 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:27.647262 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:27.647740 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:27.647753 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:27.649243 (+ 1490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:27.651578 (+ 2335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:27.651582 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:27.651591 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:27.651933 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:27.652193 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:27.652197 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:27.652200 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:27.652363 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:27.652695 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:27.652700 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:27.652995 (+ 295us) client_negotiation.cc:769] Sending connection context
0807 08:40:27.653173 (+ 178us) client_negotiation.cc:240] Negotiation successful
0807 08:40:27.653450 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":90,"threads_started":1}
I20260807 08:40:27.655305 18116 heartbeater.cc:347] Connected to a master server at 127.8.208.254:42413
I20260807 08:40:27.655514 18116 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:27.655918 18116 heartbeater.cc:511] Master 127.8.208.254:42413 requested a full tablet report, sending...
I20260807 08:40:27.657254 17915 ts_manager.cc:194] Registered new tserver with Master: e555176b605d4f52b26bc66ccb4a73af (127.8.208.193:46209)
I20260807 08:40:27.658304 17915 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.193@KRBTEST.COM'} at 127.8.208.193:39273
WARNING: no policy specified for kudu/127.8.208.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
I20260807 08:40:27.674394 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:42413
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:27.773281 18121 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:27.773535 18121 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:27.773608 18121 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:27.777169 18121 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:27.777256 18121 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:27.777352 18121 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:40:27.781968 18121 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:42413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18121
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:27.782835 18121 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:27.783718 18121 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:27.792482 18130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:27.792539 18121 server_base.cc:1034] running on GCE node
W20260807 08:40:27.792505 18132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:27.792498 18127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:27.793015 18121 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:27.793496 18121 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:27.794656 18121 hybrid_clock.cc:648] HybridClock initialized: now 1786092027794624 us; error 30 us; skew 500 ppm
Aug 07 08:40:27 dist-test-slave-6nmv krb5kdc[17868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092027, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:27.797148 18121 init.cc:377] Logged in from keytab as kudu/127.8.208.194@KRBTEST.COM (short username kudu)
I20260807 08:40:27.797899 18121 webserver.cc:460] Webserver started at http://127.8.208.194:44211/ using document root <none> and password file <none>
I20260807 08:40:27.798324 18121 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:27.798374 18121 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:27.798508 18121 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:27.800238 18121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "09ef35e399674045a89f07c0173659e3"
format_stamp: "Formatted at 2026-08-07 08:40:27 on dist-test-slave-6nmv"
server_key: "ecdc93708fe66e06ec3705921152aaf5"
server_key_iv: "b621e710f00c9aa6229d3145e34b07ff"
server_key_version: "encryptionkey@0"
I20260807 08:40:27.800693 18121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "09ef35e399674045a89f07c0173659e3"
format_stamp: "Formatted at 2026-08-07 08:40:27 on dist-test-slave-6nmv"
server_key: "ecdc93708fe66e06ec3705921152aaf5"
server_key_iv: "b621e710f00c9aa6229d3145e34b07ff"
server_key_version: "encryptionkey@0"
I20260807 08:40:27.803930 18121 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 08:40:27.806205 18140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:27.807358 18121 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:40:27.807467 18121 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "09ef35e399674045a89f07c0173659e3"
format_stamp: "Formatted at 2026-08-07 08:40:27 on dist-test-slave-6nmv"
server_key: "ecdc93708fe66e06ec3705921152aaf5"
server_key_iv: "b621e710f00c9aa6229d3145e34b07ff"
server_key_version: "encryptionkey@0"
I20260807 08:40:27.807565 18121 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:27.821525 18121 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:27.823877 18121 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:27.824074 18121 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:27.824590 18121 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:27.825353 18121 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:27.825397 18121 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:27.825457 18121 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:27.825489 18121 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:27.834283 18121 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:36105
I20260807 08:40:27.834308 18261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:36105 every 8 connection(s)
I20260807 08:40:27.835053 18121 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:40:27.839638 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 18121
I20260807 08:40:27.839782 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:40:27.840037 9027 external_mini_cluster.cc:1428] Setting key c6f6b95aa5cc442cc61d2fb83b7880df
Aug 07 08:40:27 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092027, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:27.848423 17956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:27.836726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:38127 (local address 127.8.208.254:42413)
0807 08:40:27.836885 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:27.836890 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:27.837631 (+ 741us) server_negotiation.cc:407] Connection header received
0807 08:40:27.838792 (+ 1161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:27.838795 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:27.838839 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:27.838906 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:27.840021 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:27.840659 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:27.841950 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:27.842187 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:27.842300 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:27.844844 (+ 2544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:27.844846 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:27.844848 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:27.844871 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:27.846266 (+ 1395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:27.846928 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:27.846930 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:27.846932 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:27.847007 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:27.847418 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:27.847421 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:27.847422 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:27.847602 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:27.847685 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:27.848233 (+ 548us) server_negotiation.cc:299] Negotiation successful
0807 08:40:27.848320 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 08:40:27.849434 18264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:27.837068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.194:38127)
0807 08:40:27.837486 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:27.837527 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:27.838622 (+ 1095us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:27.839047 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:27.839053 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:27.839351 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:27.839872 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:27.839892 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:27.840775 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:27.840778 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:27.841770 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:27.841780 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:27.842343 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:27.842346 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:27.842498 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:27.843007 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:27.843020 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:27.844651 (+ 1631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:27.846376 (+ 1725us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:27.846383 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:27.846397 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:27.846811 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:27.847110 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:27.847116 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:27.847120 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:27.847312 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:27.847717 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:27.847724 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:27.847999 (+ 275us) client_negotiation.cc:769] Sending connection context
0807 08:40:27.848199 (+ 200us) client_negotiation.cc:240] Negotiation successful
0807 08:40:27.848482 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":105,"threads_started":1}
WARNING: no policy specified for kudu/127.8.208.195@KRBTEST.COM; defaulting to no policy
I20260807 08:40:27.850579 18262 heartbeater.cc:347] Connected to a master server at 127.8.208.254:42413
I20260807 08:40:27.850793 18262 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:27.851202 18262 heartbeater.cc:511] Master 127.8.208.254:42413 requested a full tablet report, sending...
I20260807 08:40:27.852131 17915 ts_manager.cc:194] Registered new tserver with Master: 09ef35e399674045a89f07c0173659e3 (127.8.208.194:36105)
I20260807 08:40:27.852808 17915 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.194@KRBTEST.COM'} at 127.8.208.194:38127
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
I20260807 08:40:27.868054 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:42413
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:27.972815 18267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:27.973119 18267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:27.973158 18267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:27.976940 18267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:27.977021 18267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:27.977120 18267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:40:27.982002 18267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:42413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:27.982834 18267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:27.983680 18267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:27.992359 18273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:27.992424 18267 server_base.cc:1034] running on GCE node
W20260807 08:40:27.992342 18276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:27.992370 18274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:27.993078 18267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:27.993556 18267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:27.994731 18267 hybrid_clock.cc:648] HybridClock initialized: now 1786092027994713 us; error 29 us; skew 500 ppm
Aug 07 08:40:27 dist-test-slave-6nmv krb5kdc[17868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092027, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:27.997184 18267 init.cc:377] Logged in from keytab as kudu/127.8.208.195@KRBTEST.COM (short username kudu)
I20260807 08:40:27.998009 18267 webserver.cc:460] Webserver started at http://127.8.208.195:35353/ using document root <none> and password file <none>
I20260807 08:40:27.998471 18267 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:27.998524 18267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:27.998659 18267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:28.000252 18267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "fc7642add4da4951a4aed3a7cae3687b"
format_stamp: "Formatted at 2026-08-07 08:40:27 on dist-test-slave-6nmv"
server_key: "6fd5a05ace71065dc1c0fa43539102b6"
server_key_iv: "c020d0e4bcf1e8c0a9f86fe1dc20dd94"
server_key_version: "encryptionkey@0"
I20260807 08:40:28.000741 18267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "fc7642add4da4951a4aed3a7cae3687b"
format_stamp: "Formatted at 2026-08-07 08:40:27 on dist-test-slave-6nmv"
server_key: "6fd5a05ace71065dc1c0fa43539102b6"
server_key_iv: "c020d0e4bcf1e8c0a9f86fe1dc20dd94"
server_key_version: "encryptionkey@0"
I20260807 08:40:28.004011 18267 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 08:40:28.006174 18284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:28.007279 18267 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:28.007367 18267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "fc7642add4da4951a4aed3a7cae3687b"
format_stamp: "Formatted at 2026-08-07 08:40:27 on dist-test-slave-6nmv"
server_key: "6fd5a05ace71065dc1c0fa43539102b6"
server_key_iv: "c020d0e4bcf1e8c0a9f86fe1dc20dd94"
server_key_version: "encryptionkey@0"
I20260807 08:40:28.007441 18267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:28.032254 18267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:28.035010 18267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:28.035146 18267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:28.035601 18267 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:28.036310 18267 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:28.036355 18267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:28.036396 18267 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:28.036415 18267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:28.045351 18267 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:35079
I20260807 08:40:28.045389 18410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:35079 every 8 connection(s)
I20260807 08:40:28.046180 18267 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:40:28.053475 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 18267
I20260807 08:40:28.053614 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:40:28.053965 9027 external_mini_cluster.cc:1428] Setting key 45ff8a70e45b2c77ebead06979bb289c
Aug 07 08:40:28 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092027, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:28.059302 17956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:28.047899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:36425 (local address 127.8.208.254:42413)
0807 08:40:28.048032 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:28.048036 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:28.048762 (+ 726us) server_negotiation.cc:407] Connection header received
0807 08:40:28.050033 (+ 1271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:28.050036 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:28.050100 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:28.050222 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:28.051287 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.051836 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.053035 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.053252 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.053363 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:28.056106 (+ 2743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:28.056109 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:28.056112 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:28.056135 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:28.057392 (+ 1257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:28.057937 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:28.057946 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:28.057947 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:28.058020 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:28.058358 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:28.058360 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:28.058361 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:28.058523 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:28.058596 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:28.059098 (+ 502us) server_negotiation.cc:299] Negotiation successful
0807 08:40:28.059192 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 08:40:28.060077 18413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:28.048225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.195:36425)
0807 08:40:28.048630 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:28.048668 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:28.049781 (+ 1113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:28.050391 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:28.050397 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:28.050723 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:28.051144 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:28.051157 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.051980 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.051984 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:28.052905 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:28.052914 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.053395 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.053399 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:28.053569 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:28.054234 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:28.054248 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:28.055961 (+ 1713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:28.057506 (+ 1545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:28.057510 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:28.057520 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:28.057774 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:28.058134 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:28.058137 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:28.058138 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:28.058270 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:28.058641 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:28.058646 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:28.058883 (+ 237us) client_negotiation.cc:769] Sending connection context
0807 08:40:28.059045 (+ 162us) client_negotiation.cc:240] Negotiation successful
0807 08:40:28.059283 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":106,"threads_started":1}
I20260807 08:40:28.061354 18411 heartbeater.cc:347] Connected to a master server at 127.8.208.254:42413
I20260807 08:40:28.061654 18411 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:28.062278 18411 heartbeater.cc:511] Master 127.8.208.254:42413 requested a full tablet report, sending...
I20260807 08:40:28.063319 17915 ts_manager.cc:194] Registered new tserver with Master: fc7642add4da4951a4aed3a7cae3687b (127.8.208.195:35079)
I20260807 08:40:28.064134 17915 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.195@KRBTEST.COM'} at 127.8.208.195:36425
I20260807 08:40:28.069096 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.8.208.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.208.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.208.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.193.keytab.
Entry for principal oryx/127.8.208.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.193.keytab.
WARNING: no policy specified for oryx/127.8.208.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.208.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.208.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.194.keytab.
Entry for principal oryx/127.8.208.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.194.keytab.
WARNING: no policy specified for oryx/127.8.208.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.208.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.208.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.195.keytab.
Entry for principal oryx/127.8.208.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.195.keytab.
I20260807 08:40:28.134589 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 17981
I20260807 08:40:28.141381 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 18121
I20260807 08:40:28.147311 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 18267
I20260807 08:40:28.154225 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 17882
I20260807 08:40:28.161267 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:42413
--webserver_interface=127.8.208.254
--webserver_port=44593
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:42413
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:28.263062 18421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:28.263314 18421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:28.263376 18421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:28.267037 18421 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:40:28.267112 18421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:28.267149 18421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:28.267186 18421 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:40:28.267216 18421 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:40:28.271886 18421 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:42413
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:42413
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=44593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18421
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:28.272760 18421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:28.274062 18421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:28.281675 18426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:28.281675 18427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:28.281731 18429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:28.282126 18421 server_base.cc:1034] running on GCE node
I20260807 08:40:28.282667 18421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:28.283638 18421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:28.284816 18421 hybrid_clock.cc:648] HybridClock initialized: now 1786092028284797 us; error 47 us; skew 500 ppm
Aug 07 08:40:28 dist-test-slave-6nmv krb5kdc[17868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092028, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:28.287554 18421 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:40:28.288287 18421 webserver.cc:460] Webserver started at http://127.8.208.254:44593/ using document root <none> and password file <none>
I20260807 08:40:28.288754 18421 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:28.288820 18421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:28.292181 18421 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260807 08:40:28.294066 18438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:28.295241 18421 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:28.295365 18421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "609340ea53b348f68344e9f179a0aae6"
format_stamp: "Formatted at 2026-08-07 08:40:27 on dist-test-slave-6nmv"
server_key: "c500ef0e516f5880d8d83ad7b441e0ac"
server_key_iv: "06ff717e67f97c9dbd4b370574d56783"
server_key_version: "encryptionkey@0"
I20260807 08:40:28.295830 18421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:28.332710 18421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:28.335595 18421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:28.335793 18421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:28.342389 18421 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:42413
I20260807 08:40:28.342414 18495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:42413 every 8 connection(s)
I20260807 08:40:28.343348 18421 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:40:28.347275 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 18421
I20260807 08:40:28.347534 18497 sys_catalog.cc:263] Verifying existing consensus state
I20260807 08:40:28.347894 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:46209
--local_ip_for_outbound_sockets=127.8.208.193
--tserver_master_addrs=127.8.208.254:42413
--webserver_port=44153
--webserver_interface=127.8.208.193
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.8.208.193
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.193.keytab with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 08:40:28.349887 18497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6: Bootstrap starting.
I20260807 08:40:28.365610 18497 log.cc:824] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:28.372071 18497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 08:40:28.372493 18497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6: Bootstrap complete.
I20260807 08:40:28.376989 18497 raft_consensus.cc:348] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "609340ea53b348f68344e9f179a0aae6" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 42413 } }
I20260807 08:40:28.377369 18497 raft_consensus.cc:729] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 609340ea53b348f68344e9f179a0aae6, State: Initialized, Role: FOLLOWER
I20260807 08:40:28.377977 18497 consensus_queue.cc:260] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "609340ea53b348f68344e9f179a0aae6" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 42413 } }
I20260807 08:40:28.378089 18497 raft_consensus.cc:388] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:40:28.378165 18497 raft_consensus.cc:482] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:40:28.378252 18497 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [term 1 FOLLOWER]: Advancing to term 2
I20260807 08:40:28.380002 18497 raft_consensus.cc:504] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "609340ea53b348f68344e9f179a0aae6" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 42413 } }
I20260807 08:40:28.380301 18497 leader_election.cc:302] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 609340ea53b348f68344e9f179a0aae6; no voters:
I20260807 08:40:28.380625 18497 leader_election.cc:288] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 08:40:28.380759 18503 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 08:40:28.381000 18503 raft_consensus.cc:686] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [term 2 LEADER]: Becoming Leader. State: Replica: 609340ea53b348f68344e9f179a0aae6, State: Running, Role: LEADER
I20260807 08:40:28.381347 18503 consensus_queue.cc:237] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "609340ea53b348f68344e9f179a0aae6" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 42413 } }
I20260807 08:40:28.381690 18497 sys_catalog.cc:564] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:40:28.382627 18504 sys_catalog.cc:455] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "609340ea53b348f68344e9f179a0aae6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "609340ea53b348f68344e9f179a0aae6" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 42413 } } }
I20260807 08:40:28.382740 18504 sys_catalog.cc:458] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:28.383179 18506 sys_catalog.cc:455] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 609340ea53b348f68344e9f179a0aae6. Latest consensus state: current_term: 2 leader_uuid: "609340ea53b348f68344e9f179a0aae6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "609340ea53b348f68344e9f179a0aae6" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 42413 } } }
I20260807 08:40:28.383342 18506 sys_catalog.cc:458] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6 [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:28.383642 18513 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:40:28.386544 18513 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:40:28.387072 18513 catalog_manager.cc:1259] Loaded cluster ID: ce02802edb0b43df9042b0666705794f
I20260807 08:40:28.387146 18513 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:40:28.388782 18513 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:40:28.389318 18513 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 609340ea53b348f68344e9f179a0aae6: Loaded TSK: 0
I20260807 08:40:28.390349 18513 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 08:40:28.461521 18499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:28.461760 18499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:28.461870 18499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:28.465487 18499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:28.465564 18499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:28.465648 18499 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:40:28.470749 18499 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.193.keytab
--principal=oryx/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:46209
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=44153
--tserver_master_addrs=127.8.208.254:42413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18499
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:28.471668 18499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:28.472575 18499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:28.482105 18529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:28.482118 18528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:28.482209 18531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:28.482484 18499 server_base.cc:1034] running on GCE node
I20260807 08:40:28.482848 18499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:28.483387 18499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:28.484560 18499 hybrid_clock.cc:648] HybridClock initialized: now 1786092028484541 us; error 33 us; skew 500 ppm
Aug 07 08:40:28 dist-test-slave-6nmv krb5kdc[17868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092028, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:28.487208 18499 init.cc:377] Logged in from keytab as oryx/127.8.208.193@KRBTEST.COM (short username oryx)
I20260807 08:40:28.488035 18499 webserver.cc:460] Webserver started at http://127.8.208.193:44153/ using document root <none> and password file <none>
I20260807 08:40:28.488507 18499 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:28.488575 18499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:28.492139 18499 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:40:28.494117 18538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:28.495316 18499 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 08:40:28.495440 18499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "e555176b605d4f52b26bc66ccb4a73af"
format_stamp: "Formatted at 2026-08-07 08:40:27 on dist-test-slave-6nmv"
server_key: "d507f5a3df83e13d6aeecafb9f9b7309"
server_key_iv: "075bba133573b9fda45fa00f1489bd35"
server_key_version: "encryptionkey@0"
I20260807 08:40:28.495936 18499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:28.518116 18499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:28.520730 18499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:28.520900 18499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:28.521457 18499 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:28.522281 18499 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:28.522347 18499 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:28.522410 18499 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:28.522459 18499 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:28.530858 18499 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:46209
I20260807 08:40:28.530897 18663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:46209 every 8 connection(s)
I20260807 08:40:28.531764 18499 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:40:28.535331 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 18499
I20260807 08:40:28.535761 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:36105
--local_ip_for_outbound_sockets=127.8.208.194
--tserver_master_addrs=127.8.208.254:42413
--webserver_port=44211
--webserver_interface=127.8.208.194
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.8.208.194
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.194.keytab with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 08:40:28 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:28 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:28.544610 18669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:28.533604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.193:56221)
0807 08:40:28.534022 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:28.534069 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:28.535184 (+ 1115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:28.536309 (+ 1125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:28.536320 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:28.536840 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:28.537504 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:28.537527 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.539294 (+ 1767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.539296 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:28.540063 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:28.540076 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.541047 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.541050 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:28.541169 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:28.541714 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:28.541728 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:28.543993 (+ 2265us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":110,"threads_started":1}
W20260807 08:40:28.545109 18667 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:28.533479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:56221 (local address 127.8.208.254:42413)
0807 08:40:28.533870 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:28.533891 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:28.534171 (+ 280us) server_negotiation.cc:407] Connection header received
0807 08:40:28.535596 (+ 1425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:28.535605 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:28.535919 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:28.536177 (+ 258us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:28.537702 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.539179 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.540203 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.540899 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.541090 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:28.544264 (+ 3174us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.193:56221: BlockingRecv error: recv got EOF from 127.8.208.193:56221 (error 108)
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":109,"threads_started":1}
W20260807 08:40:28.545143 18665 heartbeater.cc:644] Failed to heartbeat to 127.8.208.254:42413 (0 consecutive failures): Not authorized: Failed to ping master at 127.8.208.254:42413: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Aug 07 08:40:28 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:28 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:28.550196 18669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:28.545623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.193:45091)
0807 08:40:28.545717 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:28.545734 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:28.545813 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:28.546037 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:28.546040 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:28.546170 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:28.546240 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:28.546244 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.546925 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.546930 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:28.547449 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:28.547457 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.547894 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.547897 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:28.547992 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:28.548445 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:28.548456 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:28.550094 (+ 1638us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":35}
W20260807 08:40:28.550570 18667 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:28.545710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:45091 (local address 127.8.208.254:42413)
0807 08:40:28.545838 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:28.545841 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:28.545855 (+ 14us) server_negotiation.cc:407] Connection header received
0807 08:40:28.545892 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:28.545895 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:28.545934 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:28.546025 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:28.546337 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.546817 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.547566 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.547787 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.547893 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:28.550480 (+ 2587us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.193:45091: BlockingRecv error: recv got EOF from 127.8.208.193:45091 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 07 08:40:28 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:28 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:28.555342 18669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:28.550657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.193:50979)
0807 08:40:28.550844 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:28.550855 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:28.550910 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:28.551083 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:28.551085 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:28.551219 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:28.551290 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:28.551295 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.551889 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.551895 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:28.552756 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:28.552778 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.553160 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.553163 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:28.553259 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:28.553643 (+ 384us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:28.553655 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:28.555230 (+ 1575us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136}
W20260807 08:40:28.555423 18667 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:28.550836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:50979 (local address 127.8.208.254:42413)
0807 08:40:28.550930 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:28.550932 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:28.550942 (+ 10us) server_negotiation.cc:407] Connection header received
0807 08:40:28.550967 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:28.550969 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:28.550996 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:28.551050 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:28.551378 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.551790 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.552882 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.553067 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.553132 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:28.555327 (+ 2195us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.193:50979: BlockingRecv error: recv got EOF from 127.8.208.193:50979 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260807 08:40:28.555686 18665 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 08:40:28.647779 18670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:28.648027 18670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:28.648067 18670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:28.651978 18670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:28.652033 18670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:28.652146 18670 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:40:28.656929 18670 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.194.keytab
--principal=oryx/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:36105
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=44211
--tserver_master_addrs=127.8.208.254:42413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18670
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:28.657924 18670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:28.658905 18670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:28.667971 18675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:28.668048 18676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:28.668051 18678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:28.668149 18670 server_base.cc:1034] running on GCE node
I20260807 08:40:28.668630 18670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:28.669224 18670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:28.670408 18670 hybrid_clock.cc:648] HybridClock initialized: now 1786092028670388 us; error 44 us; skew 500 ppm
Aug 07 08:40:28 dist-test-slave-6nmv krb5kdc[17868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092028, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:28.673117 18670 init.cc:377] Logged in from keytab as oryx/127.8.208.194@KRBTEST.COM (short username oryx)
I20260807 08:40:28.673880 18670 webserver.cc:460] Webserver started at http://127.8.208.194:44211/ using document root <none> and password file <none>
I20260807 08:40:28.674368 18670 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:28.674433 18670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:28.678045 18670 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260807 08:40:28.679900 18687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:28.680964 18670 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:28.681046 18670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "09ef35e399674045a89f07c0173659e3"
format_stamp: "Formatted at 2026-08-07 08:40:27 on dist-test-slave-6nmv"
server_key: "ecdc93708fe66e06ec3705921152aaf5"
server_key_iv: "b621e710f00c9aa6229d3145e34b07ff"
server_key_version: "encryptionkey@0"
I20260807 08:40:28.681581 18670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:28.701710 18670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:28.704470 18670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:28.704612 18670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:28.705276 18670 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:28.706086 18670 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:28.706130 18670 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:28.706187 18670 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:28.706216 18670 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:28.715396 18670 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:36105
I20260807 08:40:28.715462 18807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:36105 every 8 connection(s)
I20260807 08:40:28.716289 18670 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:40:28.722856 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 18670
I20260807 08:40:28.723345 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:35079
--local_ip_for_outbound_sockets=127.8.208.195
--tserver_master_addrs=127.8.208.254:42413
--webserver_port=35353
--webserver_interface=127.8.208.195
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:46009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.8.208.195
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.195.keytab with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 08:40:28 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:28 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 08:40:28.727510 18667 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:28.718064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:46711 (local address 127.8.208.254:42413)
0807 08:40:28.718198 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:28.718202 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:28.719078 (+ 876us) server_negotiation.cc:407] Connection header received
0807 08:40:28.720573 (+ 1495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:28.720575 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:28.720624 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:28.720692 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:28.721767 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.722291 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.723839 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.724080 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.724153 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:28.727335 (+ 3182us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.194:46711: BlockingRecv error: recv got EOF from 127.8.208.194:46711 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 08:40:28.727973 18811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:28.718413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.194:46711)
0807 08:40:28.718883 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:28.718943 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:28.720387 (+ 1444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:28.720847 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:28.720869 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:28.721194 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:28.721631 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:28.721644 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.722407 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.722410 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:28.723719 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:28.723733 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.724221 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.724226 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:28.724425 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:28.724968 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:28.724998 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:28.727154 (+ 2156us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":107,"threads_started":1}
W20260807 08:40:28.728506 18808 heartbeater.cc:644] Failed to heartbeat to 127.8.208.254:42413 (0 consecutive failures): Not authorized: Failed to ping master at 127.8.208.254:42413: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Aug 07 08:40:28 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:28 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:28.733476 18811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:28.728897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.194:53203)
0807 08:40:28.728994 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:28.729008 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:28.729072 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:28.729302 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:28.729304 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:28.729449 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:28.729521 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:28.729525 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.730238 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.730243 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:28.730707 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:28.730714 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.731105 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.731108 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:28.731185 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:28.731637 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:28.731665 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:28.733331 (+ 1666us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 08:40:28.733510 18667 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:28.729016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:53203 (local address 127.8.208.254:42413)
0807 08:40:28.729130 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:28.729135 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:28.729153 (+ 18us) server_negotiation.cc:407] Connection header received
0807 08:40:28.729180 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:28.729182 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:28.729211 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:28.729290 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:28.729626 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.730141 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.730817 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.731004 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.731102 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:28.733436 (+ 2334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.194:53203: BlockingRecv error: recv got EOF from 127.8.208.194:53203 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 07 08:40:28 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:28 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:28.738744 18811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:28.733990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.194:43495)
0807 08:40:28.734097 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:28.734110 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:28.734188 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:28.734376 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:28.734378 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:28.734518 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:28.734590 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:28.734596 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.735169 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.735171 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:28.735993 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:28.736002 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.736377 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.736380 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:28.736460 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:28.736870 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:28.736884 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:28.738652 (+ 1768us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 08:40:28.738888 18808 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 08:40:28.738952 18667 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:28.734097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:43495 (local address 127.8.208.254:42413)
0807 08:40:28.734217 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:28.734219 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:28.734232 (+ 13us) server_negotiation.cc:407] Connection header received
0807 08:40:28.734257 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:28.734259 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:28.734287 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:28.734343 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:28.734687 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.735087 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.736099 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.736282 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.736350 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:28.738747 (+ 2397us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.194:43495: BlockingRecv error: recv got EOF from 127.8.208.194:43495 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260807 08:40:28.828554 18812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:28.828778 18812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:28.828848 18812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:28.832964 18812 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:28.833016 18812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:28.833066 18812 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:40:28.837949 18812 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:46009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/krb5kdc/oryx_127.8.208.195.keytab
--principal=oryx/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:35079
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=35353
--tserver_master_addrs=127.8.208.254:42413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18812
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:28.838966 18812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:28.839951 18812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:28.848811 18817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:28.848807 18818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:28.848811 18820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:28.849246 18812 server_base.cc:1034] running on GCE node
I20260807 08:40:28.849565 18812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:28.850139 18812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:28.851312 18812 hybrid_clock.cc:648] HybridClock initialized: now 1786092028851300 us; error 33 us; skew 500 ppm
Aug 07 08:40:28 dist-test-slave-6nmv krb5kdc[17868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092028, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:28.854071 18812 init.cc:377] Logged in from keytab as oryx/127.8.208.195@KRBTEST.COM (short username oryx)
I20260807 08:40:28.854954 18812 webserver.cc:460] Webserver started at http://127.8.208.195:35353/ using document root <none> and password file <none>
I20260807 08:40:28.855479 18812 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:28.855584 18812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:28.859160 18812 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:40:28.860970 18827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:28.862106 18812 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:40:28.862234 18812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "fc7642add4da4951a4aed3a7cae3687b"
format_stamp: "Formatted at 2026-08-07 08:40:27 on dist-test-slave-6nmv"
server_key: "6fd5a05ace71065dc1c0fa43539102b6"
server_key_iv: "c020d0e4bcf1e8c0a9f86fe1dc20dd94"
server_key_version: "encryptionkey@0"
I20260807 08:40:28.862717 18812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:28.882077 18812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:28.884874 18812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:28.885073 18812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:28.885565 18812 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:28.886354 18812 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:28.886425 18812 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:28.886497 18812 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:28.886560 18812 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:28.895669 18812 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:35079
I20260807 08:40:28.895694 18946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:35079 every 8 connection(s)
I20260807 08:40:28.896557 18812 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:40:28.899648 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 18812
Aug 07 08:40:28 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:28 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 08:40:28.907747 18667 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:28.898226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:43263 (local address 127.8.208.254:42413)
0807 08:40:28.898356 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:28.898361 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:28.899155 (+ 794us) server_negotiation.cc:407] Connection header received
0807 08:40:28.900585 (+ 1430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:28.900588 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:28.900640 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:28.900712 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:28.902015 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.902558 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.903926 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.904233 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.904346 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:28.907614 (+ 3268us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.195:43263: BlockingRecv error: recv got EOF from 127.8.208.195:43263 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 08:40:28.908274 18949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:28.898549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.195:43263)
0807 08:40:28.898984 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:28.899059 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:28.900374 (+ 1315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:28.900869 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:28.900874 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:28.901311 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:28.901888 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:28.901910 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.902677 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.902680 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:28.903758 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:28.903768 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.904389 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.904393 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:28.904529 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:28.905037 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:28.905051 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:28.907478 (+ 2427us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":91,"threads_started":1}
W20260807 08:40:28.908735 18947 heartbeater.cc:644] Failed to heartbeat to 127.8.208.254:42413 (0 consecutive failures): Not authorized: Failed to ping master at 127.8.208.254:42413: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
I20260807 08:40:28.909283 18952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:28.900538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58788 (local address 127.8.208.254:42413)
0807 08:40:28.900750 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:28.900759 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:28.900770 (+ 11us) server_negotiation.cc:407] Connection header received
0807 08:40:28.900803 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:28.900805 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:28.900838 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:28.900912 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:28.901693 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.902230 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.903115 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.903478 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.903605 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:28.905007 (+ 1402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:28.905012 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:28.905022 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:28.905045 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:28.906909 (+ 1864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:28.907353 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:28.907359 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:28.907364 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:28.907530 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:28.908008 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:28.908010 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:28.908011 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:28.908303 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:28.908527 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:28.908913 (+ 386us) server_negotiation.cc:299] Negotiation successful
0807 08:40:28.909169 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":94,"threads_started":1}
Aug 07 08:40:28 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:28 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:28.913905 18949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:28.909140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.195:46669)
0807 08:40:28.909233 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:28.909247 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:28.909317 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:28.909653 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:28.909656 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:28.909802 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:28.909928 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:28.909934 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.910673 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.910675 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:28.911302 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:28.911312 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.911861 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.911865 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:28.911962 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:28.912327 (+ 365us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:28.912338 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:28.913776 (+ 1438us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 08:40:28.914116 18952 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:28.909362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:46669 (local address 127.8.208.254:42413)
0807 08:40:28.909465 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:28.909470 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:28.909483 (+ 13us) server_negotiation.cc:407] Connection header received
0807 08:40:28.909516 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:28.909518 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:28.909547 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:28.909611 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:28.910030 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.910573 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.911437 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.911724 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.911841 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:28.913997 (+ 2156us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.195:46669: BlockingRecv error: recv got EOF from 127.8.208.195:46669 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 07 08:40:28 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:28 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:28.918390 18949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:28.914344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.195:50727)
0807 08:40:28.914435 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:28.914455 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:28.914518 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:28.914721 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:28.914723 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:28.914826 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:28.914888 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:28.914891 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.915490 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.915492 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:28.915927 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:28.915933 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.916266 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.916268 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:28.916315 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:28.916763 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:28.916774 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:28.918322 (+ 1548us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 08:40:28.918553 18952 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:28.914452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:50727 (local address 127.8.208.254:42413)
0807 08:40:28.914570 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:28.914576 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:28.914594 (+ 18us) server_negotiation.cc:407] Connection header received
0807 08:40:28.914621 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:28.914623 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:28.914652 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:28.914716 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:28.914998 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.915395 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.915997 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:28.916159 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:28.916242 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:28.918454 (+ 2212us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.195:50727: BlockingRecv error: recv got EOF from 127.8.208.195:50727 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260807 08:40:28.918562 18947 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 08:40:29 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:29 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:29.561543 18953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:29.556342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.193:58347)
0807 08:40:29.556612 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:29.556626 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:29.556746 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:29.557022 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:29.557024 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:29.557200 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:29.557293 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:29.557298 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:29.558060 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:29.558063 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:29.558620 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:29.558627 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:29.559108 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:29.559111 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:29.559178 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:29.559651 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:29.559662 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:29.561433 (+ 1771us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":84,"threads_started":1}
W20260807 08:40:29.561689 18954 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:29.556463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:58347 (local address 127.8.208.254:42413)
0807 08:40:29.556745 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:29.556750 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:29.556766 (+ 16us) server_negotiation.cc:407] Connection header received
0807 08:40:29.556842 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:29.556845 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:29.556906 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:29.556990 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:29.557406 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:29.557970 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:29.558726 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:29.558968 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:29.559059 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:29.561565 (+ 2506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.193:58347: BlockingRecv error: recv got EOF from 127.8.208.193:58347 (error 108)
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":121,"threads_started":1}
Aug 07 08:40:29 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:29 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:29.744277 18955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:29.739395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.194:42365)
0807 08:40:29.739639 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:29.739669 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:29.739757 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:29.740011 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:29.740013 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:29.740177 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:29.740267 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:29.740271 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:29.741041 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:29.741043 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:29.741556 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:29.741563 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:29.741940 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:29.741943 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:29.742002 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:29.742432 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:29.742443 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:29.744124 (+ 1681us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":66,"threads_started":1}
W20260807 08:40:29.744328 18954 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:29.739484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:42365 (local address 127.8.208.254:42413)
0807 08:40:29.739679 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:29.739685 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:29.739739 (+ 54us) server_negotiation.cc:407] Connection header received
0807 08:40:29.739839 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:29.739841 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:29.739905 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:29.739976 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:29.740456 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:29.740933 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:29.741652 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:29.741856 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:29.741923 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:29.744229 (+ 2306us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.194:42365: BlockingRecv error: recv got EOF from 127.8.208.194:42365 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 07 08:40:29 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:29 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:29.924022 18956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:29.919111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.195:60563)
0807 08:40:29.919361 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:29.919372 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:29.919494 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:29.919739 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:29.919742 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:29.919923 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:29.920017 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:29.920022 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:29.920678 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:29.920684 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:29.921196 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:29.921203 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:29.921630 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:29.921633 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:29.921720 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:29.922252 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:29.922271 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:29.923886 (+ 1615us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":78,"threads_started":1}
W20260807 08:40:29.924101 18954 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:29.919162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:60563 (local address 127.8.208.254:42413)
0807 08:40:29.919303 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:29.919307 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:29.919440 (+ 133us) server_negotiation.cc:407] Connection header received
0807 08:40:29.919589 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:29.919592 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:29.919640 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:29.919720 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:29.920124 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:29.920581 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:29.921311 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:29.921530 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:29.921624 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:29.923995 (+ 2371us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.195:60563: BlockingRecv error: recv got EOF from 127.8.208.195:60563 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 07 08:40:30 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:30 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:30.567683 18957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:30.562446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.193:59393)
0807 08:40:30.562695 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:30.562707 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:30.562783 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:30.562977 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:30.562979 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:30.563140 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:30.563244 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:30.563249 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:30.563914 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:30.563916 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:30.564424 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:30.564430 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:30.564780 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:30.564782 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:30.564888 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:30.565481 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:30.565493 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:30.567551 (+ 2058us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":83,"threads_started":1}
W20260807 08:40:30.567854 18958 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:30.562493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:59393 (local address 127.8.208.254:42413)
0807 08:40:30.562773 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:30.562776 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:30.562788 (+ 12us) server_negotiation.cc:407] Connection header received
0807 08:40:30.562855 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:30.562857 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:30.562897 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:30.562962 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:30.563332 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:30.563826 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:30.564510 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:30.564698 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:30.564763 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:30.567696 (+ 2933us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.193:59393: BlockingRecv error: recv got EOF from 127.8.208.193:59393 (error 108)
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":97,"threads_started":1}
Aug 07 08:40:30 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:30 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:30.750536 18960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:30.745208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.194:36173)
0807 08:40:30.745557 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:30.745571 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:30.745697 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:30.746004 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:30.746006 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:30.746202 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:30.746292 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:30.746298 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:30.747078 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:30.747083 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:30.747626 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:30.747633 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:30.748101 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:30.748105 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:30.748183 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:30.748630 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:30.748640 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:30.750397 (+ 1757us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":92,"threads_started":1}
W20260807 08:40:30.750635 18958 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:30.745247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:36173 (local address 127.8.208.254:42413)
0807 08:40:30.745405 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:30.745409 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:30.745666 (+ 257us) server_negotiation.cc:407] Connection header received
0807 08:40:30.745789 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:30.745791 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:30.745875 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:30.745967 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:30.746409 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:30.746965 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:30.747746 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:30.747998 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:30.748098 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:30.750531 (+ 2433us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.194:36173: BlockingRecv error: recv got EOF from 127.8.208.194:36173 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 07 08:40:30 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:30 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:30.930336 18961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:30.924794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.195:49739)
0807 08:40:30.925121 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:30.925140 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:30.925244 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:30.925518 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:30.925521 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:30.925715 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:30.925804 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:30.925856 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:30.926560 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:30.926565 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:30.927134 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:30.927141 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:30.927598 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:30.927601 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:30.927689 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:30.928315 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:30.928326 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:30.930223 (+ 1897us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":95,"threads_started":1}
W20260807 08:40:30.930430 18958 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:30.925078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:49739 (local address 127.8.208.254:42413)
0807 08:40:30.925214 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:30.925218 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:30.925231 (+ 13us) server_negotiation.cc:407] Connection header received
0807 08:40:30.925348 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:30.925352 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:30.925404 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:30.925497 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:30.925972 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:30.926454 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:30.927255 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:30.927481 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:30.927592 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:30.930332 (+ 2740us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.195:49739: BlockingRecv error: recv got EOF from 127.8.208.195:49739 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 07 08:40:31 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:31 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:31.573992 18962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:31.568545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.193:49535)
0807 08:40:31.568804 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:31.568816 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:31.568906 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:31.569130 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:31.569132 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:31.569305 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:31.569397 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:31.569402 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:31.570362 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:31.570366 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:31.571125 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:31.571134 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:31.571579 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:31.571582 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:31.571648 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:31.572161 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:31.572171 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:31.573885 (+ 1714us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":84,"threads_started":1}
W20260807 08:40:31.574144 18963 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:31.568606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:49535 (local address 127.8.208.254:42413)
0807 08:40:31.568827 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:31.568831 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:31.568897 (+ 66us) server_negotiation.cc:407] Connection header received
0807 08:40:31.568982 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:31.568984 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:31.569027 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:31.569101 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:31.569494 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:31.570246 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:31.571247 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:31.571478 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:31.571560 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:31.574019 (+ 2459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.193:49535: BlockingRecv error: recv got EOF from 127.8.208.193:49535 (error 108)
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":61,"threads_started":1}
Aug 07 08:40:31 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:31 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:31.756356 18964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:31.751269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.194:56741)
0807 08:40:31.751573 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:31.751584 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:31.751681 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:31.751920 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:31.751921 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:31.752086 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:31.752176 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:31.752181 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:31.752940 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:31.752942 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:31.753434 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:31.753440 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:31.753923 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:31.753926 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:31.753983 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:31.754493 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:31.754504 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:31.756258 (+ 1754us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":74,"threads_started":1}
W20260807 08:40:31.756541 18963 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:31.751311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:56741 (local address 127.8.208.254:42413)
0807 08:40:31.751456 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:31.751459 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:31.751665 (+ 206us) server_negotiation.cc:407] Connection header received
0807 08:40:31.751775 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:31.751777 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:31.751824 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:31.751887 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:31.752267 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:31.752848 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:31.753553 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:31.753759 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:31.753911 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:31.756393 (+ 2482us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.194:56741: BlockingRecv error: recv got EOF from 127.8.208.194:56741 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 07 08:40:31 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:31 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:31.936509 18965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:31.931188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.195:37403)
0807 08:40:31.931470 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:31.931484 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:31.931578 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:31.931813 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:31.931815 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:31.932010 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:31.932104 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:31.932110 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:31.932814 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:31.932816 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:31.933405 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:31.933417 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:31.933858 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:31.933863 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:31.933950 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:31.934491 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:31.934502 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:31.936309 (+ 1807us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":111,"threads_started":1}
W20260807 08:40:31.936590 18963 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:31.931281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:37403 (local address 127.8.208.254:42413)
0807 08:40:31.931408 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:31.931411 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:31.931548 (+ 137us) server_negotiation.cc:407] Connection header received
0807 08:40:31.931665 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:31.931667 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:31.931714 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:31.931782 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:31.932200 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:31.932719 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:31.933515 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:31.933724 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:31.933798 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:31.936468 (+ 2670us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.195:37403: BlockingRecv error: recv got EOF from 127.8.208.195:37403 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 07 08:40:32 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:32 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:32.583117 18966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:32.574691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.193:36531)
0807 08:40:32.575036 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:32.575048 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:32.575139 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:32.575359 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:32.575361 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:32.575553 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:32.575651 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:32.575656 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:32.576365 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:32.576367 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:32.576900 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:32.576926 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:32.577324 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:32.577326 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:32.577388 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:32.581007 (+ 3619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:32.581019 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:32.583012 (+ 1993us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":187,"threads_started":1}
W20260807 08:40:32.583267 18967 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:32.574753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:36531 (local address 127.8.208.254:42413)
0807 08:40:32.575016 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:32.575019 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:32.575098 (+ 79us) server_negotiation.cc:407] Connection header received
0807 08:40:32.575198 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:32.575200 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:32.575238 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:32.575328 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:32.575747 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:32.576276 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:32.577019 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:32.577234 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:32.577328 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:32.583123 (+ 5795us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.193:36531: BlockingRecv error: recv got EOF from 127.8.208.193:36531 (error 108)
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":78,"threads_started":1}
Aug 07 08:40:32 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:32 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:32.762140 18968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:32.757105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.194:35419)
0807 08:40:32.757386 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:32.757399 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:32.757532 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:32.757799 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:32.757802 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:32.758062 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:32.758175 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:32.758180 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:32.758852 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:32.758857 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:32.759335 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:32.759342 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:32.759751 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:32.759754 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:32.759832 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:32.760293 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:32.760304 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:32.762038 (+ 1734us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":87,"threads_started":1}
W20260807 08:40:32.762300 18967 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:32.757167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:35419 (local address 127.8.208.254:42413)
0807 08:40:32.757323 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:32.757328 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:32.757472 (+ 144us) server_negotiation.cc:407] Connection header received
0807 08:40:32.757637 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:32.757641 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:32.757693 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:32.757771 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:32.758281 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:32.758757 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:32.759447 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:32.759654 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:32.759747 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:32.762168 (+ 2421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.194:35419: BlockingRecv error: recv got EOF from 127.8.208.194:35419 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 07 08:40:32 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:32 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:32.942701 18969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:32.937316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.195:53989)
0807 08:40:32.937576 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:32.937589 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:32.937683 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:32.937929 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:32.937931 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:32.938137 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:32.938241 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:32.938246 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:32.939004 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:32.939006 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:32.939524 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:32.939530 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:32.940017 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:32.940020 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:32.940082 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:32.940574 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:32.940584 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:32.942565 (+ 1981us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":102,"threads_started":1}
W20260807 08:40:32.942986 18967 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:32.937400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:53989 (local address 127.8.208.254:42413)
0807 08:40:32.937560 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:32.937564 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:32.937657 (+ 93us) server_negotiation.cc:407] Connection header received
0807 08:40:32.937767 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:32.937769 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:32.937836 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:32.937911 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:32.938342 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:32.938892 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:32.939665 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:32.939909 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:32.939997 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:32.942840 (+ 2843us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.195:53989: BlockingRecv error: recv got EOF from 127.8.208.195:53989 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 07 08:40:33 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:33 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:33.589488 18970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:33.583898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.193:40965)
0807 08:40:33.584212 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:33.584225 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:33.584320 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:33.584600 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:33.584602 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:33.584799 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:33.584908 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:33.584914 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:33.585680 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:33.585684 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:33.586231 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:33.586239 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:33.586708 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:33.586712 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:33.586787 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:33.587423 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:33.587435 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:33.589378 (+ 1943us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":98,"threads_started":1}
W20260807 08:40:33.589617 18971 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:33.583925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:40965 (local address 127.8.208.254:42413)
0807 08:40:33.584175 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:33.584179 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:33.584289 (+ 110us) server_negotiation.cc:407] Connection header received
0807 08:40:33.584416 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:33.584418 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:33.584465 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:33.584574 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:33.585010 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:33.585548 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:33.586343 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:33.586600 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:33.586721 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:33.589499 (+ 2778us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.193:40965: BlockingRecv error: recv got EOF from 127.8.208.193:40965 (error 108)
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":100,"threads_started":1}
Aug 07 08:40:33 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:33 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:33.768065 18972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:33.762850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.194:49343)
0807 08:40:33.763131 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:33.763144 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:33.763226 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:33.763456 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:33.763458 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:33.763645 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:33.763768 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:33.763791 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:33.764495 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:33.764497 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:33.765177 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:33.765188 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:33.765547 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:33.765550 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:33.765604 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:33.766103 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:33.766113 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:33.767912 (+ 1799us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":91,"threads_started":1}
W20260807 08:40:33.768344 18971 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:33.762984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:49343 (local address 127.8.208.254:42413)
0807 08:40:33.763144 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:33.763149 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:33.763201 (+ 52us) server_negotiation.cc:407] Connection header received
0807 08:40:33.763295 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:33.763297 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:33.763357 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:33.763426 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:33.763903 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:33.764405 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:33.765274 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:33.765461 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:33.765533 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:33.768083 (+ 2550us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.194:49343: BlockingRecv error: recv got EOF from 127.8.208.194:49343 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 07 08:40:33 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:33 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:33.948505 18973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:33.943507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.195:44315)
0807 08:40:33.943750 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:33.943763 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:33.943850 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:33.944055 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:33.944056 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:33.944227 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:33.944316 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:33.944321 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:33.944970 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:33.944972 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:33.945459 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:33.945465 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:33.945802 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:33.945804 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:33.945882 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:33.946295 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:33.946305 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:33.948398 (+ 2093us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":84,"threads_started":1}
W20260807 08:40:33.948601 18971 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:33.943565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:44315 (local address 127.8.208.254:42413)
0807 08:40:33.943701 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:33.943705 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:33.943826 (+ 121us) server_negotiation.cc:407] Connection header received
0807 08:40:33.943912 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:33.943914 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:33.943957 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:33.944020 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:33.944409 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:33.944882 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:33.945544 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:33.945723 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:33.945787 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:33.948494 (+ 2707us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.195:44315: BlockingRecv error: recv got EOF from 127.8.208.195:44315 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 07 08:40:34 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:34 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:34.595247 18974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:34.590363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.193:35741)
0807 08:40:34.590611 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:34.590634 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:34.590719 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:34.590922 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:34.590924 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:34.591127 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:34.591236 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:34.591241 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:34.591961 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:34.591964 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:34.592527 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:34.592534 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:34.592959 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:34.592961 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:34.593016 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:34.593481 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:34.593491 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:34.595144 (+ 1653us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":80,"threads_started":1}
W20260807 08:40:34.595404 18975 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:34.590405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:35741 (local address 127.8.208.254:42413)
0807 08:40:34.590627 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:34.590630 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:34.590692 (+ 62us) server_negotiation.cc:407] Connection header received
0807 08:40:34.590784 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:34.590786 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:34.590827 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:34.590899 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:34.591332 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:34.591854 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:34.592624 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:34.592856 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:34.592945 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:34.595252 (+ 2307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.193:35741: BlockingRecv error: recv got EOF from 127.8.208.193:35741 (error 108)
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":75,"threads_started":1}
Aug 07 08:40:34 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:34 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:34.773800 18976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:34.768875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.194:49571)
0807 08:40:34.769196 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:34.769210 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:34.769322 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:34.769616 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:34.769618 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:34.769791 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:34.769942 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:34.769948 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:34.770581 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:34.770583 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:34.771047 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:34.771053 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:34.771401 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:34.771415 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:34.771469 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:34.771995 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:34.772007 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:34.773700 (+ 1693us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":82,"threads_started":1}
W20260807 08:40:34.773970 18975 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:34.768913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:49571 (local address 127.8.208.254:42413)
0807 08:40:34.769056 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:34.769061 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:34.769296 (+ 235us) server_negotiation.cc:407] Connection header received
0807 08:40:34.769415 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:34.769418 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:34.769470 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:34.769540 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:34.770044 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:34.770500 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:34.771132 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:34.771311 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:34.771381 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:34.773863 (+ 2482us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.194:49571: BlockingRecv error: recv got EOF from 127.8.208.194:49571 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 07 08:40:34 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:34 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:34.954475 18977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:34.949212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.195:43499)
0807 08:40:34.949578 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:34.949590 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:34.949703 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:34.950002 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:34.950005 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:34.950211 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:34.950303 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:34.950308 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:34.951023 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:34.951028 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:34.951568 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:34.951575 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:34.952044 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:34.952048 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:34.952132 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:34.952608 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:34.952618 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:34.954373 (+ 1755us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":114,"threads_started":1}
W20260807 08:40:34.954613 18975 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:34.949259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:43499 (local address 127.8.208.254:42413)
0807 08:40:34.949403 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:34.949407 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:34.949659 (+ 252us) server_negotiation.cc:407] Connection header received
0807 08:40:34.949795 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:34.949798 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:34.949861 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:34.949975 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:34.950424 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:34.950920 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:34.951697 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:34.951930 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:34.952029 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:34.954481 (+ 2452us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.195:43499: BlockingRecv error: recv got EOF from 127.8.208.195:43499 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 07 08:40:35 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:35 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:35.601588 18979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:35.595946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.193:56837)
0807 08:40:35.596341 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:35.596354 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:35.596480 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:35.596733 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:35.596735 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:35.596938 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:35.597027 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:35.597033 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:35.597847 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:35.597851 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:35.598437 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:35.598451 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:35.598883 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:35.598886 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:35.598969 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:35.599515 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:35.599526 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:35.601409 (+ 1883us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":78,"threads_started":1}
W20260807 08:40:35.601783 18978 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:35.596013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:56837 (local address 127.8.208.254:42413)
0807 08:40:35.596277 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:35.596282 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:35.596421 (+ 139us) server_negotiation.cc:407] Connection header received
0807 08:40:35.596575 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:35.596578 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:35.596624 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:35.596709 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:35.597143 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:35.597710 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:35.598567 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:35.598778 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:35.598876 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:35.601630 (+ 2754us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.193:56837: BlockingRecv error: recv got EOF from 127.8.208.193:56837 (error 108)
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":92,"threads_started":1}
Aug 07 08:40:35 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:35 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:35.779611 18980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:35.774505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.194:33981)
0807 08:40:35.774808 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:35.774820 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:35.774907 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:35.775134 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:35.775136 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:35.775305 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:35.775393 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:35.775398 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:35.776090 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:35.776092 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:35.776610 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:35.776617 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:35.777002 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:35.777004 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:35.777063 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:35.777626 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:35.777637 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:35.779457 (+ 1820us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":107,"threads_started":1}
W20260807 08:40:35.779660 18978 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:35.774576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:33981 (local address 127.8.208.254:42413)
0807 08:40:35.774732 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:35.774736 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:35.774917 (+ 181us) server_negotiation.cc:407] Connection header received
0807 08:40:35.774991 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:35.774993 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:35.775039 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:35.775105 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:35.775479 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:35.776000 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:35.776699 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:35.776912 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:35.776982 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:35.779564 (+ 2582us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.194:33981: BlockingRecv error: recv got EOF from 127.8.208.194:33981 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 07 08:40:35 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:35 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:35.960804 18981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:35.955393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.195:34121)
0807 08:40:35.955716 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:35.955728 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:35.955850 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:35.956113 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:35.956117 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:35.956341 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:35.956455 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:35.956461 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:35.957159 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:35.957163 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:35.957746 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:35.957754 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:35.958271 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:35.958274 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:35.958364 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:35.958889 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:35.958900 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:35.960628 (+ 1728us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":95,"threads_started":1}
W20260807 08:40:35.960852 18978 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:35.955440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:34121 (local address 127.8.208.254:42413)
0807 08:40:35.955594 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:35.955598 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:35.955799 (+ 201us) server_negotiation.cc:407] Connection header received
0807 08:40:35.955935 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:35.955940 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:35.956008 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:35.956088 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:35.956566 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:35.957052 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:35.957928 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:35.958157 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:35.958266 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:35.960736 (+ 2470us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.195:34121: BlockingRecv error: recv got EOF from 127.8.208.195:34121 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 07 08:40:36 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:36 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:36.608513 18982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:36.602415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.193:39903)
0807 08:40:36.602703 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:36.602719 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:36.602817 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:36.603110 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:36.603113 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:36.603320 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:36.603459 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:36.603467 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:36.604680 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:36.604683 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:36.605423 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:36.605432 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:36.606172 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:36.606174 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:36.606235 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:36.606662 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:36.606672 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:36.608375 (+ 1703us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":81,"threads_started":1}
W20260807 08:40:36.608660 18983 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:36.602552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:39903 (local address 127.8.208.254:42413)
0807 08:40:36.602808 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:36.602812 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:36.602826 (+ 14us) server_negotiation.cc:407] Connection header received
0807 08:40:36.602907 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:36.602909 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:36.602986 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:36.603074 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:36.603781 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:36.604560 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:36.605547 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:36.605954 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:36.606065 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:36.608523 (+ 2458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.193:39903: BlockingRecv error: recv got EOF from 127.8.208.193:39903 (error 108)
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":87,"threads_started":1}
Aug 07 08:40:36 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:36 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:36.787696 18984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:36.780521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.194:44029)
0807 08:40:36.780810 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:36.780823 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:36.780931 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:36.781152 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:36.781153 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:36.781341 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:36.781444 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:36.781449 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:36.782515 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:36.782519 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:36.783165 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:36.783175 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:36.783714 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:36.783718 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:36.783825 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:36.785762 (+ 1937us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:36.785777 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:36.787528 (+ 1751us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":111,"threads_started":1}
W20260807 08:40:36.787745 18983 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:36.780591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:44029 (local address 127.8.208.254:42413)
0807 08:40:36.780742 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:36.780749 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:36.780899 (+ 150us) server_negotiation.cc:407] Connection header received
0807 08:40:36.781009 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:36.781011 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:36.781054 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:36.781114 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:36.781545 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:36.782354 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:36.783310 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:36.783600 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:36.783681 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:36.787645 (+ 3964us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.194:44029: BlockingRecv error: recv got EOF from 127.8.208.194:44029 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 07 08:40:36 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:36 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:36.967139 18985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:36.961744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.195:43765)
0807 08:40:36.962070 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:36.962085 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:36.962222 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:36.962483 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:36.962486 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:36.962699 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:36.962789 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:36.962795 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:36.963549 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:36.963555 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:36.964218 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:36.964228 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:36.964654 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:36.964656 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:36.964712 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:36.965230 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:36.965240 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:36.967037 (+ 1797us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":114,"threads_started":1}
W20260807 08:40:36.967278 18983 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:36.961803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:43765 (local address 127.8.208.254:42413)
0807 08:40:36.962023 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:36.962028 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:36.962163 (+ 135us) server_negotiation.cc:407] Connection header received
0807 08:40:36.962319 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:36.962323 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:36.962380 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:36.962462 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:36.962919 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:36.963443 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:36.964331 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:36.964562 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:36.964636 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:36.967145 (+ 2509us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.195:43765: BlockingRecv error: recv got EOF from 127.8.208.195:43765 (error 108)
Metrics: {"server-negotiator.queue_time_us":100}
Aug 07 08:40:37 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:37 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:37.617842 18986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:37.609192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.193:56193)
0807 08:40:37.609470 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:37.609482 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:37.609585 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:37.609832 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:37.609834 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:37.610032 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:37.610126 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:37.610131 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:37.610825 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:37.610827 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:37.611315 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:37.611322 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:37.611749 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:37.611751 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:37.611807 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:37.615609 (+ 3802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:37.615620 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:37.617638 (+ 2018us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":113,"threads_started":1}
W20260807 08:40:37.617916 18987 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:37.609265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:56193 (local address 127.8.208.254:42413)
0807 08:40:37.609483 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:37.609486 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:37.609538 (+ 52us) server_negotiation.cc:407] Connection header received
0807 08:40:37.609665 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:37.609667 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:37.609710 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:37.609789 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:37.610226 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:37.610723 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:37.611405 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:37.611629 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:37.611728 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:37.617760 (+ 6032us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.193:56193: BlockingRecv error: recv got EOF from 127.8.208.193:56193 (error 108)
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":79,"threads_started":1}
Aug 07 08:40:37 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:37 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:37.793949 18988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:37.788512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.194:40795)
0807 08:40:37.788846 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:37.788859 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:37.788962 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:37.789179 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:37.789182 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:37.789360 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:37.789462 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:37.789467 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:37.790160 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:37.790162 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:37.790699 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:37.790706 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:37.791083 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:37.791086 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:37.791153 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:37.791753 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:37.791765 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:37.793750 (+ 1985us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":102,"threads_started":1}
W20260807 08:40:37.794035 18987 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:37.788639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:40795 (local address 127.8.208.254:42413)
0807 08:40:37.788774 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:37.788779 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:37.788941 (+ 162us) server_negotiation.cc:407] Connection header received
0807 08:40:37.789026 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:37.789028 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:37.789073 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:37.789136 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:37.789553 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:37.790068 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:37.790790 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:37.790994 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:37.791065 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:37.793935 (+ 2870us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.194:40795: BlockingRecv error: recv got EOF from 127.8.208.194:40795 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 07 08:40:37 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:37 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:37.973186 18989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:37.967887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.195:58785)
0807 08:40:37.968220 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:37.968235 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:37.968379 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:37.968664 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:37.968666 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:37.968877 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:37.968973 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:37.968978 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:37.969675 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:37.969680 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:37.970206 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:37.970214 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:37.970643 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:37.970648 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:37.970731 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:37.971190 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:37.971210 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:37.973057 (+ 1847us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":109,"threads_started":1}
W20260807 08:40:37.973368 18987 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:37.968000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:58785 (local address 127.8.208.254:42413)
0807 08:40:37.968170 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:37.968175 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:37.968312 (+ 137us) server_negotiation.cc:407] Connection header received
0807 08:40:37.968484 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:37.968489 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:37.968548 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:37.968643 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:37.969086 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:37.969568 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:37.970325 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:37.970533 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:37.970637 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:37.973253 (+ 2616us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.195:58785: BlockingRecv error: recv got EOF from 127.8.208.195:58785 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 07 08:40:38 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:38 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:38.623351 18990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:38.618556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.193:41391)
0807 08:40:38.618828 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:38.618840 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:38.618921 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:38.619099 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:38.619101 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:38.619271 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:38.619358 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:38.619362 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:38.620004 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:38.620006 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:38.620510 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:38.620517 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:38.620976 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:38.620979 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:38.621044 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:38.621521 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:38.621533 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:38.623245 (+ 1712us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":68,"threads_started":1}
W20260807 08:40:38.623498 18991 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:38.618616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:41391 (local address 127.8.208.254:42413)
0807 08:40:38.618863 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:38.618866 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:38.618881 (+ 15us) server_negotiation.cc:407] Connection header received
0807 08:40:38.618985 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:38.618986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:38.619025 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:38.619090 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:38.619465 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:38.619924 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:38.620601 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:38.620842 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:38.620934 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:38.623364 (+ 2430us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.193:41391: BlockingRecv error: recv got EOF from 127.8.208.193:41391 (error 108)
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":91,"threads_started":1}
Aug 07 08:40:38 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:38 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:38.800225 18992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:38.794690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.194:36587)
0807 08:40:38.794967 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:38.794981 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:38.795103 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:38.795340 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:38.795342 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:38.795531 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:38.795619 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:38.795624 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:38.796321 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:38.796325 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:38.797040 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:38.797049 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:38.797460 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:38.797464 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:38.797567 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:38.798143 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:38.798156 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:38.800060 (+ 1904us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":84,"threads_started":1}
W20260807 08:40:38.800266 18991 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:38.794822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:36587 (local address 127.8.208.254:42413)
0807 08:40:38.794959 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:38.794963 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:38.795055 (+ 92us) server_negotiation.cc:407] Connection header received
0807 08:40:38.795197 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:38.795200 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:38.795244 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:38.795313 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:38.795726 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:38.796212 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:38.797138 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:38.797339 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:38.797462 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:38.800177 (+ 2715us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.194:36587: BlockingRecv error: recv got EOF from 127.8.208.194:36587 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 07 08:40:38 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:38 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:38.984810 18993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:38.974028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.195:58589)
0807 08:40:38.974284 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:38.974297 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:38.974415 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:38.974649 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:38.974651 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:38.974839 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:38.974941 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:38.974946 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:38.975651 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:38.975653 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:38.976188 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:38.976195 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:38.976596 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:38.976599 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:38.976673 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:38.982799 (+ 6126us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:38.982810 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:38.984660 (+ 1850us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":94,"threads_started":1}
W20260807 08:40:38.984907 18991 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:38.974132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:58589 (local address 127.8.208.254:42413)
0807 08:40:38.974246 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:38.974249 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:38.974370 (+ 121us) server_negotiation.cc:407] Connection header received
0807 08:40:38.974487 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:38.974489 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:38.974545 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:38.974607 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:38.975036 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:38.975555 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:38.976296 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:38.976488 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:38.976551 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:38.984768 (+ 8217us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.195:58589: BlockingRecv error: recv got EOF from 127.8.208.195:58589 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 07 08:40:39 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:39 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:39.628811 18994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:39.624071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.193:34621)
0807 08:40:39.624321 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:39.624333 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:39.624451 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:39.624672 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:39.624674 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:39.624839 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:39.624930 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:39.624934 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:39.625551 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:39.625553 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:39.626044 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:39.626051 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:39.626413 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:39.626415 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:39.626471 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:39.626914 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:39.626924 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:39.628680 (+ 1756us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":94,"threads_started":1}
W20260807 08:40:39.628965 18995 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:39.624130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:34621 (local address 127.8.208.254:42413)
0807 08:40:39.624336 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:39.624339 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:39.624376 (+ 37us) server_negotiation.cc:407] Connection header received
0807 08:40:39.624532 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:39.624533 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:39.624574 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:39.624641 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:39.625011 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:39.625472 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:39.626123 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:39.626320 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:39.626386 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:39.628832 (+ 2446us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.193:34621: BlockingRecv error: recv got EOF from 127.8.208.193:34621 (error 108)
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":76,"threads_started":1}
Aug 07 08:40:39 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:39 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:39.805992 18996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:39.800905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.194:43425)
0807 08:40:39.801184 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:39.801195 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:39.801311 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:39.801573 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:39.801588 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:39.801840 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:39.801985 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:39.801992 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:39.802726 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:39.802729 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:39.803265 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:39.803273 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:39.803669 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:39.803672 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:39.803732 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:39.804199 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:39.804210 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:39.805887 (+ 1677us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":86,"threads_started":1}
W20260807 08:40:39.806231 18995 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:39.800955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:43425 (local address 127.8.208.254:42413)
0807 08:40:39.801111 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:39.801114 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:39.801258 (+ 144us) server_negotiation.cc:407] Connection header received
0807 08:40:39.801401 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:39.801403 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:39.801454 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:39.801535 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:39.802096 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:39.802613 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:39.803365 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:39.803580 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:39.803652 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:39.806012 (+ 2360us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.194:43425: BlockingRecv error: recv got EOF from 127.8.208.194:43425 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 07 08:40:39 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:39 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:39.990528 18997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:39.985492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.195:46087)
0807 08:40:39.985762 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:39.985776 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:39.985893 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:39.986109 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:39.986111 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:39.986295 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:39.986386 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:39.986391 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:39.987066 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:39.987068 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:39.987570 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:39.987576 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:39.987980 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:39.987983 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:39.988045 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:39.988581 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:39.988593 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:39.990368 (+ 1775us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":102,"threads_started":1}
W20260807 08:40:39.990612 18995 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:39.985532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:46087 (local address 127.8.208.254:42413)
0807 08:40:39.985682 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:39.985686 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:39.985856 (+ 170us) server_negotiation.cc:407] Connection header received
0807 08:40:39.985964 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:39.985965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:39.986011 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:39.986077 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:39.986490 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:39.986981 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:39.987676 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:39.987885 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:39.987959 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:39.990497 (+ 2538us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.195:46087: BlockingRecv error: recv got EOF from 127.8.208.195:46087 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 07 08:40:40 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:40 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:40.634586 18998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:40.629545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.193:40829)
0807 08:40:40.629796 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:40.629843 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:40.629939 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:40.630148 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:40.630150 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:40.630310 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:40.630412 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:40.630416 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:40.631107 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:40.631109 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:40.631591 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:40.631597 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:40.632182 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:40.632184 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:40.632238 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:40.632660 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:40.632670 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:40.634476 (+ 1806us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":86,"threads_started":1}
W20260807 08:40:40.634766 18999 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:40.629579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:40829 (local address 127.8.208.254:42413)
0807 08:40:40.629924 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:40.629927 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:40.629941 (+ 14us) server_negotiation.cc:407] Connection header received
0807 08:40:40.630002 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:40.630004 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:40.630045 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:40.630114 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:40.630507 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:40.631013 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:40.631850 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:40.632091 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:40.632169 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:40.634606 (+ 2437us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.193:40829: BlockingRecv error: recv got EOF from 127.8.208.193:40829 (error 108)
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":81,"threads_started":1}
Aug 07 08:40:40 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:40 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:40.811455 19000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:40.806696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.194:34813)
0807 08:40:40.806934 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:40.806954 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:40.807057 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:40.807258 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:40.807260 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:40.807432 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:40.807529 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:40.807534 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:40.808249 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:40.808252 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:40.808791 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:40.808797 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:40.809184 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:40.809186 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:40.809244 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:40.809697 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:40.809708 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:40.811350 (+ 1642us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":80,"threads_started":1}
W20260807 08:40:40.811652 18999 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:40.806738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:34813 (local address 127.8.208.254:42413)
0807 08:40:40.806865 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:40.806869 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:40.807015 (+ 146us) server_negotiation.cc:407] Connection header received
0807 08:40:40.807122 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:40.807124 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:40.807165 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:40.807228 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:40.807623 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:40.808161 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:40.808882 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:40.809097 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:40.809167 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:40.811480 (+ 2313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.194:34813: BlockingRecv error: recv got EOF from 127.8.208.194:34813 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 07 08:40:40 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:40 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:40.996361 19001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:40.991318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.195:48501)
0807 08:40:40.991614 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:40.991626 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:40.991767 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:40.992033 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:40.992036 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:40.992243 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:40.992333 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:40.992338 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:40.993064 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:40.993069 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:40.993548 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:40.993555 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:40.994069 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:40.994072 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:40.994159 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:40.994635 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:40.994645 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:40.996214 (+ 1569us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":113,"threads_started":1}
W20260807 08:40:40.996429 18999 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:40.991374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:48501 (local address 127.8.208.254:42413)
0807 08:40:40.991522 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:40.991526 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:40.991714 (+ 188us) server_negotiation.cc:407] Connection header received
0807 08:40:40.991861 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:40.991865 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:40.991927 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:40.992007 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:40.992451 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:40.992964 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:40.993655 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:40.993958 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:40.994054 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:40.996323 (+ 2269us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.195:48501: BlockingRecv error: recv got EOF from 127.8.208.195:48501 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 07 08:40:41 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:41 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:41.639971 19002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:41.635247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.193:40047)
0807 08:40:41.635517 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:41.635529 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:41.635616 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:41.635832 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:41.635834 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:41.636016 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:41.636102 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:41.636107 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:41.636745 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:41.636747 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:41.637249 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:41.637255 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:41.637607 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:41.637608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:41.637662 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:41.638152 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:41.638163 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:41.639857 (+ 1694us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":105,"threads_started":1}
W20260807 08:40:41.640111 19003 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:41.635311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:40047 (local address 127.8.208.254:42413)
0807 08:40:41.635526 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:41.635529 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:41.635573 (+ 44us) server_negotiation.cc:407] Connection header received
0807 08:40:41.635690 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:41.635692 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:41.635733 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:41.635799 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:41.636188 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:41.636650 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:41.637336 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:41.637525 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:41.637590 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:41.639988 (+ 2398us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.193:40047: BlockingRecv error: recv got EOF from 127.8.208.193:40047 (error 108)
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":83,"threads_started":1}
Aug 07 08:40:41 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:41 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:41.817842 19004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:41.812217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.194:55711)
0807 08:40:41.812494 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:41.812509 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:41.812607 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:41.812854 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:41.812856 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:41.813073 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:41.813168 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:41.813174 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:41.814271 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:41.814275 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:41.814932 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:41.814940 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:41.815342 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:41.815344 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:41.815407 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:41.815894 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:41.815906 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:41.817683 (+ 1777us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":84,"threads_started":1}
W20260807 08:40:41.818010 19003 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:41.812382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:55711 (local address 127.8.208.254:42413)
0807 08:40:41.812523 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:41.812527 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:41.812558 (+ 31us) server_negotiation.cc:407] Connection header received
0807 08:40:41.812684 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:41.812686 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:41.812730 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:41.812810 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:41.813310 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:41.814105 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:41.815035 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:41.815246 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:41.815328 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:41.817894 (+ 2566us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.194:55711: BlockingRecv error: recv got EOF from 127.8.208.194:55711 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 07 08:40:41 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:41 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:42.002756 19005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:41.997109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.195:51687)
0807 08:40:41.997380 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:41.997394 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:41.997548 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:41.997928 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:41.997932 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:41.998184 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:41.998299 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:41.998305 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:41.999268 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:41.999272 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:41.999814 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:41.999822 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:42.000295 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:42.000297 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:42.000356 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:42.000800 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:42.000811 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:42.002648 (+ 1837us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":87,"threads_started":1}
W20260807 08:40:42.002912 19003 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:41.997207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:51687 (local address 127.8.208.254:42413)
0807 08:40:41.997383 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:41.997389 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:41.997501 (+ 112us) server_negotiation.cc:407] Connection header received
0807 08:40:41.997671 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:41.997674 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:41.997753 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:41.997908 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:41.998455 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:41.999140 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:41.999931 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:42.000191 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:42.000301 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:42.002766 (+ 2465us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.195:51687: BlockingRecv error: recv got EOF from 127.8.208.195:51687 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 07 08:40:42 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:42 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:42.650489 19006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:42.640726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.193:58959)
0807 08:40:42.640969 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:42.640982 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:42.641065 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:42.641289 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:42.641290 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:42.641468 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:42.641559 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:42.641564 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:42.642285 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:42.642287 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:42.642817 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:42.642826 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:42.643209 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:42.643211 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:42.643268 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:42.648561 (+ 5293us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:42.648574 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:42.650365 (+ 1791us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":88,"threads_started":1}
W20260807 08:40:42.650650 19007 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:42.640823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:58959 (local address 127.8.208.254:42413)
0807 08:40:42.641107 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:42.641110 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:42.641120 (+ 10us) server_negotiation.cc:407] Connection header received
0807 08:40:42.641149 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:42.641151 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:42.641187 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:42.641254 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:42.641658 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:42.642195 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:42.642920 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:42.643120 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:42.643191 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:42.650507 (+ 7316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.193:58959: BlockingRecv error: recv got EOF from 127.8.208.193:58959 (error 108)
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":78,"threads_started":1}
Aug 07 08:40:42 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:42 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:42.823431 19008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:42.818684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.194:35331)
0807 08:40:42.819006 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:42.819019 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:42.819126 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:42.819347 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:42.819349 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:42.819554 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:42.819650 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:42.819655 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:42.820347 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:42.820349 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:42.820882 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:42.820887 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:42.821232 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:42.821234 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:42.821288 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:42.821712 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:42.821723 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:42.823305 (+ 1582us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":132,"threads_started":1}
W20260807 08:40:42.823558 19007 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:42.818737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:35331 (local address 127.8.208.254:42413)
0807 08:40:42.818860 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:42.818864 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:42.819102 (+ 238us) server_negotiation.cc:407] Connection header received
0807 08:40:42.819189 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:42.819191 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:42.819230 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:42.819311 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:42.819744 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:42.820256 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:42.820965 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:42.821145 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:42.821213 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:42.823454 (+ 2241us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.194:35331: BlockingRecv error: recv got EOF from 127.8.208.194:35331 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 07 08:40:43 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:43 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.195@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:43.008800 19009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:43.003417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.195:50975)
0807 08:40:43.003695 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:43.003709 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:43.003807 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:43.004042 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:43.004043 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:43.004222 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:43.004313 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:43.004317 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:43.005034 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:43.005037 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:43.005587 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:43.005596 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:43.006078 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:43.006082 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:43.006152 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:43.006620 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:43.006632 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:43.008627 (+ 1995us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":87,"threads_started":1}
W20260807 08:40:43.008857 19007 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:43.003533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:50975 (local address 127.8.208.254:42413)
0807 08:40:43.003706 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:43.003709 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:43.003775 (+ 66us) server_negotiation.cc:407] Connection header received
0807 08:40:43.003883 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:43.003885 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:43.003929 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:43.004004 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:43.004407 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:43.004918 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:43.005697 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:43.005953 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:43.006046 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:43.008746 (+ 2700us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.195:50975: BlockingRecv error: recv got EOF from 127.8.208.195:50975 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 07 08:40:43 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:43 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.193@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:43.656850 19010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:43.651503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.193:40537)
0807 08:40:43.651777 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:43.651789 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:43.651872 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:43.652153 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:43.652155 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:43.652332 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:43.652427 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:43.652431 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:43.653238 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:43.653241 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:43.653991 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:43.654000 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:43.654359 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:43.654361 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:43.654420 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:43.654961 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:43.654973 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:43.656751 (+ 1778us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":94,"threads_started":1}
W20260807 08:40:43.657008 19011 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:43.651565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:40537 (local address 127.8.208.254:42413)
0807 08:40:43.651794 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:43.651805 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:43.651834 (+ 29us) server_negotiation.cc:407] Connection header received
0807 08:40:43.651983 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:43.651985 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:43.652029 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:43.652118 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:43.652522 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:43.653138 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:43.654084 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:43.654277 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:43.654346 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:43.656861 (+ 2515us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.193:40537: BlockingRecv error: recv got EOF from 127.8.208.193:40537 (error 108)
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":69,"threads_started":1}
Aug 07 08:40:43 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 08:40:43 dist-test-slave-6nmv krb5kdc[17868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.208.194@KRBTEST.COM for oryx/127.8.208.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 08:40:43.829140 19012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:43.824356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:42413 (local address 127.8.208.194:36133)
0807 08:40:43.824608 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:43.824619 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:43.824703 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:43.824897 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:43.824899 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:43.825070 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:43.825157 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:43.825162 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:43.825786 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:43.825789 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:43.826326 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:43.826334 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:43.826697 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:43.826699 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:43.826751 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:43.827219 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:43.827230 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:43.829015 (+ 1785us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.208.254:42413: Server oryx/127.8.208.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":85,"threads_started":1}
W20260807 08:40:43.829282 19011 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:43.824403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:36133 (local address 127.8.208.254:42413)
0807 08:40:43.824562 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:43.824565 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:43.824700 (+ 135us) server_negotiation.cc:407] Connection header received
0807 08:40:43.824762 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:43.824764 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:43.824805 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:43.824864 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:43.825249 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:43.825706 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:43.826428 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:43.826613 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:43.826679 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:43.829153 (+ 2474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.208.194:36133: BlockingRecv error: recv got EOF from 127.8.208.194:36133 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 08:40:43.901757 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 18499
I20260807 08:40:43.911752 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 18670
I20260807 08:40:43.918867 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 18812
I20260807 08:40:43.925105 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 18421
2026-08-07T08:40:43Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17831 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-07T08:40:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:40:43Z Disabled control of system clock
I20260807 08:40:43.958114 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:40653
--webserver_interface=127.8.208.254
--webserver_port=0
--builtin_ntp_servers=127.8.208.212:40281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:40653
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 08:40:44.062849 19016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:44.063064 19016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:44.063094 19016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:44.066639 19016 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:40:44.066679 19016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:44.066692 19016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:44.066705 19016 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:40:44.066718 19016 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:40:44.071056 19016 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:40281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:40653
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:40653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19016
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:44.071965 19016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:44.073223 19016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:44.081473 19026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:44.081578 19016 server_base.cc:1034] running on GCE node
W20260807 08:40:44.081477 19023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:44.081491 19022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:44.082295 19016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:44.083338 19016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:44.084518 19016 hybrid_clock.cc:648] HybridClock initialized: now 1786092044084502 us; error 35 us; skew 500 ppm
I20260807 08:40:44.086154 19016 webserver.cc:460] Webserver started at http://127.8.208.254:35615/ using document root <none> and password file <none>
I20260807 08:40:44.086645 19016 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:44.086730 19016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:44.086930 19016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:44.088758 19016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "5f1b207cc08d46a091f16c586dfb3808"
format_stamp: "Formatted at 2026-08-07 08:40:44 on dist-test-slave-6nmv"
server_key: "84ea1562afe1dc92bf630286888a401e"
server_key_iv: "07db5ea6892b181ad9cec38468108ac6"
server_key_version: "encryptionkey@0"
I20260807 08:40:44.089318 19016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "5f1b207cc08d46a091f16c586dfb3808"
format_stamp: "Formatted at 2026-08-07 08:40:44 on dist-test-slave-6nmv"
server_key: "84ea1562afe1dc92bf630286888a401e"
server_key_iv: "07db5ea6892b181ad9cec38468108ac6"
server_key_version: "encryptionkey@0"
I20260807 08:40:44.092600 19016 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 08:40:44.094707 19033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:44.095763 19016 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:44.095886 19016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "5f1b207cc08d46a091f16c586dfb3808"
format_stamp: "Formatted at 2026-08-07 08:40:44 on dist-test-slave-6nmv"
server_key: "84ea1562afe1dc92bf630286888a401e"
server_key_iv: "07db5ea6892b181ad9cec38468108ac6"
server_key_version: "encryptionkey@0"
I20260807 08:40:44.095984 19016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:44.124884 19016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:44.125427 19016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:44.125588 19016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:44.132153 19016 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:40653
I20260807 08:40:44.132158 19088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:40653 every 8 connection(s)
I20260807 08:40:44.133016 19016 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:40:44.133383 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 19016
I20260807 08:40:44.133523 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:40:44.133831 9027 external_mini_cluster.cc:1428] Setting key aec03f4885cbf6b8954928aca2a06a34
I20260807 08:40:44.135980 19089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:44.141083 19089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f1b207cc08d46a091f16c586dfb3808: Bootstrap starting.
I20260807 08:40:44.142324 19092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:44.135175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33110 (local address 127.8.208.254:40653)
0807 08:40:44.135754 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:44.135766 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:44.135798 (+ 32us) server_negotiation.cc:407] Connection header received
0807 08:40:44.136420 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:44.136435 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:44.136779 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:44.137073 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:44.137442 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:44.138512 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:44.139411 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:44.139830 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:44.139989 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:44.140788 (+ 799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:44.140792 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:44.140803 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:40:44.141127 (+ 324us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:44.141226 (+ 99us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:40:44.141246 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:44.141342 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:44.141463 (+ 121us) server_negotiation.cc:299] Negotiation successful
0807 08:40:44.141696 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":138,"threads_started":1}
I20260807 08:40:44.143188 19089 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f1b207cc08d46a091f16c586dfb3808: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:44.143849 19089 log.cc:824] T 00000000000000000000000000000000 P 5f1b207cc08d46a091f16c586dfb3808: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:44.145457 19089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f1b207cc08d46a091f16c586dfb3808: No bootstrap required, opened a new log
I20260807 08:40:44.148732 19089 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f1b207cc08d46a091f16c586dfb3808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f1b207cc08d46a091f16c586dfb3808" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40653 } }
I20260807 08:40:44.148921 19089 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f1b207cc08d46a091f16c586dfb3808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:44.149000 19089 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f1b207cc08d46a091f16c586dfb3808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f1b207cc08d46a091f16c586dfb3808, State: Initialized, Role: FOLLOWER
I20260807 08:40:44.149461 19089 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f1b207cc08d46a091f16c586dfb3808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f1b207cc08d46a091f16c586dfb3808" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40653 } }
I20260807 08:40:44.149605 19089 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f1b207cc08d46a091f16c586dfb3808 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:40:44.149686 19089 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f1b207cc08d46a091f16c586dfb3808 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:40:44.149775 19089 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f1b207cc08d46a091f16c586dfb3808 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:44.150586 19089 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f1b207cc08d46a091f16c586dfb3808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f1b207cc08d46a091f16c586dfb3808" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40653 } }
I20260807 08:40:44.150899 19089 leader_election.cc:302] T 00000000000000000000000000000000 P 5f1b207cc08d46a091f16c586dfb3808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f1b207cc08d46a091f16c586dfb3808; no voters:
I20260807 08:40:44.151165 19089 leader_election.cc:288] T 00000000000000000000000000000000 P 5f1b207cc08d46a091f16c586dfb3808 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:40:44.151243 19094 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f1b207cc08d46a091f16c586dfb3808 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:44.151466 19094 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f1b207cc08d46a091f16c586dfb3808 [term 1 LEADER]: Becoming Leader. State: Replica: 5f1b207cc08d46a091f16c586dfb3808, State: Running, Role: LEADER
I20260807 08:40:44.151787 19094 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f1b207cc08d46a091f16c586dfb3808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f1b207cc08d46a091f16c586dfb3808" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40653 } }
I20260807 08:40:44.152209 19089 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f1b207cc08d46a091f16c586dfb3808 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:40:44.153270 19096 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f1b207cc08d46a091f16c586dfb3808 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f1b207cc08d46a091f16c586dfb3808. Latest consensus state: current_term: 1 leader_uuid: "5f1b207cc08d46a091f16c586dfb3808" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f1b207cc08d46a091f16c586dfb3808" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40653 } } }
I20260807 08:40:44.153386 19096 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f1b207cc08d46a091f16c586dfb3808 [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:44.153738 19103 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:40:44.153723 19095 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f1b207cc08d46a091f16c586dfb3808 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f1b207cc08d46a091f16c586dfb3808" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f1b207cc08d46a091f16c586dfb3808" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40653 } } }
I20260807 08:40:44.154330 19095 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f1b207cc08d46a091f16c586dfb3808 [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:44.156241 19103 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:40:44.161021 19103 catalog_manager.cc:1347] Generated new cluster ID: a1923d2703a44a87abd4b71d5a123033
I20260807 08:40:44.161082 19103 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:40:44.178915 19103 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:40:44.179950 19103 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:40:44.190953 19103 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f1b207cc08d46a091f16c586dfb3808: Generated new TSK 0
I20260807 08:40:44.191596 19103 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:40:44.195765 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:40653
--builtin_ntp_servers=127.8.208.212:40281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260807 08:40:44.298923 19115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:44.299155 19115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:44.299188 19115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:44.303064 19115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:44.303107 19115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:44.303151 19115 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:40:44.307439 19115 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:40281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:40653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19115
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:44.308303 19115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:44.309481 19115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:44.317901 19126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:44.317911 19122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:44.317910 19121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:44.317952 19115 server_base.cc:1034] running on GCE node
I20260807 08:40:44.318514 19115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:44.319028 19115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:44.320182 19115 hybrid_clock.cc:648] HybridClock initialized: now 1786092044320167 us; error 28 us; skew 500 ppm
I20260807 08:40:44.321743 19115 webserver.cc:460] Webserver started at http://127.8.208.193:34533/ using document root <none> and password file <none>
I20260807 08:40:44.322297 19115 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:44.322355 19115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:44.322584 19115 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:44.324326 19115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "47c9a6dcf24d417ea0a881f2257c215a"
format_stamp: "Formatted at 2026-08-07 08:40:44 on dist-test-slave-6nmv"
server_key: "ce024a492ce2017f256cfbd0547662ee"
server_key_iv: "f31aaedc3d32ccf444ab7b36e270e71a"
server_key_version: "encryptionkey@0"
I20260807 08:40:44.324795 19115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "47c9a6dcf24d417ea0a881f2257c215a"
format_stamp: "Formatted at 2026-08-07 08:40:44 on dist-test-slave-6nmv"
server_key: "ce024a492ce2017f256cfbd0547662ee"
server_key_iv: "f31aaedc3d32ccf444ab7b36e270e71a"
server_key_version: "encryptionkey@0"
I20260807 08:40:44.328029 19115 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 08:40:44.330251 19132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:44.331470 19115 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:40:44.331590 19115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "47c9a6dcf24d417ea0a881f2257c215a"
format_stamp: "Formatted at 2026-08-07 08:40:44 on dist-test-slave-6nmv"
server_key: "ce024a492ce2017f256cfbd0547662ee"
server_key_iv: "f31aaedc3d32ccf444ab7b36e270e71a"
server_key_version: "encryptionkey@0"
I20260807 08:40:44.331748 19115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:44.340456 19115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:44.340965 19115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:44.341122 19115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:44.341665 19115 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:44.342479 19115 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:44.342540 19115 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:44.342592 19115 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:44.342635 19115 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:44.350396 19115 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:37949
I20260807 08:40:44.350468 19253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:37949 every 8 connection(s)
I20260807 08:40:44.351152 19115 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:40:44.351765 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 19115
I20260807 08:40:44.351886 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
I20260807 08:40:44.352205 9027 external_mini_cluster.cc:1428] Setting key e428606306c82b550f46d1fa7e5c48c4
I20260807 08:40:44.354290 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:40653
--builtin_ntp_servers=127.8.208.212:40281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 08:40:44.362072 19092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:44.353072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:47565 (local address 127.8.208.254:40653)
0807 08:40:44.353209 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:44.353214 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:44.354588 (+ 1374us) server_negotiation.cc:407] Connection header received
0807 08:40:44.356422 (+ 1834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:44.356427 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:44.356490 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:44.356579 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:44.357465 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:44.358315 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:44.360100 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:44.360301 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:44.360374 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:44.361575 (+ 1201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:44.361578 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:44.361580 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:40:44.361591 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:44.361622 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:40:44.361629 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:44.361682 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:44.361898 (+ 216us) server_negotiation.cc:299] Negotiation successful
0807 08:40:44.361960 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 08:40:44.363124 19258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:44.353590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:40653 (local address 127.8.208.193:47565)
0807 08:40:44.354387 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:44.354489 (+ 102us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:44.356185 (+ 1696us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:44.356693 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:44.356699 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:44.356766 (+ 67us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:44.357298 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:44.357318 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:44.358502 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:44.358509 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:44.359961 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:44.359975 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:44.360454 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:44.360461 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:44.360675 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:44.361250 (+ 575us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 08:40:44.361254 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:44.361305 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 08:40:44.361385 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:44.361713 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:44.361724 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:44.361733 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 08:40:44.361898 (+ 165us) client_negotiation.cc:240] Negotiation successful
0807 08:40:44.362177 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":158,"threads_started":1}
I20260807 08:40:44.364282 19255 heartbeater.cc:347] Connected to a master server at 127.8.208.254:40653
I20260807 08:40:44.364490 19255 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:44.364918 19255 heartbeater.cc:511] Master 127.8.208.254:40653 requested a full tablet report, sending...
I20260807 08:40:44.366329 19050 ts_manager.cc:194] Registered new tserver with Master: 47c9a6dcf24d417ea0a881f2257c215a (127.8.208.193:37949)
I20260807 08:40:44.367419 19050 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.208.193:47565
W20260807 08:40:44.457142 19259 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:44.457353 19259 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:44.457386 19259 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:44.461215 19259 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:44.461259 19259 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:44.461349 19259 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:40:44.465677 19259 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:40281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:40653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19259
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:44.466598 19259 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:44.467816 19259 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:44.476967 19268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:44.477068 19259 server_base.cc:1034] running on GCE node
W20260807 08:40:44.476931 19266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:44.476999 19265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:44.477548 19259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:44.478209 19259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:44.479374 19259 hybrid_clock.cc:648] HybridClock initialized: now 1786092044479344 us; error 46 us; skew 500 ppm
I20260807 08:40:44.481259 19259 webserver.cc:460] Webserver started at http://127.8.208.194:35181/ using document root <none> and password file <none>
I20260807 08:40:44.481868 19259 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:44.481935 19259 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:44.482151 19259 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:44.484136 19259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "9f79d3c2cd5e49f6ae284ee89a4704ac"
format_stamp: "Formatted at 2026-08-07 08:40:44 on dist-test-slave-6nmv"
server_key: "0aa6d33a146cbca0f086b34b874994e5"
server_key_iv: "d3f9e7924c7375baa193bf14a877a57f"
server_key_version: "encryptionkey@0"
I20260807 08:40:44.484683 19259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "9f79d3c2cd5e49f6ae284ee89a4704ac"
format_stamp: "Formatted at 2026-08-07 08:40:44 on dist-test-slave-6nmv"
server_key: "0aa6d33a146cbca0f086b34b874994e5"
server_key_iv: "d3f9e7924c7375baa193bf14a877a57f"
server_key_version: "encryptionkey@0"
I20260807 08:40:44.488297 19259 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 08:40:44.490820 19274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:44.492055 19259 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:40:44.492168 19259 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "9f79d3c2cd5e49f6ae284ee89a4704ac"
format_stamp: "Formatted at 2026-08-07 08:40:44 on dist-test-slave-6nmv"
server_key: "0aa6d33a146cbca0f086b34b874994e5"
server_key_iv: "d3f9e7924c7375baa193bf14a877a57f"
server_key_version: "encryptionkey@0"
I20260807 08:40:44.492274 19259 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:44.507843 19259 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:44.508450 19259 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:44.508631 19259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:44.509166 19259 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:44.510151 19259 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:44.510197 19259 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:44.510260 19259 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:44.510301 19259 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:44.518440 19259 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:39447
I20260807 08:40:44.518489 19400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:39447 every 8 connection(s)
I20260807 08:40:44.519272 19259 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:40:44.521126 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 19259
I20260807 08:40:44.521234 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:40:44.521518 9027 external_mini_cluster.cc:1428] Setting key 208cf9103e46968adaac9961ad63becf
I20260807 08:40:44.523286 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:40653
--builtin_ntp_servers=127.8.208.212:40281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 08:40:44.528518 19092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:44.520734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:36455 (local address 127.8.208.254:40653)
0807 08:40:44.520888 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:44.520892 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:44.521981 (+ 1089us) server_negotiation.cc:407] Connection header received
0807 08:40:44.523340 (+ 1359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:44.523343 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:44.523400 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:44.523492 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:44.524231 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:44.524936 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:44.526449 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:44.526682 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:44.526759 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:44.528075 (+ 1316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:44.528078 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:44.528080 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:40:44.528091 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:44.528108 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:40:44.528116 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:44.528173 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:44.528355 (+ 182us) server_negotiation.cc:299] Negotiation successful
0807 08:40:44.528405 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 08:40:44.529657 19404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:44.521096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:40653 (local address 127.8.208.194:36455)
0807 08:40:44.521811 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:44.521880 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:44.523154 (+ 1274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:44.523636 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:44.523641 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:44.523720 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:44.524112 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:44.524121 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:44.525058 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:44.525063 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:44.526314 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:44.526327 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:44.526827 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:44.526833 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:44.527068 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:44.527768 (+ 700us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 08:40:44.527772 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:44.527824 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 08:40:44.527902 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:44.528204 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:44.528214 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:44.528221 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 08:40:44.528359 (+ 138us) client_negotiation.cc:240] Negotiation successful
0807 08:40:44.528648 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":177,"threads_started":1}
I20260807 08:40:44.530658 19402 heartbeater.cc:347] Connected to a master server at 127.8.208.254:40653
I20260807 08:40:44.530857 19402 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:44.531287 19402 heartbeater.cc:511] Master 127.8.208.254:40653 requested a full tablet report, sending...
I20260807 08:40:44.532183 19050 ts_manager.cc:194] Registered new tserver with Master: 9f79d3c2cd5e49f6ae284ee89a4704ac (127.8.208.194:39447)
I20260807 08:40:44.532720 19050 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.208.194:36455
W20260807 08:40:44.626410 19405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:44.626605 19405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:44.626634 19405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:44.630270 19405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:44.630307 19405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:44.630378 19405 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:40:44.634676 19405 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:40281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:40653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19405
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:44.635540 19405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:44.636706 19405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:44.645036 19410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:44.645036 19411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:44.645155 19405 server_base.cc:1034] running on GCE node
W20260807 08:40:44.645093 19413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:44.645644 19405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:44.646189 19405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:44.647338 19405 hybrid_clock.cc:648] HybridClock initialized: now 1786092044647321 us; error 28 us; skew 500 ppm
I20260807 08:40:44.649019 19405 webserver.cc:460] Webserver started at http://127.8.208.195:44881/ using document root <none> and password file <none>
I20260807 08:40:44.649566 19405 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:44.649617 19405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:44.649900 19405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:44.651634 19405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "5523bb1d7d2748ddbdbca9628419233e"
format_stamp: "Formatted at 2026-08-07 08:40:44 on dist-test-slave-6nmv"
server_key: "9036328826c8752de95c85a7c1dcdb46"
server_key_iv: "6ecdde1e24c5f2c0a71ebe79a5025276"
server_key_version: "encryptionkey@0"
I20260807 08:40:44.652223 19405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "5523bb1d7d2748ddbdbca9628419233e"
format_stamp: "Formatted at 2026-08-07 08:40:44 on dist-test-slave-6nmv"
server_key: "9036328826c8752de95c85a7c1dcdb46"
server_key_iv: "6ecdde1e24c5f2c0a71ebe79a5025276"
server_key_version: "encryptionkey@0"
I20260807 08:40:44.655751 19405 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260807 08:40:44.657874 19419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:44.658988 19405 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:44.659121 19405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "5523bb1d7d2748ddbdbca9628419233e"
format_stamp: "Formatted at 2026-08-07 08:40:44 on dist-test-slave-6nmv"
server_key: "9036328826c8752de95c85a7c1dcdb46"
server_key_iv: "6ecdde1e24c5f2c0a71ebe79a5025276"
server_key_version: "encryptionkey@0"
I20260807 08:40:44.659231 19405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:44.674296 19405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:44.674853 19405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:44.675037 19405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:44.675536 19405 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:44.676296 19405 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:44.676360 19405 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:44.676419 19405 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:44.676466 19405 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:44.684338 19405 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:35441
I20260807 08:40:44.684362 19542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:35441 every 8 connection(s)
I20260807 08:40:44.685073 19405 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:40:44.689668 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 19405
I20260807 08:40:44.689769 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:40:44.690102 9027 external_mini_cluster.cc:1428] Setting key ba1c18a20ce25f07c376af8debf6f16c
I20260807 08:40:44.693662 19092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:44.686690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:58879 (local address 127.8.208.254:40653)
0807 08:40:44.686821 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:44.686825 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:44.687693 (+ 868us) server_negotiation.cc:407] Connection header received
0807 08:40:44.688951 (+ 1258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:44.688954 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:44.689000 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:44.689072 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:44.690050 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:44.690655 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:44.691928 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:44.692163 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:44.692274 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:44.693187 (+ 913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:44.693190 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:44.693193 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:40:44.693203 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:44.693219 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:40:44.693227 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:44.693321 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:44.693477 (+ 156us) server_negotiation.cc:299] Negotiation successful
0807 08:40:44.693535 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 08:40:44.694401 19545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:44.687035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:40653 (local address 127.8.208.195:58879)
0807 08:40:44.687587 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:44.687621 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:44.688782 (+ 1161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:44.689229 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:44.689235 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:44.689318 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:44.689870 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:44.689906 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:44.690810 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:44.690815 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:44.691802 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:44.691812 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:44.692307 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:44.692311 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:44.692477 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:44.692967 (+ 490us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 08:40:44.692969 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:44.693007 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 08:40:44.693057 (+ 50us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:44.693322 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:44.693332 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:44.693339 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 08:40:44.693464 (+ 125us) client_negotiation.cc:240] Negotiation successful
0807 08:40:44.693689 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":100,"threads_started":1}
I20260807 08:40:44.695345 19543 heartbeater.cc:347] Connected to a master server at 127.8.208.254:40653
I20260807 08:40:44.695537 19543 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:44.696010 19543 heartbeater.cc:511] Master 127.8.208.254:40653 requested a full tablet report, sending...
I20260807 08:40:44.696848 19050 ts_manager.cc:194] Registered new tserver with Master: 5523bb1d7d2748ddbdbca9628419233e (127.8.208.195:35441)
I20260807 08:40:44.697322 19050 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.208.195:58879
I20260807 08:40:44.703493 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 08:40:44.705964 19092 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:44.705232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59034 (local address 127.8.208.254:40653)
0807 08:40:44.705366 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:44.705369 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:44.705446 (+ 77us) server_negotiation.cc:407] Connection header received
0807 08:40:44.705525 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:44.705527 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:44.705557 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:44.705612 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:44.705869 (+ 257us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59034: BlockingRecv error: recv got EOF from 127.0.0.1:59034 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 08:40:44.706151 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 19115
I20260807 08:40:44.714551 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 19259
I20260807 08:40:44.722060 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 19405
I20260807 08:40:44.727260 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 19016
2026-08-07T08:40:44Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (798 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-07T08:40:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:40:44Z Disabled control of system clock
I20260807 08:40:44.760390 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:35741
--webserver_interface=127.8.208.254
--webserver_port=0
--builtin_ntp_servers=127.8.208.212:35485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:35741
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 08:40:44.862517 19555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:44.862784 19555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:44.862856 19555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:44.866501 19555 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:40:44.866571 19555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:44.866600 19555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:44.866674 19555 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:40:44.866712 19555 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:40:44.870895 19555 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:35485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:35741
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:35741
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19555
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:44.871835 19555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:44.873139 19555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 08:40:44.881225 19555 server_base.cc:1034] running on GCE node
W20260807 08:40:44.881403 19560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:44.881430 19563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:44.881431 19561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:44.882105 19555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:44.883072 19555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:44.884245 19555 hybrid_clock.cc:648] HybridClock initialized: now 1786092044884221 us; error 35 us; skew 500 ppm
I20260807 08:40:44.886049 19555 webserver.cc:460] Webserver started at http://127.8.208.254:33327/ using document root <none> and password file <none>
I20260807 08:40:44.886531 19555 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:44.886590 19555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:44.886742 19555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:44.888569 19555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "bb1aad21025e4ba295d4785771011ffa"
format_stamp: "Formatted at 2026-08-07 08:40:44 on dist-test-slave-6nmv"
server_key: "4f51f83ddaf1dbf43ae6749b973638c7"
server_key_iv: "d82ae180f37c36cee509b711f92aa4a2"
server_key_version: "encryptionkey@0"
I20260807 08:40:44.889096 19555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "bb1aad21025e4ba295d4785771011ffa"
format_stamp: "Formatted at 2026-08-07 08:40:44 on dist-test-slave-6nmv"
server_key: "4f51f83ddaf1dbf43ae6749b973638c7"
server_key_iv: "d82ae180f37c36cee509b711f92aa4a2"
server_key_version: "encryptionkey@0"
I20260807 08:40:44.892568 19555 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 08:40:44.894757 19569 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:44.896067 19555 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:40:44.896171 19555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "bb1aad21025e4ba295d4785771011ffa"
format_stamp: "Formatted at 2026-08-07 08:40:44 on dist-test-slave-6nmv"
server_key: "4f51f83ddaf1dbf43ae6749b973638c7"
server_key_iv: "d82ae180f37c36cee509b711f92aa4a2"
server_key_version: "encryptionkey@0"
I20260807 08:40:44.896270 19555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:44.900386 19555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:44.900859 19555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:44.900986 19555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:44.907140 19555 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:35741
I20260807 08:40:44.907146 19627 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:35741 every 8 connection(s)
I20260807 08:40:44.907982 19555 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:40:44.910912 19628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:44.915629 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 19555
I20260807 08:40:44.915736 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:40:44.915733 19628 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb1aad21025e4ba295d4785771011ffa: Bootstrap starting.
I20260807 08:40:44.916014 9027 external_mini_cluster.cc:1428] Setting key 657bd217f0dbf1de10cc5eb1bd1c12ed
I20260807 08:40:44.918152 19628 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bb1aad21025e4ba295d4785771011ffa: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:44.918848 19628 log.cc:824] T 00000000000000000000000000000000 P bb1aad21025e4ba295d4785771011ffa: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:44.920681 19628 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb1aad21025e4ba295d4785771011ffa: No bootstrap required, opened a new log
I20260807 08:40:44.921424 19631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:44.917230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53330 (local address 127.8.208.254:35741)
0807 08:40:44.917920 (+ 690us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:44.917935 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:44.917968 (+ 33us) server_negotiation.cc:407] Connection header received
0807 08:40:44.918649 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:44.918666 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:44.919195 (+ 529us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:44.919528 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:44.920316 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:44.920320 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:44.920330 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:40:44.920339 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:44.920389 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:40:44.920403 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:44.920508 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:44.920593 (+ 85us) server_negotiation.cc:299] Negotiation successful
0807 08:40:44.920833 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":120,"threads_started":1}
I20260807 08:40:44.924219 19628 raft_consensus.cc:348] T 00000000000000000000000000000000 P bb1aad21025e4ba295d4785771011ffa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb1aad21025e4ba295d4785771011ffa" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35741 } }
I20260807 08:40:44.924393 19628 raft_consensus.cc:374] T 00000000000000000000000000000000 P bb1aad21025e4ba295d4785771011ffa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:44.924428 19628 raft_consensus.cc:729] T 00000000000000000000000000000000 P bb1aad21025e4ba295d4785771011ffa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb1aad21025e4ba295d4785771011ffa, State: Initialized, Role: FOLLOWER
I20260807 08:40:44.924826 19628 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb1aad21025e4ba295d4785771011ffa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb1aad21025e4ba295d4785771011ffa" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35741 } }
I20260807 08:40:44.924973 19628 raft_consensus.cc:388] T 00000000000000000000000000000000 P bb1aad21025e4ba295d4785771011ffa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:40:44.925040 19628 raft_consensus.cc:482] T 00000000000000000000000000000000 P bb1aad21025e4ba295d4785771011ffa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:40:44.925149 19628 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bb1aad21025e4ba295d4785771011ffa [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:44.925928 19628 raft_consensus.cc:504] T 00000000000000000000000000000000 P bb1aad21025e4ba295d4785771011ffa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb1aad21025e4ba295d4785771011ffa" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35741 } }
I20260807 08:40:44.926234 19628 leader_election.cc:302] T 00000000000000000000000000000000 P bb1aad21025e4ba295d4785771011ffa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bb1aad21025e4ba295d4785771011ffa; no voters:
I20260807 08:40:44.926496 19628 leader_election.cc:288] T 00000000000000000000000000000000 P bb1aad21025e4ba295d4785771011ffa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:40:44.926611 19633 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bb1aad21025e4ba295d4785771011ffa [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:44.926856 19633 raft_consensus.cc:686] T 00000000000000000000000000000000 P bb1aad21025e4ba295d4785771011ffa [term 1 LEADER]: Becoming Leader. State: Replica: bb1aad21025e4ba295d4785771011ffa, State: Running, Role: LEADER
I20260807 08:40:44.927134 19633 consensus_queue.cc:237] T 00000000000000000000000000000000 P bb1aad21025e4ba295d4785771011ffa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb1aad21025e4ba295d4785771011ffa" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35741 } }
I20260807 08:40:44.927578 19628 sys_catalog.cc:564] T 00000000000000000000000000000000 P bb1aad21025e4ba295d4785771011ffa [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:40:44.928793 19634 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb1aad21025e4ba295d4785771011ffa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bb1aad21025e4ba295d4785771011ffa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb1aad21025e4ba295d4785771011ffa" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35741 } } }
I20260807 08:40:44.928808 19635 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb1aad21025e4ba295d4785771011ffa [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb1aad21025e4ba295d4785771011ffa. Latest consensus state: current_term: 1 leader_uuid: "bb1aad21025e4ba295d4785771011ffa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb1aad21025e4ba295d4785771011ffa" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35741 } } }
I20260807 08:40:44.928965 19634 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb1aad21025e4ba295d4785771011ffa [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:44.928998 19635 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb1aad21025e4ba295d4785771011ffa [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:44.929382 19643 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:40:44.932268 19643 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:40:44.937104 19643 catalog_manager.cc:1347] Generated new cluster ID: 45f7d047c5f549efabc786e655f2d545
I20260807 08:40:44.937160 19643 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:40:44.945757 19643 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:40:44.946013 19643 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:40:44.954293 19643 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bb1aad21025e4ba295d4785771011ffa: Generated new TSK 0
I20260807 08:40:44.954828 19643 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:40:44.967729 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:35741
--builtin_ntp_servers=127.8.208.212:35485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 08:40:45.069593 19652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:45.069878 19652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:45.069973 19652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:45.073551 19652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:45.073616 19652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:45.073697 19652 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:40:45.077811 19652 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:35485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:35741
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19652
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:45.078776 19652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:45.080057 19652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:45.088413 19661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:45.088457 19659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:45.088421 19658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:45.088639 19652 server_base.cc:1034] running on GCE node
I20260807 08:40:45.089180 19652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:45.089746 19652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:45.090909 19652 hybrid_clock.cc:648] HybridClock initialized: now 1786092045090894 us; error 28 us; skew 500 ppm
I20260807 08:40:45.092573 19652 webserver.cc:460] Webserver started at http://127.8.208.193:33363/ using document root <none> and password file <none>
I20260807 08:40:45.093122 19652 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:45.093180 19652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:45.093402 19652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:45.095220 19652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "7d305c9fe1104914b0cea82761f3f653"
format_stamp: "Formatted at 2026-08-07 08:40:45 on dist-test-slave-6nmv"
server_key: "ecfda83e6172371a9b35ac485e0a59a1"
server_key_iv: "bada3fc2d42fef77447745c5c173b635"
server_key_version: "encryptionkey@0"
I20260807 08:40:45.095713 19652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "7d305c9fe1104914b0cea82761f3f653"
format_stamp: "Formatted at 2026-08-07 08:40:45 on dist-test-slave-6nmv"
server_key: "ecfda83e6172371a9b35ac485e0a59a1"
server_key_iv: "bada3fc2d42fef77447745c5c173b635"
server_key_version: "encryptionkey@0"
I20260807 08:40:45.098905 19652 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.002s
I20260807 08:40:45.101083 19670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:45.102180 19652 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:45.102301 19652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "7d305c9fe1104914b0cea82761f3f653"
format_stamp: "Formatted at 2026-08-07 08:40:45 on dist-test-slave-6nmv"
server_key: "ecfda83e6172371a9b35ac485e0a59a1"
server_key_iv: "bada3fc2d42fef77447745c5c173b635"
server_key_version: "encryptionkey@0"
I20260807 08:40:45.102427 19652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:45.106400 19652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:45.106913 19652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:45.107074 19652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:45.107542 19652 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:45.108349 19652 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:45.108428 19652 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:45.108493 19652 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:45.108536 19652 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:45.116119 19652 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:41821
I20260807 08:40:45.116153 19791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:41821 every 8 connection(s)
I20260807 08:40:45.116865 19652 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:40:45.122043 19631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:45.118467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:45311 (local address 127.8.208.254:35741)
0807 08:40:45.118629 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:45.118634 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:45.119556 (+ 922us) server_negotiation.cc:407] Connection header received
0807 08:40:45.120604 (+ 1048us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:45.120607 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:45.120643 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:45.120710 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:45.121644 (+ 934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:45.121646 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:45.121648 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:40:45.121658 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:45.121674 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:40:45.121681 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:45.121745 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:45.121917 (+ 172us) server_negotiation.cc:299] Negotiation successful
0807 08:40:45.121951 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 08:40:45.122732 19795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:45.118819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35741 (local address 127.8.208.193:45311)
0807 08:40:45.119428 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:45.119461 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:45.120432 (+ 971us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:45.120853 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:45.120858 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:45.120928 (+ 70us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:45.121432 (+ 504us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 08:40:45.121433 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:45.121467 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 08:40:45.121521 (+ 54us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:45.121747 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:45.121753 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:45.121756 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 08:40:45.121944 (+ 188us) client_negotiation.cc:240] Negotiation successful
0807 08:40:45.122096 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":111,"threads_started":1}
I20260807 08:40:45.123605 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 19652
I20260807 08:40:45.123680 19793 heartbeater.cc:347] Connected to a master server at 127.8.208.254:35741
I20260807 08:40:45.123728 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
I20260807 08:40:45.123867 19793 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:45.124032 9027 external_mini_cluster.cc:1428] Setting key c6d782144b581d30b11f86627420738b
I20260807 08:40:45.124250 19793 heartbeater.cc:511] Master 127.8.208.254:35741 requested a full tablet report, sending...
I20260807 08:40:45.125655 19586 ts_manager.cc:194] Registered new tserver with Master: 7d305c9fe1104914b0cea82761f3f653 (127.8.208.193:41821)
I20260807 08:40:45.125844 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:35741
--builtin_ntp_servers=127.8.208.212:35485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 08:40:45.230564 19796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:45.230775 19796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:45.230813 19796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:45.234717 19796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:45.234759 19796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:45.234807 19796 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:40:45.239032 19796 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:35485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:35741
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19796
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:45.239842 19796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:45.241036 19796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:45.249408 19801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:45.249351 19802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:45.249542 19796 server_base.cc:1034] running on GCE node
W20260807 08:40:45.249699 19804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:45.250056 19796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:45.250594 19796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:45.251765 19796 hybrid_clock.cc:648] HybridClock initialized: now 1786092045251748 us; error 26 us; skew 500 ppm
I20260807 08:40:45.253345 19796 webserver.cc:460] Webserver started at http://127.8.208.194:46499/ using document root <none> and password file <none>
I20260807 08:40:45.253907 19796 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:45.253991 19796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:45.254208 19796 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:45.256055 19796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "8e23b98d149c4f598215843fa8303f79"
format_stamp: "Formatted at 2026-08-07 08:40:45 on dist-test-slave-6nmv"
server_key: "b285131aa7f72d0b10de68c16499bb82"
server_key_iv: "b807b92377821e348889040a489399f0"
server_key_version: "encryptionkey@0"
I20260807 08:40:45.256577 19796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "8e23b98d149c4f598215843fa8303f79"
format_stamp: "Formatted at 2026-08-07 08:40:45 on dist-test-slave-6nmv"
server_key: "b285131aa7f72d0b10de68c16499bb82"
server_key_iv: "b807b92377821e348889040a489399f0"
server_key_version: "encryptionkey@0"
I20260807 08:40:45.259850 19796 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 08:40:45.262012 19811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:45.263003 19796 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:40:45.263118 19796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "8e23b98d149c4f598215843fa8303f79"
format_stamp: "Formatted at 2026-08-07 08:40:45 on dist-test-slave-6nmv"
server_key: "b285131aa7f72d0b10de68c16499bb82"
server_key_iv: "b807b92377821e348889040a489399f0"
server_key_version: "encryptionkey@0"
I20260807 08:40:45.263213 19796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:45.266969 19796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:45.267463 19796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:45.267632 19796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:45.268110 19796 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:45.268921 19796 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:45.268990 19796 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:45.269055 19796 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:45.269107 19796 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:45.277060 19796 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:34473
I20260807 08:40:45.277088 19935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:34473 every 8 connection(s)
I20260807 08:40:45.277803 19796 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:40:45.282089 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 19796
I20260807 08:40:45.282202 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:40:45.282478 9027 external_mini_cluster.cc:1428] Setting key 98af39308ddd07213af442eb4eb391a8
I20260807 08:40:45.283279 19631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:45.279373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:45573 (local address 127.8.208.254:35741)
0807 08:40:45.279519 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:45.279522 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:45.280390 (+ 868us) server_negotiation.cc:407] Connection header received
0807 08:40:45.281523 (+ 1133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:45.281526 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:45.281571 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:45.281665 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:45.282744 (+ 1079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:45.282748 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:45.282750 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:40:45.282778 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:45.282804 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:40:45.282827 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:45.282920 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:45.283080 (+ 160us) server_negotiation.cc:299] Negotiation successful
0807 08:40:45.283140 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 08:40:45.284157 19938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:45.279708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35741 (local address 127.8.208.194:45573)
0807 08:40:45.280262 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:45.280294 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:45.281324 (+ 1030us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:45.281801 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:45.281819 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:45.281908 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:45.282471 (+ 563us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 08:40:45.282473 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:45.282506 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 08:40:45.282592 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:45.282902 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:45.282909 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:45.282914 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 08:40:45.283087 (+ 173us) client_negotiation.cc:240] Negotiation successful
0807 08:40:45.283318 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":100,"threads_started":1}
I20260807 08:40:45.284637 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:35741
--builtin_ntp_servers=127.8.208.212:35485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 08:40:45.285125 19936 heartbeater.cc:347] Connected to a master server at 127.8.208.254:35741
I20260807 08:40:45.285307 19936 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:45.285641 19936 heartbeater.cc:511] Master 127.8.208.254:35741 requested a full tablet report, sending...
I20260807 08:40:45.286652 19586 ts_manager.cc:194] Registered new tserver with Master: 8e23b98d149c4f598215843fa8303f79 (127.8.208.194:34473)
W20260807 08:40:45.382604 19939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:45.382807 19939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:45.382838 19939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:45.386071 19939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:45.386102 19939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:45.386145 19939 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:40:45.390177 19939 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:35485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:35741
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19939
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:45.390875 19939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:45.391898 19939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:45.399974 19946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:45.400007 19948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:45.399988 19944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:45.400338 19939 server_base.cc:1034] running on GCE node
I20260807 08:40:45.400799 19939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:45.401324 19939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:45.402494 19939 hybrid_clock.cc:648] HybridClock initialized: now 1786092045402471 us; error 34 us; skew 500 ppm
I20260807 08:40:45.404026 19939 webserver.cc:460] Webserver started at http://127.8.208.195:41971/ using document root <none> and password file <none>
I20260807 08:40:45.404520 19939 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:45.404597 19939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:45.404774 19939 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:45.406515 19939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "515e4958d45c43f98f19af54c3346806"
format_stamp: "Formatted at 2026-08-07 08:40:45 on dist-test-slave-6nmv"
server_key: "30ef3f3c423694d71bb89b22d27eb3eb"
server_key_iv: "7d67a396a4365b385a247b8c21be9438"
server_key_version: "encryptionkey@0"
I20260807 08:40:45.406989 19939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "515e4958d45c43f98f19af54c3346806"
format_stamp: "Formatted at 2026-08-07 08:40:45 on dist-test-slave-6nmv"
server_key: "30ef3f3c423694d71bb89b22d27eb3eb"
server_key_iv: "7d67a396a4365b385a247b8c21be9438"
server_key_version: "encryptionkey@0"
I20260807 08:40:45.410151 19939 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 08:40:45.412258 19955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:45.413300 19939 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:45.413419 19939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "515e4958d45c43f98f19af54c3346806"
format_stamp: "Formatted at 2026-08-07 08:40:45 on dist-test-slave-6nmv"
server_key: "30ef3f3c423694d71bb89b22d27eb3eb"
server_key_iv: "7d67a396a4365b385a247b8c21be9438"
server_key_version: "encryptionkey@0"
I20260807 08:40:45.413514 19939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:45.417685 19939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:45.418254 19939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:45.418434 19939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:45.418918 19939 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:45.419684 19939 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:45.419744 19939 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:45.419797 19939 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:45.419847 19939 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:45.427291 19939 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:46391
I20260807 08:40:45.427306 20075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:46391 every 8 connection(s)
I20260807 08:40:45.428328 19939 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:40:45.430661 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 19939
I20260807 08:40:45.430774 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:40:45.431056 9027 external_mini_cluster.cc:1428] Setting key 1ac51516681cbefd3192b108f85499c1
I20260807 08:40:45.434176 19631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:45.429874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:48795 (local address 127.8.208.254:35741)
0807 08:40:45.430020 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:45.430023 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:45.431070 (+ 1047us) server_negotiation.cc:407] Connection header received
0807 08:40:45.432639 (+ 1569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:45.432643 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:45.432685 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:45.432798 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:45.433736 (+ 938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:45.433739 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:45.433741 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:40:45.433752 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:45.433773 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:40:45.433781 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:45.433937 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:45.434053 (+ 116us) server_negotiation.cc:299] Negotiation successful
0807 08:40:45.434087 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 08:40:45.434826 20078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:45.430194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35741 (local address 127.8.208.195:48795)
0807 08:40:45.430925 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:45.430974 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:45.432413 (+ 1439us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:45.432929 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:45.432934 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:45.433003 (+ 69us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:45.433530 (+ 527us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 08:40:45.433531 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:45.433562 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 08:40:45.433615 (+ 53us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:45.433944 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:45.433950 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:45.433954 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 08:40:45.434064 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 08:40:45.434210 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":156,"threads_started":1}
I20260807 08:40:45.435743 20076 heartbeater.cc:347] Connected to a master server at 127.8.208.254:35741
I20260807 08:40:45.435954 20076 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:45.436283 20076 heartbeater.cc:511] Master 127.8.208.254:35741 requested a full tablet report, sending...
I20260807 08:40:45.437119 19586 ts_manager.cc:194] Registered new tserver with Master: 515e4958d45c43f98f19af54c3346806 (127.8.208.195:46391)
I20260807 08:40:45.444659 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 08:40:45.447149 19631 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:40:45.446529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53340 (local address 127.8.208.254:35741)
0807 08:40:45.446636 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:45.446639 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:45.446787 (+ 148us) server_negotiation.cc:407] Connection header received
0807 08:40:45.446865 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:45.446867 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:45.446896 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:45.446950 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:45.447076 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53340: BlockingRecv error: recv got EOF from 127.0.0.1:53340 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 08:40:45.447345 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 19652
I20260807 08:40:45.454677 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 19796
I20260807 08:40:45.461526 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 19939
I20260807 08:40:45.467090 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 19555
2026-08-07T08:40:45Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (741 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:40:45 dist-test-slave-6nmv krb5kdc[20087](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:40:45 dist-test-slave-6nmv krb5kdc[20087](info): set up 2 sockets
Aug 07 08:40:45 dist-test-slave-6nmv krb5kdc[20087](info): commencing operation
krb5kdc: starting...
W20260807 08:40:46.474921 9027 mini_kdc.cc:121] Time spent starting KDC: real 0.986s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:40:46 dist-test-slave-6nmv krb5kdc[20087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:40:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:40:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:40:46.585678 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:46287
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:46287
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:46.684722 20100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:46.684911 20100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:46.684944 20100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:46.688323 20100 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:40:46.688366 20100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:46.688385 20100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:46.688400 20100 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:40:46.688416 20100 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:40:46.692878 20100 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:46287
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:46287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:46.693594 20100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:46.694396 20100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:46.701737 20106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:46.701759 20105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:46.701766 20108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:46.701915 20100 server_base.cc:1034] running on GCE node
I20260807 08:40:46.702476 20100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:46.703440 20100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:46.704595 20100 hybrid_clock.cc:648] HybridClock initialized: now 1786092046704575 us; error 37 us; skew 500 ppm
Aug 07 08:40:46 dist-test-slave-6nmv krb5kdc[20087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092046, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:46.707027 20100 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:40:46.707782 20100 webserver.cc:460] Webserver started at http://127.8.208.254:39245/ using document root <none> and password file <none>
I20260807 08:40:46.708267 20100 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:46.708357 20100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:46.708573 20100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:46.710435 20100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "e96fd78366ea4e82ace2f74d66a6b32d"
format_stamp: "Formatted at 2026-08-07 08:40:46 on dist-test-slave-6nmv"
server_key: "4975248c96fa852762cda0d300ee7be1"
server_key_iv: "d6c8cb343b5343c269cce738caf75bcd"
server_key_version: "encryptionkey@0"
I20260807 08:40:46.711005 20100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "e96fd78366ea4e82ace2f74d66a6b32d"
format_stamp: "Formatted at 2026-08-07 08:40:46 on dist-test-slave-6nmv"
server_key: "4975248c96fa852762cda0d300ee7be1"
server_key_iv: "d6c8cb343b5343c269cce738caf75bcd"
server_key_version: "encryptionkey@0"
I20260807 08:40:46.714329 20100 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 08:40:46.716372 20116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:46.717377 20100 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:46.717497 20100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "e96fd78366ea4e82ace2f74d66a6b32d"
format_stamp: "Formatted at 2026-08-07 08:40:46 on dist-test-slave-6nmv"
server_key: "4975248c96fa852762cda0d300ee7be1"
server_key_iv: "d6c8cb343b5343c269cce738caf75bcd"
server_key_version: "encryptionkey@0"
I20260807 08:40:46.717590 20100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:46.737145 20100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:46.739699 20100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:46.739874 20100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:46.746134 20100 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:46287
I20260807 08:40:46.746390 20175 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:46287 every 8 connection(s)
I20260807 08:40:46.746918 20100 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:40:46.749346 20176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:46.750517 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 20100
I20260807 08:40:46.750639 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:40:46.750896 9027 external_mini_cluster.cc:1428] Setting key 635f0ea6bcd0af0d48e78af92ac451cb
I20260807 08:40:46.755030 20176 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e96fd78366ea4e82ace2f74d66a6b32d: Bootstrap starting.
I20260807 08:40:46.757203 20176 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e96fd78366ea4e82ace2f74d66a6b32d: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:46.758054 20176 log.cc:824] T 00000000000000000000000000000000 P e96fd78366ea4e82ace2f74d66a6b32d: Log is configured to *not* fsync() on all Append() calls
Aug 07 08:40:46 dist-test-slave-6nmv krb5kdc[20087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:46.759936 20176 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e96fd78366ea4e82ace2f74d66a6b32d: No bootstrap required, opened a new log
I20260807 08:40:46.762984 20176 raft_consensus.cc:348] T 00000000000000000000000000000000 P e96fd78366ea4e82ace2f74d66a6b32d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e96fd78366ea4e82ace2f74d66a6b32d" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 46287 } }
I20260807 08:40:46.763226 20176 raft_consensus.cc:374] T 00000000000000000000000000000000 P e96fd78366ea4e82ace2f74d66a6b32d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:46.763315 20176 raft_consensus.cc:729] T 00000000000000000000000000000000 P e96fd78366ea4e82ace2f74d66a6b32d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e96fd78366ea4e82ace2f74d66a6b32d, State: Initialized, Role: FOLLOWER
I20260807 08:40:46.763721 20176 consensus_queue.cc:260] T 00000000000000000000000000000000 P e96fd78366ea4e82ace2f74d66a6b32d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e96fd78366ea4e82ace2f74d66a6b32d" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 46287 } }
I20260807 08:40:46.763845 20176 raft_consensus.cc:388] T 00000000000000000000000000000000 P e96fd78366ea4e82ace2f74d66a6b32d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:40:46.763926 20176 raft_consensus.cc:482] T 00000000000000000000000000000000 P e96fd78366ea4e82ace2f74d66a6b32d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:40:46.764009 20180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:46.752221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56504 (local address 127.8.208.254:46287)
0807 08:40:46.752655 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:46.752677 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:46.752708 (+ 31us) server_negotiation.cc:407] Connection header received
0807 08:40:46.753295 (+ 587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:46.753308 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:46.753592 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:46.753891 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:46.754720 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:46.755543 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:46.756608 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:46.756999 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:46.757106 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:46.759677 (+ 2571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:46.759682 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:46.759695 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:46.759720 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:46.761389 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:46.761838 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:46.761845 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:46.761850 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:46.761978 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:46.762241 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:46.762245 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:46.762246 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:46.762573 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:46.762766 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:46.762986 (+ 220us) server_negotiation.cc:299] Negotiation successful
0807 08:40:46.763266 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":182,"threads_started":1}
I20260807 08:40:46.764024 20176 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e96fd78366ea4e82ace2f74d66a6b32d [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:46.764828 20176 raft_consensus.cc:504] T 00000000000000000000000000000000 P e96fd78366ea4e82ace2f74d66a6b32d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e96fd78366ea4e82ace2f74d66a6b32d" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 46287 } }
I20260807 08:40:46.765156 20176 leader_election.cc:302] T 00000000000000000000000000000000 P e96fd78366ea4e82ace2f74d66a6b32d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e96fd78366ea4e82ace2f74d66a6b32d; no voters:
I20260807 08:40:46.765404 20176 leader_election.cc:288] T 00000000000000000000000000000000 P e96fd78366ea4e82ace2f74d66a6b32d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:40:46.765507 20182 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e96fd78366ea4e82ace2f74d66a6b32d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:46.765676 20182 raft_consensus.cc:686] T 00000000000000000000000000000000 P e96fd78366ea4e82ace2f74d66a6b32d [term 1 LEADER]: Becoming Leader. State: Replica: e96fd78366ea4e82ace2f74d66a6b32d, State: Running, Role: LEADER
I20260807 08:40:46.766010 20182 consensus_queue.cc:237] T 00000000000000000000000000000000 P e96fd78366ea4e82ace2f74d66a6b32d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e96fd78366ea4e82ace2f74d66a6b32d" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 46287 } }
I20260807 08:40:46.766469 20176 sys_catalog.cc:564] T 00000000000000000000000000000000 P e96fd78366ea4e82ace2f74d66a6b32d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:40:46.767351 20183 sys_catalog.cc:455] T 00000000000000000000000000000000 P e96fd78366ea4e82ace2f74d66a6b32d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e96fd78366ea4e82ace2f74d66a6b32d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e96fd78366ea4e82ace2f74d66a6b32d" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 46287 } } }
I20260807 08:40:46.767472 20183 sys_catalog.cc:458] T 00000000000000000000000000000000 P e96fd78366ea4e82ace2f74d66a6b32d [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:46.767830 20191 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:40:46.767797 20184 sys_catalog.cc:455] T 00000000000000000000000000000000 P e96fd78366ea4e82ace2f74d66a6b32d [sys.catalog]: SysCatalogTable state changed. Reason: New leader e96fd78366ea4e82ace2f74d66a6b32d. Latest consensus state: current_term: 1 leader_uuid: "e96fd78366ea4e82ace2f74d66a6b32d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e96fd78366ea4e82ace2f74d66a6b32d" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 46287 } } }
I20260807 08:40:46.767978 20184 sys_catalog.cc:458] T 00000000000000000000000000000000 P e96fd78366ea4e82ace2f74d66a6b32d [sys.catalog]: This master's current role is: LEADER
I20260807 08:40:46.770442 20191 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:40:46.776144 20191 catalog_manager.cc:1347] Generated new cluster ID: 00e709ed1d484f81bd67bca4f78357fe
I20260807 08:40:46.776218 20191 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:40:46.799798 20191 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:40:46.800690 20191 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:40:46.806671 20191 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e96fd78366ea4e82ace2f74d66a6b32d: Generated new TSK 0
I20260807 08:40:46.807300 20191 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.208.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
I20260807 08:40:46.844285 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:46287
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:46.946486 20205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:46.946674 20205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:46.946708 20205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:46.950263 20205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:46.950304 20205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:46.950351 20205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:40:46.954806 20205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:46287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20205
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:46.955543 20205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:46.956326 20205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:46.965509 20211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:46.965564 20205 server_base.cc:1034] running on GCE node
W20260807 08:40:46.965498 20210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:46.965453 20214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:46.966009 20205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:46.966547 20205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:46.967731 20205 hybrid_clock.cc:648] HybridClock initialized: now 1786092046967714 us; error 36 us; skew 500 ppm
Aug 07 08:40:46 dist-test-slave-6nmv krb5kdc[20087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092046, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:46.970330 20205 init.cc:377] Logged in from keytab as kudu/127.8.208.193@KRBTEST.COM (short username kudu)
I20260807 08:40:46.971006 20205 webserver.cc:460] Webserver started at http://127.8.208.193:35179/ using document root <none> and password file <none>
I20260807 08:40:46.971433 20205 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:46.971483 20205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:46.971629 20205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:46.973304 20205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "44386bbb2b2948809953b0cb489a4ba5"
format_stamp: "Formatted at 2026-08-07 08:40:46 on dist-test-slave-6nmv"
server_key: "b7dfb5522bf32d379a47cc97f686b1df"
server_key_iv: "29164fbfb0dbe147f2e1a07eb76e16c0"
server_key_version: "encryptionkey@0"
I20260807 08:40:46.973758 20205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "44386bbb2b2948809953b0cb489a4ba5"
format_stamp: "Formatted at 2026-08-07 08:40:46 on dist-test-slave-6nmv"
server_key: "b7dfb5522bf32d379a47cc97f686b1df"
server_key_iv: "29164fbfb0dbe147f2e1a07eb76e16c0"
server_key_version: "encryptionkey@0"
I20260807 08:40:46.977056 20205 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 08:40:46.979202 20223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:46.980258 20205 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 08:40:46.980392 20205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "44386bbb2b2948809953b0cb489a4ba5"
format_stamp: "Formatted at 2026-08-07 08:40:46 on dist-test-slave-6nmv"
server_key: "b7dfb5522bf32d379a47cc97f686b1df"
server_key_iv: "29164fbfb0dbe147f2e1a07eb76e16c0"
server_key_version: "encryptionkey@0"
I20260807 08:40:46.980499 20205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:47.006862 20205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:47.009895 20205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:47.010079 20205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:47.010557 20205 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:47.011279 20205 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:47.011344 20205 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:47.011412 20205 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:47.011451 20205 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:47.019639 20205 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:33167
I20260807 08:40:47.019675 20343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:33167 every 8 connection(s)
I20260807 08:40:47.020375 20205 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
Aug 07 08:40:47 dist-test-slave-6nmv krb5kdc[20087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092046, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:47.029735 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 20205
I20260807 08:40:47.029878 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
I20260807 08:40:47.030200 9027 external_mini_cluster.cc:1428] Setting key 9df59f7801d9071db06de6bddcac9bf5
I20260807 08:40:47.032387 20180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:47.021913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:48615 (local address 127.8.208.254:46287)
0807 08:40:47.022045 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:47.022050 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:47.022794 (+ 744us) server_negotiation.cc:407] Connection header received
0807 08:40:47.023864 (+ 1070us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:47.023867 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:47.023913 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:47.023981 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:47.024938 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.025394 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.026403 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.026608 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.026691 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:47.028698 (+ 2007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:47.028701 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:47.028703 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:47.028726 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:47.030092 (+ 1366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:47.030626 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:47.030632 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:47.030634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:47.030750 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:47.031137 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:47.031141 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:47.031144 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:47.031425 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:47.031547 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:47.032081 (+ 534us) server_negotiation.cc:299] Negotiation successful
0807 08:40:47.032220 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 08:40:47.033070 20347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:47.022283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:46287 (local address 127.8.208.193:48615)
0807 08:40:47.022669 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:47.022703 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:47.023694 (+ 991us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:47.024130 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:47.024137 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:47.024420 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:47.024814 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:47.024836 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.025491 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.025493 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:47.026288 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:47.026296 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.026728 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.026730 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:47.026848 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:47.027261 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:47.027275 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:47.028545 (+ 1270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:47.030220 (+ 1675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:47.030225 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:47.030238 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:47.030538 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:47.030857 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:47.030859 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:47.030861 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:47.031017 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:47.031615 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:47.031620 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:47.031859 (+ 239us) client_negotiation.cc:769] Sending connection context
0807 08:40:47.032035 (+ 176us) client_negotiation.cc:240] Negotiation successful
0807 08:40:47.032332 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":97,"threads_started":1}
I20260807 08:40:47.034121 20345 heartbeater.cc:347] Connected to a master server at 127.8.208.254:46287
I20260807 08:40:47.034330 20345 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:47.034723 20345 heartbeater.cc:511] Master 127.8.208.254:46287 requested a full tablet report, sending...
I20260807 08:40:47.035966 20135 ts_manager.cc:194] Registered new tserver with Master: 44386bbb2b2948809953b0cb489a4ba5 (127.8.208.193:33167)
I20260807 08:40:47.036969 20135 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.193@KRBTEST.COM'} at 127.8.208.193:48615
WARNING: no policy specified for kudu/127.8.208.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
I20260807 08:40:47.056583 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:46287
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:47.155196 20351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:47.155406 20351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:47.155445 20351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:47.159303 20351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:47.159349 20351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:47.159430 20351 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:40:47.164327 20351 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:46287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20351
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:47.165223 20351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:47.166123 20351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:47.175160 20359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:47.175139 20357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:47.175300 20351 server_base.cc:1034] running on GCE node
W20260807 08:40:47.175451 20356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:47.175873 20351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:47.176371 20351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:47.177518 20351 hybrid_clock.cc:648] HybridClock initialized: now 1786092047177494 us; error 37 us; skew 500 ppm
Aug 07 08:40:47 dist-test-slave-6nmv krb5kdc[20087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092047, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:47.180126 20351 init.cc:377] Logged in from keytab as kudu/127.8.208.194@KRBTEST.COM (short username kudu)
I20260807 08:40:47.180899 20351 webserver.cc:460] Webserver started at http://127.8.208.194:33259/ using document root <none> and password file <none>
I20260807 08:40:47.181417 20351 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:47.181480 20351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:47.181717 20351 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:47.183629 20351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "29f0ef1125874b65b4476cb12aebc7a3"
format_stamp: "Formatted at 2026-08-07 08:40:47 on dist-test-slave-6nmv"
server_key: "f70790a1b4a683d10ea82b30b98e9bed"
server_key_iv: "aaf51f45b16b17112e2e16aa5c564f27"
server_key_version: "encryptionkey@0"
I20260807 08:40:47.184181 20351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "29f0ef1125874b65b4476cb12aebc7a3"
format_stamp: "Formatted at 2026-08-07 08:40:47 on dist-test-slave-6nmv"
server_key: "f70790a1b4a683d10ea82b30b98e9bed"
server_key_iv: "aaf51f45b16b17112e2e16aa5c564f27"
server_key_version: "encryptionkey@0"
I20260807 08:40:47.187386 20351 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 08:40:47.189610 20366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:47.190789 20351 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:47.190899 20351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "29f0ef1125874b65b4476cb12aebc7a3"
format_stamp: "Formatted at 2026-08-07 08:40:47 on dist-test-slave-6nmv"
server_key: "f70790a1b4a683d10ea82b30b98e9bed"
server_key_iv: "aaf51f45b16b17112e2e16aa5c564f27"
server_key_version: "encryptionkey@0"
I20260807 08:40:47.190994 20351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:47.232676 20351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:47.235548 20351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:47.235744 20351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:47.236303 20351 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:47.237047 20351 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:47.237098 20351 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:47.237160 20351 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:47.237191 20351 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:47.245329 20351 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:35573
I20260807 08:40:47.245366 20485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:35573 every 8 connection(s)
I20260807 08:40:47.246096 20351 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:40:47.252166 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 20351
I20260807 08:40:47.252306 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:40:47.252596 9027 external_mini_cluster.cc:1428] Setting key dd2dba8b9e8ca9fb2482011a93a4b1c7
Aug 07 08:40:47 dist-test-slave-6nmv krb5kdc[20087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092047, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:47.259235 20180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:47.247619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:55051 (local address 127.8.208.254:46287)
0807 08:40:47.247744 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:47.247748 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:47.248498 (+ 750us) server_negotiation.cc:407] Connection header received
0807 08:40:47.249852 (+ 1354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:47.249855 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:47.249938 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:47.250027 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:47.251035 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.251525 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.252730 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.252990 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.253099 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:47.255549 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:47.255554 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:47.255560 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:47.255588 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:47.257193 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:47.257609 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:47.257614 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:47.257618 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:47.257707 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:47.258034 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:47.258040 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:47.258044 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:47.258299 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:47.258422 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:47.258875 (+ 453us) server_negotiation.cc:299] Negotiation successful
0807 08:40:47.259021 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 08:40:47.259971 20488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:47.247947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:46287 (local address 127.8.208.194:55051)
0807 08:40:47.248343 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:47.248394 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:47.249616 (+ 1222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:47.250181 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:47.250187 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:47.250510 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:47.250904 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:47.250915 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.251669 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.251673 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:47.252613 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:47.252623 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.253158 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.253163 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:47.253378 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:47.253956 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:47.253969 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:47.255389 (+ 1420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:47.257293 (+ 1904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:47.257297 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:47.257307 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:47.257529 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:47.257790 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:47.257792 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:47.257793 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:47.257952 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:47.258416 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:47.258420 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:47.258630 (+ 210us) client_negotiation.cc:769] Sending connection context
0807 08:40:47.258778 (+ 148us) client_negotiation.cc:240] Negotiation successful
0807 08:40:47.259130 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":95,"threads_started":1}
I20260807 08:40:47.261035 20486 heartbeater.cc:347] Connected to a master server at 127.8.208.254:46287
I20260807 08:40:47.261240 20486 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:47.261644 20486 heartbeater.cc:511] Master 127.8.208.254:46287 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.8.208.195@KRBTEST.COM; defaulting to no policy
I20260807 08:40:47.262645 20135 ts_manager.cc:194] Registered new tserver with Master: 29f0ef1125874b65b4476cb12aebc7a3 (127.8.208.194:35573)
I20260807 08:40:47.263247 20135 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.194@KRBTEST.COM'} at 127.8.208.194:55051
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
I20260807 08:40:47.280817 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:46287
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:40:47.381767 20493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:40:47.382076 20493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:40:47.382148 20493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:40:47.385550 20493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:40:47.385612 20493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:40:47.385682 20493 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:40:47.390326 20493 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:46287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20493
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:40:47.391119 20493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:40:47.391968 20493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:40:47.400231 20502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:40:47.400224 20499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:47.400321 20493 server_base.cc:1034] running on GCE node
W20260807 08:40:47.400225 20498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:40:47.400777 20493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:40:47.401302 20493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:40:47.402472 20493 hybrid_clock.cc:648] HybridClock initialized: now 1786092047402456 us; error 25 us; skew 500 ppm
Aug 07 08:40:47 dist-test-slave-6nmv krb5kdc[20087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092047, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:40:47.404963 20493 init.cc:377] Logged in from keytab as kudu/127.8.208.195@KRBTEST.COM (short username kudu)
I20260807 08:40:47.405650 20493 webserver.cc:460] Webserver started at http://127.8.208.195:42575/ using document root <none> and password file <none>
I20260807 08:40:47.406191 20493 fs_manager.cc:359] Metadata directory not provided
I20260807 08:40:47.406268 20493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:40:47.406459 20493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:40:47.408267 20493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "614a7492e6db4435ae2124104a22022c"
format_stamp: "Formatted at 2026-08-07 08:40:47 on dist-test-slave-6nmv"
server_key: "58944679aafb7ec545c98c91c6b70f35"
server_key_iv: "31e11e5231722162a84637207e7cd1de"
server_key_version: "encryptionkey@0"
I20260807 08:40:47.408927 20493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "614a7492e6db4435ae2124104a22022c"
format_stamp: "Formatted at 2026-08-07 08:40:47 on dist-test-slave-6nmv"
server_key: "58944679aafb7ec545c98c91c6b70f35"
server_key_iv: "31e11e5231722162a84637207e7cd1de"
server_key_version: "encryptionkey@0"
I20260807 08:40:47.412196 20493 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260807 08:40:47.414260 20509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:47.415251 20493 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:40:47.415369 20493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "614a7492e6db4435ae2124104a22022c"
format_stamp: "Formatted at 2026-08-07 08:40:47 on dist-test-slave-6nmv"
server_key: "58944679aafb7ec545c98c91c6b70f35"
server_key_iv: "31e11e5231722162a84637207e7cd1de"
server_key_version: "encryptionkey@0"
I20260807 08:40:47.415468 20493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:40:47.423540 20493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:40:47.426405 20493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:40:47.426584 20493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:40:47.427081 20493 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:40:47.427726 20493 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:40:47.427788 20493 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:47.427845 20493 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:40:47.427889 20493 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:40:47.435843 20493 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:45483
I20260807 08:40:47.435863 20633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:45483 every 8 connection(s)
I20260807 08:40:47.436576 20493 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
Aug 07 08:40:47 dist-test-slave-6nmv krb5kdc[20087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092047, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:40:47.446440 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 20493
I20260807 08:40:47.446578 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:40:47.446913 9027 external_mini_cluster.cc:1428] Setting key 72be6c5380d154ef6fe3a6bbec9d251f
I20260807 08:40:47.449185 20180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:47.438120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:40529 (local address 127.8.208.254:46287)
0807 08:40:47.438251 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:47.438255 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:47.438980 (+ 725us) server_negotiation.cc:407] Connection header received
0807 08:40:47.440186 (+ 1206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:47.440189 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:47.440245 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:47.440339 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:47.441354 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.441921 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.442922 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.443143 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.443239 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:47.445466 (+ 2227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:47.445469 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:47.445471 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:47.445493 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:47.446938 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:47.447515 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:47.447519 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:47.447520 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:47.447604 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:47.447986 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:47.447989 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:47.447990 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:47.448204 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:47.448318 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:47.448888 (+ 570us) server_negotiation.cc:299] Negotiation successful
0807 08:40:47.449009 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 08:40:47.449923 20639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:47.438434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:46287 (local address 127.8.208.195:40529)
0807 08:40:47.438845 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:47.438881 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:47.440000 (+ 1119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:47.440528 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:47.440534 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:47.440829 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:40:47.441221 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:47.441231 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.442026 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.442035 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:47.442800 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:47.442809 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.443269 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.443272 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:47.443433 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:47.443919 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:40:47.443933 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:40:47.445326 (+ 1393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:40:47.447071 (+ 1745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:47.447075 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:47.447084 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:47.447423 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:47.447698 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:40:47.447701 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:40:47.447703 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:40:47.447893 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:40:47.448343 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:40:47.448348 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:40:47.448622 (+ 274us) client_negotiation.cc:769] Sending connection context
0807 08:40:47.448820 (+ 198us) client_negotiation.cc:240] Negotiation successful
0807 08:40:47.449115 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":115,"threads_started":1}
I20260807 08:40:47.450922 20636 heartbeater.cc:347] Connected to a master server at 127.8.208.254:46287
I20260807 08:40:47.451155 20636 heartbeater.cc:464] Registering TS with master...
I20260807 08:40:47.451617 20636 heartbeater.cc:511] Master 127.8.208.254:46287 requested a full tablet report, sending...
I20260807 08:40:47.452553 20135 ts_manager.cc:194] Registered new tserver with Master: 614a7492e6db4435ae2124104a22022c (127.8.208.195:45483)
I20260807 08:40:47.453083 20135 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.195@KRBTEST.COM'} at 127.8.208.195:40529
I20260807 08:40:47.460412 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 08:40:47.468758 20180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:47.462161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56518 (local address 127.8.208.254:46287)
0807 08:40:47.462266 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:47.462269 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:47.462462 (+ 193us) server_negotiation.cc:407] Connection header received
0807 08:40:47.462531 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:47.462533 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:47.462565 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:47.462633 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:40:47.463226 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.463629 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.464380 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.464585 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.464655 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:47.465791 (+ 1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:40:47.465793 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:40:47.465795 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:40:47.465855 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:40:47.467345 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:47.467687 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:47.467689 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:47.467690 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:47.467758 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:40:47.467984 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:40:47.467986 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:40:47.467987 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:40:47.468210 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:40:47.468331 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:47.468529 (+ 198us) server_negotiation.cc:299] Negotiation successful
0807 08:40:47.468660 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 08:40:47.471235 20135 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56518:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 08:40:47.473989 20135 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:40:47.487329 20648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:47.481598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:45483 (local address 127.0.0.1:43826)
0807 08:40:47.482295 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:47.482339 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:47.482466 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:47.483135 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:47.483141 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:47.483164 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:47.483280 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:47.483285 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.484766 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.484768 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:47.485970 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:47.485980 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.486791 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.486794 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:47.486898 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:47.486963 (+ 65us) client_negotiation.cc:769] Sending connection context
0807 08:40:47.487060 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 08:40:47.487171 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"mutex_wait_us":40,"thread_start_us":73,"threads_started":1}
I20260807 08:40:47.487491 20650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:47.481767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43826 (local address 127.8.208.195:45483)
0807 08:40:47.482617 (+ 850us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:47.482628 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:47.482651 (+ 23us) server_negotiation.cc:407] Connection header received
0807 08:40:47.482718 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:47.482725 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:47.482943 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:47.483443 (+ 500us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:47.483573 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.484648 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.486097 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.486678 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.486756 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:47.486841 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:47.487262 (+ 421us) server_negotiation.cc:299] Negotiation successful
0807 08:40:47.487337 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":760,"thread_start_us":277,"threads_started":1}
I20260807 08:40:47.487659 20653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:47.482463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54842 (local address 127.8.208.193:33167)
0807 08:40:47.482788 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:47.482801 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:47.483218 (+ 417us) server_negotiation.cc:407] Connection header received
0807 08:40:47.483436 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:47.483441 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:47.483608 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:47.483756 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:47.484022 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.484985 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.486276 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.486809 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.486902 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:47.487042 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:47.487160 (+ 118us) server_negotiation.cc:299] Negotiation successful
0807 08:40:47.487253 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":113,"threads_started":1}
I20260807 08:40:47.487732 20651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:47.482052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:33167 (local address 127.0.0.1:54842)
0807 08:40:47.483139 (+ 1087us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:47.483150 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:47.483276 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:47.483783 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:47.483788 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:47.483811 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:47.483891 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:47.483896 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.485104 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.485109 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:47.486170 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:47.486179 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.486950 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.486954 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:47.487034 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:47.487055 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 08:40:47.487132 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 08:40:47.487194 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1025,"mutex_wait_us":30,"thread_start_us":114,"threads_started":1}
I20260807 08:40:47.488528 20652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:47.482331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48758 (local address 127.8.208.194:35573)
0807 08:40:47.482990 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:47.483003 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:47.483026 (+ 23us) server_negotiation.cc:407] Connection header received
0807 08:40:47.483101 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:47.483105 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:47.483289 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:47.483417 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:47.483576 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.484413 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.486933 (+ 2520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.487728 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.487841 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:47.487980 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:47.488277 (+ 297us) server_negotiation.cc:299] Negotiation successful
0807 08:40:47.488392 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":125,"threads_started":1}
I20260807 08:40:47.488888 20649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:47.481848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:35573 (local address 127.0.0.1:48758)
0807 08:40:47.482834 (+ 986us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:47.482849 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:47.482951 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:47.483396 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:47.483398 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:47.483411 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:47.483497 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:47.483503 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.484546 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.484550 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:47.485988 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:47.485993 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.488043 (+ 2050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.488047 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:47.488142 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:47.488157 (+ 15us) client_negotiation.cc:769] Sending connection context
0807 08:40:47.488236 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 08:40:47.488321 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":918,"mutex_wait_us":110,"thread_start_us":91,"threads_started":1}
I20260807 08:40:47.490407 20564 tablet_service.cc:1467] Processing CreateTablet for tablet 15f6025ee7c64459a07897039b2a851b (DEFAULT_TABLE table=test-table [id=7616a6ebdbec494c956fd6f5ca0f4a13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:47.490407 20273 tablet_service.cc:1467] Processing CreateTablet for tablet 15f6025ee7c64459a07897039b2a851b (DEFAULT_TABLE table=test-table [id=7616a6ebdbec494c956fd6f5ca0f4a13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:47.491421 20564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15f6025ee7c64459a07897039b2a851b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:47.491416 20273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15f6025ee7c64459a07897039b2a851b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:47.491287 20417 tablet_service.cc:1467] Processing CreateTablet for tablet 15f6025ee7c64459a07897039b2a851b (DEFAULT_TABLE table=test-table [id=7616a6ebdbec494c956fd6f5ca0f4a13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:40:47.492199 20417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15f6025ee7c64459a07897039b2a851b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:40:47.498011 20655 tablet_bootstrap.cc:492] T 15f6025ee7c64459a07897039b2a851b P 29f0ef1125874b65b4476cb12aebc7a3: Bootstrap starting.
I20260807 08:40:47.499182 20656 tablet_bootstrap.cc:492] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c: Bootstrap starting.
I20260807 08:40:47.500461 20655 tablet_bootstrap.cc:654] T 15f6025ee7c64459a07897039b2a851b P 29f0ef1125874b65b4476cb12aebc7a3: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:47.501171 20656 tablet_bootstrap.cc:654] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:47.501155 20655 log.cc:824] T 15f6025ee7c64459a07897039b2a851b P 29f0ef1125874b65b4476cb12aebc7a3: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:47.502012 20656 log.cc:824] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:47.502120 20657 tablet_bootstrap.cc:492] T 15f6025ee7c64459a07897039b2a851b P 44386bbb2b2948809953b0cb489a4ba5: Bootstrap starting.
I20260807 08:40:47.503712 20655 tablet_bootstrap.cc:492] T 15f6025ee7c64459a07897039b2a851b P 29f0ef1125874b65b4476cb12aebc7a3: No bootstrap required, opened a new log
I20260807 08:40:47.503842 20656 tablet_bootstrap.cc:492] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c: No bootstrap required, opened a new log
I20260807 08:40:47.503911 20655 ts_tablet_manager.cc:1397] T 15f6025ee7c64459a07897039b2a851b P 29f0ef1125874b65b4476cb12aebc7a3: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 08:40:47.504040 20656 ts_tablet_manager.cc:1397] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260807 08:40:47.504259 20657 tablet_bootstrap.cc:654] T 15f6025ee7c64459a07897039b2a851b P 44386bbb2b2948809953b0cb489a4ba5: Neither blocks nor log segments found. Creating new log.
I20260807 08:40:47.505470 20657 log.cc:824] T 15f6025ee7c64459a07897039b2a851b P 44386bbb2b2948809953b0cb489a4ba5: Log is configured to *not* fsync() on all Append() calls
I20260807 08:40:47.507007 20656 raft_consensus.cc:348] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614a7492e6db4435ae2124104a22022c" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 45483 } } peers { permanent_uuid: "29f0ef1125874b65b4476cb12aebc7a3" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 35573 } } peers { permanent_uuid: "44386bbb2b2948809953b0cb489a4ba5" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 33167 } }
I20260807 08:40:47.507222 20656 raft_consensus.cc:374] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:47.507292 20656 raft_consensus.cc:729] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614a7492e6db4435ae2124104a22022c, State: Initialized, Role: FOLLOWER
I20260807 08:40:47.507339 20657 tablet_bootstrap.cc:492] T 15f6025ee7c64459a07897039b2a851b P 44386bbb2b2948809953b0cb489a4ba5: No bootstrap required, opened a new log
I20260807 08:40:47.507517 20657 ts_tablet_manager.cc:1397] T 15f6025ee7c64459a07897039b2a851b P 44386bbb2b2948809953b0cb489a4ba5: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 08:40:47.507592 20655 raft_consensus.cc:348] T 15f6025ee7c64459a07897039b2a851b P 29f0ef1125874b65b4476cb12aebc7a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614a7492e6db4435ae2124104a22022c" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 45483 } } peers { permanent_uuid: "29f0ef1125874b65b4476cb12aebc7a3" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 35573 } } peers { permanent_uuid: "44386bbb2b2948809953b0cb489a4ba5" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 33167 } }
I20260807 08:40:47.507733 20656 consensus_queue.cc:260] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614a7492e6db4435ae2124104a22022c" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 45483 } } peers { permanent_uuid: "29f0ef1125874b65b4476cb12aebc7a3" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 35573 } } peers { permanent_uuid: "44386bbb2b2948809953b0cb489a4ba5" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 33167 } }
I20260807 08:40:47.507863 20655 raft_consensus.cc:374] T 15f6025ee7c64459a07897039b2a851b P 29f0ef1125874b65b4476cb12aebc7a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:47.507957 20655 raft_consensus.cc:729] T 15f6025ee7c64459a07897039b2a851b P 29f0ef1125874b65b4476cb12aebc7a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29f0ef1125874b65b4476cb12aebc7a3, State: Initialized, Role: FOLLOWER
I20260807 08:40:47.508307 20636 heartbeater.cc:503] Master 127.8.208.254:46287 was elected leader, sending a full tablet report...
I20260807 08:40:47.508481 20655 consensus_queue.cc:260] T 15f6025ee7c64459a07897039b2a851b P 29f0ef1125874b65b4476cb12aebc7a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614a7492e6db4435ae2124104a22022c" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 45483 } } peers { permanent_uuid: "29f0ef1125874b65b4476cb12aebc7a3" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 35573 } } peers { permanent_uuid: "44386bbb2b2948809953b0cb489a4ba5" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 33167 } }
I20260807 08:40:47.508652 20656 ts_tablet_manager.cc:1428] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c: Time spent starting tablet: real 0.005s user 0.004s sys 0.001s
I20260807 08:40:47.509204 20486 heartbeater.cc:503] Master 127.8.208.254:46287 was elected leader, sending a full tablet report...
I20260807 08:40:47.510102 20655 ts_tablet_manager.cc:1428] T 15f6025ee7c64459a07897039b2a851b P 29f0ef1125874b65b4476cb12aebc7a3: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 08:40:47.510911 20657 raft_consensus.cc:348] T 15f6025ee7c64459a07897039b2a851b P 44386bbb2b2948809953b0cb489a4ba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614a7492e6db4435ae2124104a22022c" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 45483 } } peers { permanent_uuid: "29f0ef1125874b65b4476cb12aebc7a3" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 35573 } } peers { permanent_uuid: "44386bbb2b2948809953b0cb489a4ba5" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 33167 } }
I20260807 08:40:47.511147 20657 raft_consensus.cc:374] T 15f6025ee7c64459a07897039b2a851b P 44386bbb2b2948809953b0cb489a4ba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:40:47.511236 20657 raft_consensus.cc:729] T 15f6025ee7c64459a07897039b2a851b P 44386bbb2b2948809953b0cb489a4ba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44386bbb2b2948809953b0cb489a4ba5, State: Initialized, Role: FOLLOWER
I20260807 08:40:47.511675 20657 consensus_queue.cc:260] T 15f6025ee7c64459a07897039b2a851b P 44386bbb2b2948809953b0cb489a4ba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614a7492e6db4435ae2124104a22022c" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 45483 } } peers { permanent_uuid: "29f0ef1125874b65b4476cb12aebc7a3" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 35573 } } peers { permanent_uuid: "44386bbb2b2948809953b0cb489a4ba5" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 33167 } }
I20260807 08:40:47.512321 20345 heartbeater.cc:503] Master 127.8.208.254:46287 was elected leader, sending a full tablet report...
I20260807 08:40:47.512562 20657 ts_tablet_manager.cc:1428] T 15f6025ee7c64459a07897039b2a851b P 44386bbb2b2948809953b0cb489a4ba5: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
W20260807 08:40:47.521348 20346 tablet.cc:2369] T 15f6025ee7c64459a07897039b2a851b P 44386bbb2b2948809953b0cb489a4ba5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 08:40:47.606323 20661 raft_consensus.cc:482] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:40:47.606698 20661 raft_consensus.cc:504] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614a7492e6db4435ae2124104a22022c" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 45483 } } peers { permanent_uuid: "29f0ef1125874b65b4476cb12aebc7a3" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 35573 } } peers { permanent_uuid: "44386bbb2b2948809953b0cb489a4ba5" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 33167 } }
I20260807 08:40:47.607818 20661 leader_election.cc:288] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29f0ef1125874b65b4476cb12aebc7a3 (127.8.208.194:35573), 44386bbb2b2948809953b0cb489a4ba5 (127.8.208.193:33167)
I20260807 08:40:47.612784 20653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:47.608227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:60581 (local address 127.8.208.193:33167)
0807 08:40:47.608364 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:47.608369 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:47.608408 (+ 39us) server_negotiation.cc:407] Connection header received
0807 08:40:47.608501 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:47.608507 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:47.608562 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:47.608633 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:47.608965 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.609790 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.611382 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.612048 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.612185 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:47.612239 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:47.612551 (+ 312us) server_negotiation.cc:299] Negotiation successful
0807 08:40:47.612650 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 08:40:47.612784 20652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:47.608205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:52765 (local address 127.8.208.194:35573)
0807 08:40:47.608351 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:47.608356 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:47.608557 (+ 201us) server_negotiation.cc:407] Connection header received
0807 08:40:47.608653 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:47.608656 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:47.608713 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:47.608806 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:40:47.609086 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.609801 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.611381 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.612052 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.612185 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:47.612239 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:47.612564 (+ 325us) server_negotiation.cc:299] Negotiation successful
0807 08:40:47.612649 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 08:40:47.612797 20639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:47.608020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:33167 (local address 127.8.208.195:60581)
0807 08:40:47.608201 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:47.608217 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:47.608330 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:47.608676 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:47.608678 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:47.608693 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:47.608835 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:47.608842 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.609926 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.609929 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:47.611251 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:47.611257 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.612180 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.612184 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:47.612366 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:47.612420 (+ 54us) client_negotiation.cc:769] Sending connection context
0807 08:40:47.612494 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 08:40:47.612649 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"mutex_wait_us":210}
I20260807 08:40:47.612804 20664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:47.608020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:35573 (local address 127.8.208.195:52765)
0807 08:40:47.608454 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:47.608468 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:40:47.608562 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:40:47.608832 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:40:47.608834 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:40:47.608850 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:40:47.608975 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:47.608981 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.609926 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.609929 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:47.611246 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:40:47.611257 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.612180 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.612184 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:40:47.612360 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:47.612416 (+ 56us) client_negotiation.cc:769] Sending connection context
0807 08:40:47.612494 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 08:40:47.612648 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"mutex_wait_us":232,"thread_start_us":114,"threads_started":1}
I20260807 08:40:47.613511 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15f6025ee7c64459a07897039b2a851b" candidate_uuid: "614a7492e6db4435ae2124104a22022c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44386bbb2b2948809953b0cb489a4ba5" is_pre_election: true
I20260807 08:40:47.613567 20437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15f6025ee7c64459a07897039b2a851b" candidate_uuid: "614a7492e6db4435ae2124104a22022c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29f0ef1125874b65b4476cb12aebc7a3" is_pre_election: true
I20260807 08:40:47.613785 20294 raft_consensus.cc:2454] T 15f6025ee7c64459a07897039b2a851b P 44386bbb2b2948809953b0cb489a4ba5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 614a7492e6db4435ae2124104a22022c in term 0.
I20260807 08:40:47.613947 20437 raft_consensus.cc:2454] T 15f6025ee7c64459a07897039b2a851b P 29f0ef1125874b65b4476cb12aebc7a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 614a7492e6db4435ae2124104a22022c in term 0.
I20260807 08:40:47.614302 20510 leader_election.cc:302] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44386bbb2b2948809953b0cb489a4ba5, 614a7492e6db4435ae2124104a22022c; no voters:
I20260807 08:40:47.614566 20661 raft_consensus.cc:2781] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:40:47.614660 20661 raft_consensus.cc:482] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:40:47.614718 20661 raft_consensus.cc:3037] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:47.615788 20661 raft_consensus.cc:504] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614a7492e6db4435ae2124104a22022c" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 45483 } } peers { permanent_uuid: "29f0ef1125874b65b4476cb12aebc7a3" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 35573 } } peers { permanent_uuid: "44386bbb2b2948809953b0cb489a4ba5" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 33167 } }
I20260807 08:40:47.616159 20661 leader_election.cc:288] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c [CANDIDATE]: Term 1 election: Requested vote from peers 29f0ef1125874b65b4476cb12aebc7a3 (127.8.208.194:35573), 44386bbb2b2948809953b0cb489a4ba5 (127.8.208.193:33167)
I20260807 08:40:47.616535 20294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15f6025ee7c64459a07897039b2a851b" candidate_uuid: "614a7492e6db4435ae2124104a22022c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44386bbb2b2948809953b0cb489a4ba5"
I20260807 08:40:47.616536 20437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15f6025ee7c64459a07897039b2a851b" candidate_uuid: "614a7492e6db4435ae2124104a22022c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29f0ef1125874b65b4476cb12aebc7a3"
I20260807 08:40:47.616658 20437 raft_consensus.cc:3037] T 15f6025ee7c64459a07897039b2a851b P 29f0ef1125874b65b4476cb12aebc7a3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:47.616658 20294 raft_consensus.cc:3037] T 15f6025ee7c64459a07897039b2a851b P 44386bbb2b2948809953b0cb489a4ba5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:40:47.617954 20437 raft_consensus.cc:2454] T 15f6025ee7c64459a07897039b2a851b P 29f0ef1125874b65b4476cb12aebc7a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 614a7492e6db4435ae2124104a22022c in term 1.
I20260807 08:40:47.617954 20294 raft_consensus.cc:2454] T 15f6025ee7c64459a07897039b2a851b P 44386bbb2b2948809953b0cb489a4ba5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 614a7492e6db4435ae2124104a22022c in term 1.
I20260807 08:40:47.618219 20510 leader_election.cc:302] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44386bbb2b2948809953b0cb489a4ba5, 614a7492e6db4435ae2124104a22022c; no voters:
I20260807 08:40:47.618463 20661 raft_consensus.cc:2781] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:40:47.618685 20661 raft_consensus.cc:686] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c [term 1 LEADER]: Becoming Leader. State: Replica: 614a7492e6db4435ae2124104a22022c, State: Running, Role: LEADER
I20260807 08:40:47.619009 20661 consensus_queue.cc:237] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614a7492e6db4435ae2124104a22022c" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 45483 } } peers { permanent_uuid: "29f0ef1125874b65b4476cb12aebc7a3" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 35573 } } peers { permanent_uuid: "44386bbb2b2948809953b0cb489a4ba5" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 33167 } }
I20260807 08:40:47.621935 20135 catalog_manager.cc:5495] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c reported cstate change: term changed from 0 to 1, leader changed from <none> to 614a7492e6db4435ae2124104a22022c (127.8.208.195). New cstate: current_term: 1 leader_uuid: "614a7492e6db4435ae2124104a22022c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614a7492e6db4435ae2124104a22022c" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 45483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29f0ef1125874b65b4476cb12aebc7a3" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44386bbb2b2948809953b0cb489a4ba5" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20260807 08:40:47.635161 20650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:47.632018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43836 (local address 127.8.208.195:45483)
0807 08:40:47.632118 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0807 08:40:47.632121 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:40:47.632196 (+ 75us) server_negotiation.cc:407] Connection header received
0807 08:40:47.632355 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:40:47.632358 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:40:47.632401 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:40:47.632494 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:40:47.632740 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.633164 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.633990 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:40:47.634171 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:40:47.634264 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:40:47.634532 (+ 268us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:40:47.634833 (+ 301us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:40:47.634955 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 08:40:47.634987 (+ 32us) server_negotiation.cc:299] Negotiation successful
0807 08:40:47.635029 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 08:40:47.639978 20437 raft_consensus.cc:1261] T 15f6025ee7c64459a07897039b2a851b P 29f0ef1125874b65b4476cb12aebc7a3 [term 1 FOLLOWER]: Refusing update from remote peer 614a7492e6db4435ae2124104a22022c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:40:47.639978 20294 raft_consensus.cc:1261] T 15f6025ee7c64459a07897039b2a851b P 44386bbb2b2948809953b0cb489a4ba5 [term 1 FOLLOWER]: Refusing update from remote peer 614a7492e6db4435ae2124104a22022c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:40:47.640564 20665 consensus_queue.cc:1035] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c [LEADER]: Connected to new peer: Peer: permanent_uuid: "44386bbb2b2948809953b0cb489a4ba5" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:40:47.640695 20661 consensus_queue.cc:1035] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29f0ef1125874b65b4476cb12aebc7a3" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:40:47.646761 20668 mvcc.cc:205] Tried to move back new op lower bound from 7315833027127578624 to 7315833027050422272. Current Snapshot: MvccSnapshot[applied={T|T < 7315833027127578624}]
I20260807 08:40:47.648557 20669 mvcc.cc:205] Tried to move back new op lower bound from 7315833027127578624 to 7315833027050422272. Current Snapshot: MvccSnapshot[applied={T|T < 7315833027127578624}]
I20260807 08:40:47.649078 20670 mvcc.cc:205] Tried to move back new op lower bound from 7315833027127578624 to 7315833027050422272. Current Snapshot: MvccSnapshot[applied={T|T < 7315833027127578624}]
I20260807 08:40:47.654773 20134 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56518:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:40:47.654913 20134 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56518:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:40:47.657120 20134 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e96fd78366ea4e82ace2f74d66a6b32d: Sending DeleteTablet for 3 replicas of tablet 15f6025ee7c64459a07897039b2a851b
I20260807 08:40:47.657846 20564 tablet_service.cc:1514] Processing DeleteTablet for tablet 15f6025ee7c64459a07897039b2a851b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:47 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:43826
I20260807 08:40:47.658022 20273 tablet_service.cc:1514] Processing DeleteTablet for tablet 15f6025ee7c64459a07897039b2a851b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:47 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:54842
I20260807 08:40:47.658344 20678 tablet_replica.cc:330] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c: stopping tablet replica
I20260807 08:40:47.658273 20417 tablet_service.cc:1514] Processing DeleteTablet for tablet 15f6025ee7c64459a07897039b2a851b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:40:47 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:48758
I20260807 08:40:47.658609 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 20205
I20260807 08:40:47.658645 20678 raft_consensus.cc:2229] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c [term 1 LEADER]: Raft consensus shutting down.
I20260807 08:40:47.658987 20678 raft_consensus.cc:2258] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:47.659673 20680 tablet_replica.cc:330] T 15f6025ee7c64459a07897039b2a851b P 29f0ef1125874b65b4476cb12aebc7a3: stopping tablet replica
I20260807 08:40:47.659991 20680 raft_consensus.cc:2229] T 15f6025ee7c64459a07897039b2a851b P 29f0ef1125874b65b4476cb12aebc7a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:40:47.660257 20680 raft_consensus.cc:2258] T 15f6025ee7c64459a07897039b2a851b P 29f0ef1125874b65b4476cb12aebc7a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:40:47.661578 20680 ts_tablet_manager.cc:1905] T 15f6025ee7c64459a07897039b2a851b P 29f0ef1125874b65b4476cb12aebc7a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:47.663103 20678 ts_tablet_manager.cc:1905] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:40:47.664274 20680 ts_tablet_manager.cc:1918] T 15f6025ee7c64459a07897039b2a851b P 29f0ef1125874b65b4476cb12aebc7a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:40:47.664390 20680 log.cc:1196] T 15f6025ee7c64459a07897039b2a851b P 29f0ef1125874b65b4476cb12aebc7a3: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-1/wal/wals/15f6025ee7c64459a07897039b2a851b
I20260807 08:40:47.664764 20680 ts_tablet_manager.cc:1939] T 15f6025ee7c64459a07897039b2a851b P 29f0ef1125874b65b4476cb12aebc7a3: Deleting consensus metadata
I20260807 08:40:47.665788 20678 ts_tablet_manager.cc:1918] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:40:47.665961 20678 log.cc:1196] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/15f6025ee7c64459a07897039b2a851b
I20260807 08:40:47.665992 20118 catalog_manager.cc:4841] TS 29f0ef1125874b65b4476cb12aebc7a3 (127.8.208.194:35573): tablet 15f6025ee7c64459a07897039b2a851b (table test-table [id=7616a6ebdbec494c956fd6f5ca0f4a13]) successfully deleted
I20260807 08:40:47.666317 20678 ts_tablet_manager.cc:1939] T 15f6025ee7c64459a07897039b2a851b P 614a7492e6db4435ae2124104a22022c: Deleting consensus metadata
I20260807 08:40:47.667263 20120 catalog_manager.cc:4841] TS 614a7492e6db4435ae2124104a22022c (127.8.208.195:45483): tablet 15f6025ee7c64459a07897039b2a851b (table test-table [id=7616a6ebdbec494c956fd6f5ca0f4a13]) successfully deleted
W20260807 08:40:47.678766 20117 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.208.193:33167 (error 108)
I20260807 08:40:47.678946 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 20351
I20260807 08:40:47.681767 20649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:40:47.681476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:33167 (local address 127.0.0.1:54856)
0807 08:40:47.681593 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0807 08:40:47.681667 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.193:33167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 08:40:47.682078 20117 catalog_manager.cc:4584] TS 44386bbb2b2948809953b0cb489a4ba5 (127.8.208.193:33167): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 15f6025ee7c64459a07897039b2a851b: Network error: Client connection negotiation failed: client connection to 127.8.208.193:33167: connect: Connection refused (error 111)
I20260807 08:40:47.686292 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 20493
I20260807 08:40:47.693993 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 20100
2026-08-07T08:40:47Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2227 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:40:47 dist-test-slave-6nmv krb5kdc[20684](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:40:47 dist-test-slave-6nmv krb5kdc[20684](info): set up 2 sockets
Aug 07 08:40:47 dist-test-slave-6nmv krb5kdc[20684](info): commencing operation
krb5kdc: starting...
W20260807 08:40:48.712194 9027 mini_kdc.cc:121] Time spent starting KDC: real 0.996s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:40:48 dist-test-slave-6nmv krb5kdc[20684](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092048, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:40:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:40:48Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.8.208.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.8.208.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.8.208.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/rangeradmin_127.8.208.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.8.208.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/rangeradmin_127.8.208.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.8.208.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.8.208.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.8.208.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/rangerlookup_127.8.208.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.8.208.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/rangerlookup_127.8.208.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.8.208.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.8.208.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.8.208.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/HTTP_127.8.208.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.8.208.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/HTTP_127.8.208.212@KRBTEST.COM.keytab.
I20260807 08:40:48.860832 9027 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task8uPgIu/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/postgres -l logfile start
2026-08-07 08:40:51.173 UTC [20717] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 08:40:51.173 UTC [20717] LOG: listening on IPv4 address "127.8.208.212", port 59949
2026-08-07 08:40:51.176 UTC [20717] LOG: listening on Unix socket "/tmp/.s.PGSQL.59949"
2026-08-07 08:40:51.212 UTC [20720] LOG: database system was shut down at 2026-08-07 08:40:49 UTC
2026-08-07 08:40:51.216 UTC [20717] LOG: database system is ready to accept connections
I20260807 08:40:52.143217 9027 mini_postgres.cc:96] Postgres bound to 59949
2026-08-07 08:40:52.152 UTC [20728] FATAL: database "slave" does not exist
127.8.208.212:59949 - accepting connections
I20260807 08:40:52.152818 9027 mini_ranger.cc:161] Starting Ranger...
I20260807 08:40:52.168608 9027 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 08:40:52.590834 9027 mini_ranger.cc:87] Created ranger Postgres database
I20260807 08:40:52.590927 9027 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ranger-admin
2026-08-07 08:40:52,896 [I] DB FLAVOR :POSTGRES
2026-08-07 08:40:52,896 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 08:40:52,896 [I] Checking connection..
2026-08-07 08:40:52,897 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:59949/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 08:40:53,128 [I] Checking connection passed.
2026-08-07 08:40:53,128 [I] --------- Verifying version history table ---------
2026-08-07 08:40:53,129 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:59949/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 08:40:53,358 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 08:40:53,358 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:59949/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 08:40:53,599 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 08:40:53,599 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 08:40:53,599 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:59949/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 08:40:53.831 UTC [20796] WARNING: there is no transaction in progress
2026-08-07 08:40:53,837 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 08:40:53,838 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:59949/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 08:40:54,059 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 08:40:54,059 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 08:40:54,059 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:59949/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 08:40:54,281 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:59949/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 08:40:54,509 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:59949/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-6nmv.c.gcp-upstream.internal','N') ;"
2026-08-07 08:40:54,728 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:59949/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 08:40:54,941 [I] Table x_portal_user does not exist in database ranger
2026-08-07 08:40:54,941 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:59949/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 08:40:55,188 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 08:40:55,188 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:59949/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 08:40:55,424 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:59949/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 08:40:55,635 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 08:40:55,635 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:59949/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 08:40:56.521 UTC [20911] WARNING: there is no transaction in progress
2026-08-07 08:40:56.536 UTC [20911] WARNING: there is no transaction in progress
2026-08-07 08:40:56.552 UTC [20911] WARNING: there is no transaction in progress
2026-08-07 08:40:56.566 UTC [20911] WARNING: there is no transaction in progress
2026-08-07 08:40:56.581 UTC [20911] WARNING: there is no transaction in progress
2026-08-07 08:40:56.600 UTC [20911] WARNING: there is no transaction in progress
2026-08-07 08:40:56.649 UTC [20911] WARNING: there is no transaction in progress
2026-08-07 08:40:56.655 UTC [20911] WARNING: there is no transaction in progress
2026-08-07 08:40:56.668 UTC [20911] WARNING: there is no transaction in progress
2026-08-07 08:40:56.678 UTC [20911] WARNING: there is no transaction in progress
2026-08-07 08:40:56.687 UTC [20911] WARNING: there is no transaction in progress
2026-08-07 08:40:56.700 UTC [20911] WARNING: there is no transaction in progress
2026-08-07 08:40:56.709 UTC [20911] WARNING: there is no transaction in progress
2026-08-07 08:40:56.714 UTC [20911] WARNING: there is no transaction in progress
2026-08-07 08:40:56.720 UTC [20911] WARNING: there is no transaction in progress
2026-08-07 08:40:56.726 UTC [20911] WARNING: there is no transaction in progress
2026-08-07 08:40:57,296 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 08:40:57,296 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:59949/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 08:40:57,528 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 08:40:57,528 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:59949/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 08:40:57,770 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 08:40:57,770 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:59949/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 08:40:58,013 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 08:40:58,014 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:59949/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 08:40:58,248 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:59949/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 08:40:58,477 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:59949/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-6nmv.c.gcp-upstream.internal';"
2026-08-07 08:40:58,696 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 08:40:58,696 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:59949/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 08:40:58,938 [I] DB_PATCHES have already been applied
I20260807 08:40:58.943861 9027 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ranger-admin:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task8uPgIu/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 08:40:58.943920 9027 mini_ranger.cc:193] Using host: 127.8.208.212
I20260807 08:40:58.947829 9027 mini_ranger.cc:227] Ranger admin URL: http://127.8.208.212:43933
Aug 07, 2026 8:40:59 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 8:40:59 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 8:40:59 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 8:40:59 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 8:40:59 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 8:40:59 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 8:40:59 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 08:41:00.034236 9027 mini_ranger.cc:160] Time spent starting Ranger: real 7.881s user 0.001s sys 0.010s
Aug 07, 2026 8:41:17 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 8:41:17 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 07, 2026 8:41:17 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 8:41:18 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 8:41:18 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 8:41:18 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 8:41:18 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 8:41:18 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 8:41:18 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 8:41:18 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 8:41:18 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 8:41:18 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 8:41:18 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 8:41:18 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 8:41:18 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 8:41:18 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 8:41:18 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 8:41:18 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 08:41:19.455351 9027 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.8.208.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.8.208.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.8.208.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/rangerkms_127.8.208.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.8.208.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/rangerkms_127.8.208.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.8.208.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.8.208.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.8.208.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/HTTP_127.8.208.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.8.208.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/HTTP_127.8.208.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 08:41:19 dist-test-slave-6nmv krb5kdc[20684](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092079, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 08:41:19.537367 9027 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 08:41:19.546746 9027 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 08:41:20.332844 9027 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 08:41:20.332981 9027 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ranger-kms
I20260807 08:41:20.333105 9027 mini_ranger_kms.cc:227] Using postgres at 127.8.208.212:59949
2026-08-07 08:41:20,550 [I] DB FLAVOR :POSTGRES
2026-08-07 08:41:20,550 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 08:41:20,550 [I] Checking connection
2026-08-07 08:41:20,550 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:59949/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 08:41:20,787 [I] connection success
2026-08-07 08:41:20,787 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 08:41:20,788 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 08:41:20,788 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:59949/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 08:41:21,042 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 08:41:21,043 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 08:41:21,043 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 08:41:21,043 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:59949/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 08:41:21,284 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 08:41:21.717283 9027 mini_ranger_kms.cc:310] Created kms service
I20260807 08:41:21.877139 9027 mini_ranger_kms.cc:326] Created kudu user
I20260807 08:41:21.920810 9027 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 08:41:21 dist-test-slave-6nmv krb5kdc[20684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092079, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.8.208.212@KRBTEST.COM
I20260807 08:41:22.317471 9027 mini_ranger_kms.cc:384] Added ranger policy
I20260807 08:41:22.317652 9027 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ranger-kms:/tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 08:41:22.317689 9027 mini_ranger_kms.cc:240] Using host: 127.8.208.212
I20260807 08:41:22.322913 9027 mini_ranger_kms.cc:276] Ranger KMS PID: 21102
I20260807 08:41:22.323040 9027 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.8.208.212:57285
Aug 07, 2026 8:41:23 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 8:41:23 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 8:41:23 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 8:41:23 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 8:41:23 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 8:41:23 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 08:41:24 dist-test-slave-6nmv krb5kdc[20684](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786092084, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.208.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:41:24.595431 9027 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.058s user 0.006s sys 0.196s
I20260807 08:41:24.595580 9027 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 08:41:24.595695 9027 mini_ranger_kms.cc:401] 127.8.208.212:57285/kms/v1/keys
Aug 07 08:41:24 dist-test-slave-6nmv krb5kdc[20684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092084, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.208.212@KRBTEST.COM for HTTP/127.8.208.212@KRBTEST.COM
Aug 07 08:41:25 dist-test-slave-6nmv krb5kdc[20684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092084, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.208.212@KRBTEST.COM for HTTP/127.8.208.212@KRBTEST.COM
Aug 07 08:41:27 dist-test-slave-6nmv krb5kdc[20684](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092087, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:41:27.288844 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:37543
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:37839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:37543
--ranger_config_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.208.212:57285/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:41:27.399196 21159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:41:27.399463 21159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:41:27.399500 21159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:41:27.403402 21159 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:41:27.403453 21159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:41:27.403470 21159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:41:27.403486 21159 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:41:27.403499 21159 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:41:27.408557 21159 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:37839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/master-0/wal
--ranger_kms_url=127.8.208.212:57285/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:37543
--ranger_config_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:37543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:41:27.409483 21159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:41:27.410452 21159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:41:27.418995 21166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:41:27.419166 21159 server_base.cc:1034] running on GCE node
W20260807 08:41:27.419209 21165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:41:27.419030 21168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:41:27.419818 21159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:41:27.420791 21159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:41:27.421967 21159 hybrid_clock.cc:648] HybridClock initialized: now 1786092087421952 us; error 31 us; skew 500 ppm
Aug 07 08:41:27 dist-test-slave-6nmv krb5kdc[20684](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092087, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:41:27.428794 21159 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:41:27.429776 21159 webserver.cc:460] Webserver started at http://127.8.208.254:43839/ using document root <none> and password file <none>
I20260807 08:41:27.430357 21159 fs_manager.cc:359] Metadata directory not provided
I20260807 08:41:27.430464 21159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:41:27.430666 21159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 08:41:27 dist-test-slave-6nmv krb5kdc[20684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092087, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for HTTP/127.8.208.212@KRBTEST.COM
I20260807 08:41:27.491073 21159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "1fd63ddfca5742cd82320d46af31da61"
format_stamp: "Formatted at 2026-08-07 08:41:27 on dist-test-slave-6nmv"
server_key: "24877c73e646fd904832de5d0014d61a"
server_key_iv: "c2388fd67db339189e3cc7dc9f2bf8b8"
server_key_version: "kuduclusterkey@0"
I20260807 08:41:27.491811 21159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "1fd63ddfca5742cd82320d46af31da61"
format_stamp: "Formatted at 2026-08-07 08:41:27 on dist-test-slave-6nmv"
server_key: "24877c73e646fd904832de5d0014d61a"
server_key_iv: "c2388fd67db339189e3cc7dc9f2bf8b8"
server_key_version: "kuduclusterkey@0"
I20260807 08:41:27.496038 21159 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 08:41:27.512450 21175 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:41:27.514062 21159 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 08:41:27.514197 21159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "1fd63ddfca5742cd82320d46af31da61"
format_stamp: "Formatted at 2026-08-07 08:41:27 on dist-test-slave-6nmv"
server_key: "24877c73e646fd904832de5d0014d61a"
server_key_iv: "c2388fd67db339189e3cc7dc9f2bf8b8"
server_key_version: "kuduclusterkey@0"
I20260807 08:41:27.514326 21159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:41:27.534514 21159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:41:27.537904 21159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:41:27.538125 21159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:41:27.546448 21159 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:37543
I20260807 08:41:27.546478 21230 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:37543 every 8 connection(s)
I20260807 08:41:27.547420 21159 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:41:27.550707 21231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:41:27.556547 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 21159
I20260807 08:41:27.556715 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:41:27.557067 9027 external_mini_cluster.cc:1428] Setting key 0ead5659cc6cd7ba6218f4772a3efc30
I20260807 08:41:27.557718 21231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fd63ddfca5742cd82320d46af31da61: Bootstrap starting.
I20260807 08:41:27.560496 21231 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1fd63ddfca5742cd82320d46af31da61: Neither blocks nor log segments found. Creating new log.
I20260807 08:41:27.561410 21231 log.cc:824] T 00000000000000000000000000000000 P 1fd63ddfca5742cd82320d46af31da61: Log is configured to *not* fsync() on all Append() calls
I20260807 08:41:27.563741 21231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fd63ddfca5742cd82320d46af31da61: No bootstrap required, opened a new log
Aug 07 08:41:27 dist-test-slave-6nmv krb5kdc[20684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092087, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:41:27.568146 21231 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1fd63ddfca5742cd82320d46af31da61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fd63ddfca5742cd82320d46af31da61" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 37543 } }
I20260807 08:41:27.568399 21231 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1fd63ddfca5742cd82320d46af31da61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:41:27.568487 21231 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1fd63ddfca5742cd82320d46af31da61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fd63ddfca5742cd82320d46af31da61, State: Initialized, Role: FOLLOWER
I20260807 08:41:27.568991 21231 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1fd63ddfca5742cd82320d46af31da61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fd63ddfca5742cd82320d46af31da61" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 37543 } }
I20260807 08:41:27.569137 21231 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1fd63ddfca5742cd82320d46af31da61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:41:27.569221 21231 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1fd63ddfca5742cd82320d46af31da61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:41:27.569316 21231 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1fd63ddfca5742cd82320d46af31da61 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:41:27.570348 21231 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1fd63ddfca5742cd82320d46af31da61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fd63ddfca5742cd82320d46af31da61" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 37543 } }
I20260807 08:41:27.570726 21231 leader_election.cc:302] T 00000000000000000000000000000000 P 1fd63ddfca5742cd82320d46af31da61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1fd63ddfca5742cd82320d46af31da61; no voters:
I20260807 08:41:27.571077 21231 leader_election.cc:288] T 00000000000000000000000000000000 P 1fd63ddfca5742cd82320d46af31da61 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:41:27.571195 21236 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1fd63ddfca5742cd82320d46af31da61 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:41:27.571530 21236 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1fd63ddfca5742cd82320d46af31da61 [term 1 LEADER]: Becoming Leader. State: Replica: 1fd63ddfca5742cd82320d46af31da61, State: Running, Role: LEADER
I20260807 08:41:27.571966 21236 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1fd63ddfca5742cd82320d46af31da61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fd63ddfca5742cd82320d46af31da61" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 37543 } }
I20260807 08:41:27.572427 21231 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1fd63ddfca5742cd82320d46af31da61 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:41:27.573387 21236 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fd63ddfca5742cd82320d46af31da61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1fd63ddfca5742cd82320d46af31da61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fd63ddfca5742cd82320d46af31da61" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 37543 } } }
I20260807 08:41:27.573608 21236 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fd63ddfca5742cd82320d46af31da61 [sys.catalog]: This master's current role is: LEADER
I20260807 08:41:27.573971 21236 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fd63ddfca5742cd82320d46af31da61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1fd63ddfca5742cd82320d46af31da61. Latest consensus state: current_term: 1 leader_uuid: "1fd63ddfca5742cd82320d46af31da61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fd63ddfca5742cd82320d46af31da61" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 37543 } } }
I20260807 08:41:27.574139 21236 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fd63ddfca5742cd82320d46af31da61 [sys.catalog]: This master's current role is: LEADER
I20260807 08:41:27.574414 21234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:41:27.558701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49860 (local address 127.8.208.254:37543)
0807 08:41:27.559163 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0807 08:41:27.559181 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 08:41:27.559219 (+ 38us) server_negotiation.cc:407] Connection header received
0807 08:41:27.559947 (+ 728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:41:27.559965 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:41:27.560310 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:41:27.560663 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:41:27.561576 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:41:27.562940 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:41:27.563972 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:41:27.564472 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:41:27.564668 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:41:27.567646 (+ 2978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:41:27.567652 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:41:27.567665 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:41:27.567694 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:41:27.569965 (+ 2271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:41:27.570480 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:41:27.570488 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:41:27.570494 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:41:27.570653 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:41:27.571045 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:41:27.571051 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:41:27.571054 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:41:27.571728 (+ 674us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:41:27.572770 (+ 1042us) server_negotiation.cc:1035] Waiting for connection context
0807 08:41:27.572949 (+ 179us) server_negotiation.cc:299] Negotiation successful
0807 08:41:27.573263 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":151,"threads_started":1}
I20260807 08:41:27.574873 21231 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 08:41:27.579408 21246 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:41:27.584384 21246 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:41:27.591820 21246 catalog_manager.cc:1347] Generated new cluster ID: 9785e4e5697c420383789da8a9fe8d92
I20260807 08:41:27.591889 21246 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:41:27.603461 21246 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:41:27.604856 21246 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:41:27.622124 21246 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1fd63ddfca5742cd82320d46af31da61: Generated new TSK 0
I20260807 08:41:27.623067 21246 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.208.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
I20260807 08:41:28.281306 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.208.212:57285/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:37543
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:37839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:41:28.397186 21281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:41:28.397531 21281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:41:28.397616 21281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:41:28.403396 21281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:41:28.403510 21281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:41:28.403628 21281 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:41:28.409937 21281 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:37839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.8.208.212:57285/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:37543
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21281
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:41:28.411111 21281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:41:28.412243 21281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:41:28.421842 21286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:41:28.421885 21287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:41:28.422008 21281 server_base.cc:1034] running on GCE node
W20260807 08:41:28.423161 21289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:41:28.423568 21281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:41:28.424185 21281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:41:28.425376 21281 hybrid_clock.cc:648] HybridClock initialized: now 1786092088425346 us; error 37 us; skew 500 ppm
Aug 07 08:41:28 dist-test-slave-6nmv krb5kdc[20684](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092088, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:41:28.428212 21281 init.cc:377] Logged in from keytab as kudu/127.8.208.193@KRBTEST.COM (short username kudu)
I20260807 08:41:28.429198 21281 webserver.cc:460] Webserver started at http://127.8.208.193:46227/ using document root <none> and password file <none>
I20260807 08:41:28.429872 21281 fs_manager.cc:359] Metadata directory not provided
I20260807 08:41:28.429977 21281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:41:28.430190 21281 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 08:41:28 dist-test-slave-6nmv krb5kdc[20684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092088, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for HTTP/127.8.208.212@KRBTEST.COM
I20260807 08:41:28.447923 21281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "eb6b90b823c14ffeb4b2f9a40bb77f3c"
format_stamp: "Formatted at 2026-08-07 08:41:28 on dist-test-slave-6nmv"
server_key: "d605305f3635b329d11157083a30ab2a"
server_key_iv: "24f72772417bcad63a36b2bd2593d106"
server_key_version: "kuduclusterkey@0"
I20260807 08:41:28.448802 21281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "eb6b90b823c14ffeb4b2f9a40bb77f3c"
format_stamp: "Formatted at 2026-08-07 08:41:28 on dist-test-slave-6nmv"
server_key: "d605305f3635b329d11157083a30ab2a"
server_key_iv: "24f72772417bcad63a36b2bd2593d106"
server_key_version: "kuduclusterkey@0"
I20260807 08:41:28.455245 21281 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260807 08:41:28.473567 21298 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:41:28.475359 21281 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.000s
I20260807 08:41:28.475507 21281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "eb6b90b823c14ffeb4b2f9a40bb77f3c"
format_stamp: "Formatted at 2026-08-07 08:41:28 on dist-test-slave-6nmv"
server_key: "d605305f3635b329d11157083a30ab2a"
server_key_iv: "24f72772417bcad63a36b2bd2593d106"
server_key_version: "kuduclusterkey@0"
I20260807 08:41:28.475638 21281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:41:28.496201 21281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:41:28.499075 21281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:41:28.499267 21281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:41:28.499954 21281 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:41:28.500857 21281 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:41:28.500929 21281 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:41:28.501015 21281 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:41:28.501073 21281 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:41:28.512072 21281 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:35551
I20260807 08:41:28.513190 21281 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:41:28.514935 21423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:35551 every 8 connection(s)
I20260807 08:41:28.520637 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 21281
I20260807 08:41:28.520759 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
I20260807 08:41:28.521095 9027 external_mini_cluster.cc:1428] Setting key fc2f1a751c1f9903fb3b7d22101a8100
Aug 07 08:41:28 dist-test-slave-6nmv krb5kdc[20684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092088, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.208.194@KRBTEST.COM; defaulting to no policy
I20260807 08:41:28.537809 21426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:41:28.517248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:37543 (local address 127.8.208.193:46487)
0807 08:41:28.521207 (+ 3959us) negotiation.cc:107] Waiting for socket to connect
0807 08:41:28.521259 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 08:41:28.523133 (+ 1874us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:41:28.525187 (+ 2054us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:41:28.525195 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:41:28.525524 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:41:28.526200 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:41:28.526221 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:41:28.527344 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:41:28.527350 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:41:28.528595 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:41:28.528607 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:41:28.529381 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:41:28.529384 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:41:28.529579 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:41:28.530582 (+ 1003us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:41:28.530607 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:41:28.532300 (+ 1693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:41:28.534755 (+ 2455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:41:28.534760 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:41:28.534774 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:41:28.535126 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:41:28.535455 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:41:28.535459 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:41:28.535460 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:41:28.535637 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:41:28.536061 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:41:28.536067 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:41:28.536339 (+ 272us) client_negotiation.cc:769] Sending connection context
0807 08:41:28.536518 (+ 179us) client_negotiation.cc:240] Negotiation successful
0807 08:41:28.536841 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3748,"thread_start_us":145,"threads_started":1}
I20260807 08:41:28.539000 21427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:41:28.517918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:46487 (local address 127.8.208.254:37543)
0807 08:41:28.518792 (+ 874us) server_negotiation.cc:206] Beginning negotiation
0807 08:41:28.518801 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 08:41:28.524815 (+ 6014us) server_negotiation.cc:407] Connection header received
0807 08:41:28.524862 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:41:28.524865 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:41:28.524915 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:41:28.525011 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:41:28.526379 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:41:28.527190 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:41:28.528720 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:41:28.529098 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:41:28.529213 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:41:28.532525 (+ 3312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:41:28.532529 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:41:28.532532 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:41:28.532557 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:41:28.534625 (+ 2068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:41:28.535252 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:41:28.535254 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:41:28.535256 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:41:28.535344 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:41:28.535771 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:41:28.535774 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:41:28.535775 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:41:28.535944 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:41:28.536062 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 08:41:28.538696 (+ 2634us) server_negotiation.cc:299] Negotiation successful
0807 08:41:28.538825 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":790,"thread_start_us":90,"threads_started":1}
I20260807 08:41:28.540122 21424 heartbeater.cc:347] Connected to a master server at 127.8.208.254:37543
I20260807 08:41:28.540338 21424 heartbeater.cc:464] Registering TS with master...
I20260807 08:41:28.540838 21424 heartbeater.cc:511] Master 127.8.208.254:37543 requested a full tablet report, sending...
I20260807 08:41:28.542454 21194 ts_manager.cc:194] Registered new tserver with Master: eb6b90b823c14ffeb4b2f9a40bb77f3c (127.8.208.193:35551)
I20260807 08:41:28.543932 21194 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.193@KRBTEST.COM'} at 127.8.208.193:46487
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
I20260807 08:41:28.573041 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.208.212:57285/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:37543
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:37839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 08:41:28 dist-test-slave-6nmv krb5kdc[20684](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786092088, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 08:41:28.708226 21432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:41:28.708453 21432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:41:28.708597 21432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:41:28.712493 21432 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:41:28.712567 21432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:41:28.712669 21432 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:41:28.717420 21432 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:37839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.8.208.212:57285/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:37543
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21432
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:41:28.718466 21432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:41:28.719419 21432 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:41:28.728044 21442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:41:28.728147 21432 server_base.cc:1034] running on GCE node
W20260807 08:41:28.728286 21438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:41:28.728637 21439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:41:28.729069 21432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:41:28.729686 21432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:41:28.730837 21432 hybrid_clock.cc:648] HybridClock initialized: now 1786092088730808 us; error 40 us; skew 500 ppm
Aug 07 08:41:28 dist-test-slave-6nmv krb5kdc[20684](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092088, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:41:28.733565 21432 init.cc:377] Logged in from keytab as kudu/127.8.208.194@KRBTEST.COM (short username kudu)
I20260807 08:41:28.734503 21432 webserver.cc:460] Webserver started at http://127.8.208.194:45851/ using document root <none> and password file <none>
I20260807 08:41:28.734964 21432 fs_manager.cc:359] Metadata directory not provided
I20260807 08:41:28.735044 21432 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:41:28.735246 21432 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 08:41:28 dist-test-slave-6nmv krb5kdc[20684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092088, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for HTTP/127.8.208.212@KRBTEST.COM
I20260807 08:41:28.747037 21432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "462abd5812f4443aa4174e2a4ef5c3ed"
format_stamp: "Formatted at 2026-08-07 08:41:28 on dist-test-slave-6nmv"
server_key: "2ed54a147661712a9395277e9d8b493a"
server_key_iv: "56a79dda2b422d72ae69f0b08930973e"
server_key_version: "kuduclusterkey@0"
I20260807 08:41:28.747948 21432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "462abd5812f4443aa4174e2a4ef5c3ed"
format_stamp: "Formatted at 2026-08-07 08:41:28 on dist-test-slave-6nmv"
server_key: "2ed54a147661712a9395277e9d8b493a"
server_key_iv: "56a79dda2b422d72ae69f0b08930973e"
server_key_version: "kuduclusterkey@0"
I20260807 08:41:28.755064 21432 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.000s
I20260807 08:41:28.777336 21449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:41:28.781623 21432 fs_manager.cc:725] Time spent opening block manager: real 0.014s user 0.003s sys 0.000s
I20260807 08:41:28.781934 21432 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "462abd5812f4443aa4174e2a4ef5c3ed"
format_stamp: "Formatted at 2026-08-07 08:41:28 on dist-test-slave-6nmv"
server_key: "2ed54a147661712a9395277e9d8b493a"
server_key_iv: "56a79dda2b422d72ae69f0b08930973e"
server_key_version: "kuduclusterkey@0"
I20260807 08:41:28.782127 21432 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:41:28.799480 21432 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:41:28.802409 21432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:41:28.802589 21432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:41:28.803260 21432 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:41:28.804265 21432 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:41:28.804332 21432 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:41:28.804397 21432 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:41:28.804432 21432 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:41:28.815004 21432 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:38189
I20260807 08:41:28.815363 21569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:38189 every 8 connection(s)
I20260807 08:41:28.816112 21432 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:41:28.822062 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 21432
I20260807 08:41:28.822184 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:41:28.822703 9027 external_mini_cluster.cc:1428] Setting key 04ff603e5c4b5b00b9bf0d54b7a16310
Aug 07 08:41:28 dist-test-slave-6nmv krb5kdc[20684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092088, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:41:28.830967 21573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:41:28.818391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:37543 (local address 127.8.208.194:54541)
0807 08:41:28.818862 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0807 08:41:28.818922 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 08:41:28.819714 (+ 792us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:41:28.820198 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:41:28.820203 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:41:28.820435 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:41:28.820820 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:41:28.820832 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:41:28.821547 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:41:28.821550 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:41:28.822629 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:41:28.822642 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:41:28.823352 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:41:28.823356 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:41:28.823533 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:41:28.824115 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:41:28.824135 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:41:28.825775 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:41:28.827886 (+ 2111us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:41:28.827892 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:41:28.827906 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:41:28.828200 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:41:28.828513 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:41:28.828518 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:41:28.828522 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:41:28.828684 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:41:28.829163 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:41:28.829171 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:41:28.829434 (+ 263us) client_negotiation.cc:769] Sending connection context
0807 08:41:28.829608 (+ 174us) client_negotiation.cc:240] Negotiation successful
0807 08:41:28.829993 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":132,"threads_started":1}
I20260807 08:41:28.832165 21427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:41:28.817893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:54541 (local address 127.8.208.254:37543)
0807 08:41:28.818060 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 08:41:28.818064 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:41:28.819039 (+ 975us) server_negotiation.cc:407] Connection header received
0807 08:41:28.819899 (+ 860us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:41:28.819902 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:41:28.819957 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:41:28.820038 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:41:28.820953 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:41:28.821424 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:41:28.822764 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:41:28.823016 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:41:28.823130 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:41:28.825985 (+ 2855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:41:28.825991 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:41:28.825996 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:41:28.826024 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:41:28.827755 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:41:28.828316 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:41:28.828319 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:41:28.828321 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:41:28.828418 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:41:28.828789 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:41:28.828794 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:41:28.828798 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:41:28.829027 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:41:28.829114 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 08:41:28.831842 (+ 2728us) server_negotiation.cc:299] Negotiation successful
0807 08:41:28.831995 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 08:41:28.833671 21570 heartbeater.cc:347] Connected to a master server at 127.8.208.254:37543
I20260807 08:41:28.833891 21570 heartbeater.cc:464] Registering TS with master...
I20260807 08:41:28.834415 21570 heartbeater.cc:511] Master 127.8.208.254:37543 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.8.208.195@KRBTEST.COM; defaulting to no policy
I20260807 08:41:28.835578 21194 ts_manager.cc:194] Registered new tserver with Master: 462abd5812f4443aa4174e2a4ef5c3ed (127.8.208.194:38189)
I20260807 08:41:28.836174 21194 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.194@KRBTEST.COM'} at 127.8.208.194:54541
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
I20260807 08:41:28.852361 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.208.212:57285/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:37543
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:37839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:41:28.982872 21576 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:41:28.983264 21576 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:41:28.983373 21576 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:41:28.987679 21576 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:41:28.987740 21576 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:41:28.987845 21576 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:41:28.993623 21576 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:37839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.8.208.212:57285/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:37543
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21576
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:41:28.994539 21576 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:41:28.995483 21576 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:41:29.004400 21581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:41:29.004416 21582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:41:29.004601 21585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:41:29.005738 21576 server_base.cc:1034] running on GCE node
I20260807 08:41:29.006100 21576 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:41:29.006678 21576 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:41:29.007846 21576 hybrid_clock.cc:648] HybridClock initialized: now 1786092089007828 us; error 40 us; skew 500 ppm
Aug 07 08:41:29 dist-test-slave-6nmv krb5kdc[20684](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092089, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:41:29.010994 21576 init.cc:377] Logged in from keytab as kudu/127.8.208.195@KRBTEST.COM (short username kudu)
I20260807 08:41:29.011802 21576 webserver.cc:460] Webserver started at http://127.8.208.195:38335/ using document root <none> and password file <none>
I20260807 08:41:29.012344 21576 fs_manager.cc:359] Metadata directory not provided
I20260807 08:41:29.012435 21576 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:41:29.012670 21576 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 08:41:29 dist-test-slave-6nmv krb5kdc[20684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092089, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for HTTP/127.8.208.212@KRBTEST.COM
I20260807 08:41:29.027864 21576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "ad53df0b649149d2b4ce124eb16afdd1"
format_stamp: "Formatted at 2026-08-07 08:41:29 on dist-test-slave-6nmv"
server_key: "ff6ce2655931f89e4f2a2ac21c4929a0"
server_key_iv: "eee76502f2fdaebce88e686c945e0656"
server_key_version: "kuduclusterkey@0"
I20260807 08:41:29.028831 21576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "ad53df0b649149d2b4ce124eb16afdd1"
format_stamp: "Formatted at 2026-08-07 08:41:29 on dist-test-slave-6nmv"
server_key: "ff6ce2655931f89e4f2a2ac21c4929a0"
server_key_iv: "eee76502f2fdaebce88e686c945e0656"
server_key_version: "kuduclusterkey@0"
I20260807 08:41:29.033152 21576 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
Aug 07 08:41:29 dist-test-slave-6nmv krb5kdc[20684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092088, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for HTTP/127.8.208.212@KRBTEST.COM
I20260807 08:41:29.054140 21592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:41:29.058881 21576 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.003s sys 0.000s
I20260807 08:41:29.059019 21576 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "ad53df0b649149d2b4ce124eb16afdd1"
format_stamp: "Formatted at 2026-08-07 08:41:29 on dist-test-slave-6nmv"
server_key: "ff6ce2655931f89e4f2a2ac21c4929a0"
server_key_iv: "eee76502f2fdaebce88e686c945e0656"
server_key_version: "kuduclusterkey@0"
I20260807 08:41:29.059142 21576 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:41:29.081198 21576 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:41:29.084889 21576 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:41:29.085079 21576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:41:29.085656 21576 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:41:29.086647 21576 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:41:29.086769 21576 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:41:29.086952 21576 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:41:29.087021 21576 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:41:29.097144 21576 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:41151
I20260807 08:41:29.097739 21712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:41151 every 8 connection(s)
I20260807 08:41:29.098131 21576 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:41:29.101752 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 21576
I20260807 08:41:29.101895 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:41:29.102231 9027 external_mini_cluster.cc:1428] Setting key d546c84f731bd2b4650000e83663038a
Aug 07 08:41:29 dist-test-slave-6nmv krb5kdc[20684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092089, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:41:29.112929 21427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:41:29.101014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:57809 (local address 127.8.208.254:37543)
0807 08:41:29.101116 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0807 08:41:29.101120 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:41:29.101137 (+ 17us) server_negotiation.cc:407] Connection header received
0807 08:41:29.101709 (+ 572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:41:29.101713 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:41:29.101772 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:41:29.101854 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:41:29.104141 (+ 2287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.104723 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.105725 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.106020 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.106125 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:41:29.108944 (+ 2819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:41:29.108947 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:41:29.108950 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:41:29.108975 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:41:29.110371 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:41:29.111237 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:41:29.111240 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:41:29.111242 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:41:29.111328 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:41:29.111750 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:41:29.111753 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:41:29.111754 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:41:29.111918 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:41:29.112010 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 08:41:29.112606 (+ 596us) server_negotiation.cc:299] Negotiation successful
0807 08:41:29.112738 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 08:41:29.114818 21715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:41:29.100043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:37543 (local address 127.8.208.195:57809)
0807 08:41:29.100466 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0807 08:41:29.100529 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 08:41:29.101457 (+ 928us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:41:29.102291 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:41:29.102299 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:41:29.102698 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:41:29.103487 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:41:29.103518 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.104838 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.104840 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:41:29.105602 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:41:29.105610 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.106157 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.106161 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:41:29.106344 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:41:29.106895 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:41:29.106913 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:41:29.108775 (+ 1862us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:41:29.110478 (+ 1703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:41:29.110483 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:41:29.110494 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:41:29.110780 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:41:29.111533 (+ 753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:41:29.111535 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:41:29.111536 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:41:29.111659 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:41:29.112030 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:41:29.112035 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:41:29.112290 (+ 255us) client_negotiation.cc:769] Sending connection context
0807 08:41:29.113285 (+ 995us) client_negotiation.cc:240] Negotiation successful
0807 08:41:29.113591 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":132,"threads_started":1}
I20260807 08:41:29.116050 21713 heartbeater.cc:347] Connected to a master server at 127.8.208.254:37543
I20260807 08:41:29.116266 21713 heartbeater.cc:464] Registering TS with master...
I20260807 08:41:29.116741 21713 heartbeater.cc:511] Master 127.8.208.254:37543 requested a full tablet report, sending...
I20260807 08:41:29.117815 21194 ts_manager.cc:194] Registered new tserver with Master: ad53df0b649149d2b4ce124eb16afdd1 (127.8.208.195:41151)
I20260807 08:41:29.118465 21194 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.195@KRBTEST.COM'} at 127.8.208.195:57809
I20260807 08:41:29.127341 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 08:41:29.137615 21427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:41:29.129465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49876 (local address 127.8.208.254:37543)
0807 08:41:29.129563 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0807 08:41:29.129566 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:41:29.129793 (+ 227us) server_negotiation.cc:407] Connection header received
0807 08:41:29.129904 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:41:29.129907 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:41:29.129947 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:41:29.130012 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:41:29.130730 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.131444 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.132595 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.132937 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.133053 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:41:29.134565 (+ 1512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:41:29.134581 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:41:29.134584 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:41:29.134605 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:41:29.136067 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:41:29.136502 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:41:29.136506 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:41:29.136508 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:41:29.136590 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:41:29.136864 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:41:29.136867 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:41:29.136869 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:41:29.137049 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:41:29.137162 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 08:41:29.137368 (+ 206us) server_negotiation.cc:299] Negotiation successful
0807 08:41:29.137463 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 08:41:29.140298 21194 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49876:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 08:41:29.144230 21194 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:41:29.159379 21726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:41:29.153297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:41151 (local address 127.0.0.1:48902)
0807 08:41:29.153827 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0807 08:41:29.153867 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 08:41:29.153969 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:41:29.154681 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:41:29.154686 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:41:29.154706 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:41:29.154831 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:41:29.154836 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.156338 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.156341 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:41:29.157717 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:41:29.157729 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.158854 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.158858 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:41:29.158992 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:41:29.159030 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 08:41:29.159150 (+ 120us) client_negotiation.cc:240] Negotiation successful
0807 08:41:29.159255 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":120,"threads_started":1}
I20260807 08:41:29.159404 21727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:41:29.153933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48902 (local address 127.8.208.195:41151)
0807 08:41:29.154232 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0807 08:41:29.154242 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 08:41:29.154261 (+ 19us) server_negotiation.cc:407] Connection header received
0807 08:41:29.154317 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:41:29.154321 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:41:29.154524 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:41:29.154965 (+ 441us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:41:29.155074 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.156219 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.157903 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.158730 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.158828 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:41:29.158962 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 08:41:29.159187 (+ 225us) server_negotiation.cc:299] Negotiation successful
0807 08:41:29.159269 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":136,"threads_started":1}
I20260807 08:41:29.162575 21642 tablet_service.cc:1467] Processing CreateTablet for tablet 862bee5a4dd7415aacbd4f6f085327db (DEFAULT_TABLE table=test-table [id=c414867a68ee472c80e9da37af848d36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:41:29.163663 21642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 862bee5a4dd7415aacbd4f6f085327db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:41:29.168421 21728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:41:29.154013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:38189 (local address 127.0.0.1:44322)
0807 08:41:29.161715 (+ 7702us) negotiation.cc:107] Waiting for socket to connect
0807 08:41:29.161727 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:41:29.161816 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:41:29.163308 (+ 1492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:41:29.163310 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:41:29.163326 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:41:29.163402 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:41:29.163407 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.164687 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.164690 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:41:29.165725 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:41:29.165735 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.168065 (+ 2330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.168068 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:41:29.168144 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:41:29.168163 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 08:41:29.168225 (+ 62us) client_negotiation.cc:240] Negotiation successful
0807 08:41:29.168298 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7648,"thread_start_us":81,"threads_started":1}
I20260807 08:41:29.170974 21730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:41:29.154910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44322 (local address 127.8.208.194:38189)
0807 08:41:29.155207 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0807 08:41:29.155217 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 08:41:29.162851 (+ 7634us) server_negotiation.cc:407] Connection header received
0807 08:41:29.162928 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:41:29.162932 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:41:29.163112 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:41:29.163503 (+ 391us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:41:29.163629 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.164567 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.167119 (+ 2552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.167797 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.167887 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:41:29.168009 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 08:41:29.170751 (+ 2742us) server_negotiation.cc:299] Negotiation successful
0807 08:41:29.170840 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":138,"threads_started":1}
I20260807 08:41:29.171461 21726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:41:29.153507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:35551 (local address 127.0.0.1:51922)
0807 08:41:29.159781 (+ 6274us) negotiation.cc:107] Waiting for socket to connect
0807 08:41:29.159794 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:41:29.159860 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:41:29.162657 (+ 2797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:41:29.162660 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:41:29.162675 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:41:29.162741 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:41:29.162746 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.168602 (+ 5856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.168616 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:41:29.169623 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:41:29.169633 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.171168 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.171171 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:41:29.171245 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:41:29.171267 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 08:41:29.171311 (+ 44us) client_negotiation.cc:240] Negotiation successful
0807 08:41:29.171360 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6228,"thread_start_us":72,"threads_started":1}
I20260807 08:41:29.172650 21731 tablet_bootstrap.cc:492] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1: Bootstrap starting.
I20260807 08:41:29.174669 21499 tablet_service.cc:1467] Processing CreateTablet for tablet 862bee5a4dd7415aacbd4f6f085327db (DEFAULT_TABLE table=test-table [id=c414867a68ee472c80e9da37af848d36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:41:29.175557 21731 tablet_bootstrap.cc:654] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1: Neither blocks nor log segments found. Creating new log.
I20260807 08:41:29.175707 21499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 862bee5a4dd7415aacbd4f6f085327db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:41:29.176452 21731 log.cc:824] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1: Log is configured to *not* fsync() on all Append() calls
I20260807 08:41:29.178483 21731 tablet_bootstrap.cc:492] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1: No bootstrap required, opened a new log
I20260807 08:41:29.178665 21731 ts_tablet_manager.cc:1397] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 08:41:29.182312 21731 raft_consensus.cc:348] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad53df0b649149d2b4ce124eb16afdd1" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41151 } } peers { permanent_uuid: "eb6b90b823c14ffeb4b2f9a40bb77f3c" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35551 } } peers { permanent_uuid: "462abd5812f4443aa4174e2a4ef5c3ed" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 38189 } }
I20260807 08:41:29.182657 21731 raft_consensus.cc:374] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:41:29.182754 21731 raft_consensus.cc:729] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad53df0b649149d2b4ce124eb16afdd1, State: Initialized, Role: FOLLOWER
I20260807 08:41:29.183275 21731 consensus_queue.cc:260] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad53df0b649149d2b4ce124eb16afdd1" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41151 } } peers { permanent_uuid: "eb6b90b823c14ffeb4b2f9a40bb77f3c" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35551 } } peers { permanent_uuid: "462abd5812f4443aa4174e2a4ef5c3ed" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 38189 } }
I20260807 08:41:29.184326 21731 ts_tablet_manager.cc:1428] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 08:41:29.184708 21713 heartbeater.cc:503] Master 127.8.208.254:37543 was elected leader, sending a full tablet report...
I20260807 08:41:29.186973 21729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:41:29.154558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51922 (local address 127.8.208.193:35551)
0807 08:41:29.162080 (+ 7522us) server_negotiation.cc:206] Beginning negotiation
0807 08:41:29.162086 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:41:29.162108 (+ 22us) server_negotiation.cc:407] Connection header received
0807 08:41:29.162178 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:41:29.162182 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:41:29.162384 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:41:29.162523 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:41:29.165912 (+ 3389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.166951 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.169781 (+ 2830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.170556 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.171830 (+ 1274us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:41:29.171959 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 08:41:29.186686 (+ 14727us) server_negotiation.cc:299] Negotiation successful
0807 08:41:29.186810 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7393,"thread_start_us":113,"threads_started":1}
I20260807 08:41:29.189731 21349 tablet_service.cc:1467] Processing CreateTablet for tablet 862bee5a4dd7415aacbd4f6f085327db (DEFAULT_TABLE table=test-table [id=c414867a68ee472c80e9da37af848d36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:41:29.190747 21349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 862bee5a4dd7415aacbd4f6f085327db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:41:29.190954 21734 tablet_bootstrap.cc:492] T 862bee5a4dd7415aacbd4f6f085327db P 462abd5812f4443aa4174e2a4ef5c3ed: Bootstrap starting.
I20260807 08:41:29.193656 21734 tablet_bootstrap.cc:654] T 862bee5a4dd7415aacbd4f6f085327db P 462abd5812f4443aa4174e2a4ef5c3ed: Neither blocks nor log segments found. Creating new log.
I20260807 08:41:29.194437 21734 log.cc:824] T 862bee5a4dd7415aacbd4f6f085327db P 462abd5812f4443aa4174e2a4ef5c3ed: Log is configured to *not* fsync() on all Append() calls
I20260807 08:41:29.197990 21736 tablet_bootstrap.cc:492] T 862bee5a4dd7415aacbd4f6f085327db P eb6b90b823c14ffeb4b2f9a40bb77f3c: Bootstrap starting.
I20260807 08:41:29.199962 21736 tablet_bootstrap.cc:654] T 862bee5a4dd7415aacbd4f6f085327db P eb6b90b823c14ffeb4b2f9a40bb77f3c: Neither blocks nor log segments found. Creating new log.
I20260807 08:41:29.200722 21736 log.cc:824] T 862bee5a4dd7415aacbd4f6f085327db P eb6b90b823c14ffeb4b2f9a40bb77f3c: Log is configured to *not* fsync() on all Append() calls
I20260807 08:41:29.201192 21734 tablet_bootstrap.cc:492] T 862bee5a4dd7415aacbd4f6f085327db P 462abd5812f4443aa4174e2a4ef5c3ed: No bootstrap required, opened a new log
I20260807 08:41:29.201438 21734 ts_tablet_manager.cc:1397] T 862bee5a4dd7415aacbd4f6f085327db P 462abd5812f4443aa4174e2a4ef5c3ed: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260807 08:41:29.202515 21736 tablet_bootstrap.cc:492] T 862bee5a4dd7415aacbd4f6f085327db P eb6b90b823c14ffeb4b2f9a40bb77f3c: No bootstrap required, opened a new log
I20260807 08:41:29.202679 21736 ts_tablet_manager.cc:1397] T 862bee5a4dd7415aacbd4f6f085327db P eb6b90b823c14ffeb4b2f9a40bb77f3c: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 08:41:29.206630 21736 raft_consensus.cc:348] T 862bee5a4dd7415aacbd4f6f085327db P eb6b90b823c14ffeb4b2f9a40bb77f3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad53df0b649149d2b4ce124eb16afdd1" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41151 } } peers { permanent_uuid: "eb6b90b823c14ffeb4b2f9a40bb77f3c" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35551 } } peers { permanent_uuid: "462abd5812f4443aa4174e2a4ef5c3ed" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 38189 } }
I20260807 08:41:29.206913 21736 raft_consensus.cc:374] T 862bee5a4dd7415aacbd4f6f085327db P eb6b90b823c14ffeb4b2f9a40bb77f3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:41:29.206998 21736 raft_consensus.cc:729] T 862bee5a4dd7415aacbd4f6f085327db P eb6b90b823c14ffeb4b2f9a40bb77f3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb6b90b823c14ffeb4b2f9a40bb77f3c, State: Initialized, Role: FOLLOWER
I20260807 08:41:29.207484 21736 consensus_queue.cc:260] T 862bee5a4dd7415aacbd4f6f085327db P eb6b90b823c14ffeb4b2f9a40bb77f3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad53df0b649149d2b4ce124eb16afdd1" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41151 } } peers { permanent_uuid: "eb6b90b823c14ffeb4b2f9a40bb77f3c" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35551 } } peers { permanent_uuid: "462abd5812f4443aa4174e2a4ef5c3ed" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 38189 } }
I20260807 08:41:29.208433 21736 ts_tablet_manager.cc:1428] T 862bee5a4dd7415aacbd4f6f085327db P eb6b90b823c14ffeb4b2f9a40bb77f3c: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 08:41:29.208777 21424 heartbeater.cc:503] Master 127.8.208.254:37543 was elected leader, sending a full tablet report...
I20260807 08:41:29.208842 21734 raft_consensus.cc:348] T 862bee5a4dd7415aacbd4f6f085327db P 462abd5812f4443aa4174e2a4ef5c3ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad53df0b649149d2b4ce124eb16afdd1" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41151 } } peers { permanent_uuid: "eb6b90b823c14ffeb4b2f9a40bb77f3c" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35551 } } peers { permanent_uuid: "462abd5812f4443aa4174e2a4ef5c3ed" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 38189 } }
I20260807 08:41:29.209071 21734 raft_consensus.cc:374] T 862bee5a4dd7415aacbd4f6f085327db P 462abd5812f4443aa4174e2a4ef5c3ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:41:29.209161 21734 raft_consensus.cc:729] T 862bee5a4dd7415aacbd4f6f085327db P 462abd5812f4443aa4174e2a4ef5c3ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 462abd5812f4443aa4174e2a4ef5c3ed, State: Initialized, Role: FOLLOWER
I20260807 08:41:29.209547 21734 consensus_queue.cc:260] T 862bee5a4dd7415aacbd4f6f085327db P 462abd5812f4443aa4174e2a4ef5c3ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad53df0b649149d2b4ce124eb16afdd1" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41151 } } peers { permanent_uuid: "eb6b90b823c14ffeb4b2f9a40bb77f3c" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35551 } } peers { permanent_uuid: "462abd5812f4443aa4174e2a4ef5c3ed" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 38189 } }
I20260807 08:41:29.210480 21734 ts_tablet_manager.cc:1428] T 862bee5a4dd7415aacbd4f6f085327db P 462abd5812f4443aa4174e2a4ef5c3ed: Time spent starting tablet: real 0.009s user 0.004s sys 0.000s
I20260807 08:41:29.210809 21570 heartbeater.cc:503] Master 127.8.208.254:37543 was elected leader, sending a full tablet report...
I20260807 08:41:29.241479 21733 raft_consensus.cc:482] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:41:29.241667 21733 raft_consensus.cc:504] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad53df0b649149d2b4ce124eb16afdd1" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41151 } } peers { permanent_uuid: "eb6b90b823c14ffeb4b2f9a40bb77f3c" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35551 } } peers { permanent_uuid: "462abd5812f4443aa4174e2a4ef5c3ed" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 38189 } }
I20260807 08:41:29.243055 21733 leader_election.cc:288] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb6b90b823c14ffeb4b2f9a40bb77f3c (127.8.208.193:35551), 462abd5812f4443aa4174e2a4ef5c3ed (127.8.208.194:38189)
I20260807 08:41:29.247968 21730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:41:29.243781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:60511 (local address 127.8.208.194:38189)
0807 08:41:29.243941 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 08:41:29.243945 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:41:29.244013 (+ 68us) server_negotiation.cc:407] Connection header received
0807 08:41:29.244151 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:41:29.244154 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:41:29.244191 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:41:29.244227 (+ 36us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:41:29.244614 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.245277 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.246838 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.247339 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.247460 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:41:29.247506 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 08:41:29.247798 (+ 292us) server_negotiation.cc:299] Negotiation successful
0807 08:41:29.247860 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 08:41:29.248039 21715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:41:29.243205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:35551 (local address 127.8.208.195:59767)
0807 08:41:29.243499 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0807 08:41:29.243514 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 08:41:29.243593 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:41:29.244345 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:41:29.244348 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:41:29.244368 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:41:29.244471 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:41:29.244476 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.245438 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.245441 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:41:29.246696 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:41:29.246706 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.247648 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.247652 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:41:29.247747 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:41:29.247768 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 08:41:29.247838 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 08:41:29.247902 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":78}
I20260807 08:41:29.248320 21740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:41:29.243482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:38189 (local address 127.8.208.195:60511)
0807 08:41:29.243943 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0807 08:41:29.243954 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 08:41:29.244065 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:41:29.244331 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:41:29.244333 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:41:29.244347 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:41:29.244507 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:41:29.244512 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.245428 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.245431 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:41:29.246718 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:41:29.246727 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.247600 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.247603 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:41:29.247684 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:41:29.247703 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 08:41:29.248119 (+ 416us) client_negotiation.cc:240] Negotiation successful
0807 08:41:29.248183 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":407,"mutex_wait_us":42,"spinlock_wait_cycles":13184,"thread_start_us":104,"threads_started":1}
I20260807 08:41:29.248819 21729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:41:29.243812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:59767 (local address 127.8.208.193:35551)
0807 08:41:29.244031 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 08:41:29.244035 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:41:29.244046 (+ 11us) server_negotiation.cc:407] Connection header received
0807 08:41:29.244088 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:41:29.244090 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:41:29.244128 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:41:29.244192 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:41:29.244594 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.245318 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.246833 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.247424 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.247537 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:41:29.247588 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 08:41:29.248628 (+ 1040us) server_negotiation.cc:299] Negotiation successful
0807 08:41:29.248717 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147}
I20260807 08:41:29.248868 21521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "862bee5a4dd7415aacbd4f6f085327db" candidate_uuid: "ad53df0b649149d2b4ce124eb16afdd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462abd5812f4443aa4174e2a4ef5c3ed" is_pre_election: true
I20260807 08:41:29.249089 21521 raft_consensus.cc:2454] T 862bee5a4dd7415aacbd4f6f085327db P 462abd5812f4443aa4174e2a4ef5c3ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad53df0b649149d2b4ce124eb16afdd1 in term 0.
I20260807 08:41:29.249284 21370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "862bee5a4dd7415aacbd4f6f085327db" candidate_uuid: "ad53df0b649149d2b4ce124eb16afdd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb6b90b823c14ffeb4b2f9a40bb77f3c" is_pre_election: true
I20260807 08:41:29.249490 21594 leader_election.cc:302] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 462abd5812f4443aa4174e2a4ef5c3ed, ad53df0b649149d2b4ce124eb16afdd1; no voters:
I20260807 08:41:29.249502 21370 raft_consensus.cc:2454] T 862bee5a4dd7415aacbd4f6f085327db P eb6b90b823c14ffeb4b2f9a40bb77f3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad53df0b649149d2b4ce124eb16afdd1 in term 0.
I20260807 08:41:29.249724 21733 raft_consensus.cc:2781] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:41:29.249779 21733 raft_consensus.cc:482] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:41:29.249831 21733 raft_consensus.cc:3037] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:41:29.250969 21733 raft_consensus.cc:504] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad53df0b649149d2b4ce124eb16afdd1" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41151 } } peers { permanent_uuid: "eb6b90b823c14ffeb4b2f9a40bb77f3c" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35551 } } peers { permanent_uuid: "462abd5812f4443aa4174e2a4ef5c3ed" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 38189 } }
I20260807 08:41:29.251247 21733 leader_election.cc:288] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1 [CANDIDATE]: Term 1 election: Requested vote from peers eb6b90b823c14ffeb4b2f9a40bb77f3c (127.8.208.193:35551), 462abd5812f4443aa4174e2a4ef5c3ed (127.8.208.194:38189)
I20260807 08:41:29.251597 21521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "862bee5a4dd7415aacbd4f6f085327db" candidate_uuid: "ad53df0b649149d2b4ce124eb16afdd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462abd5812f4443aa4174e2a4ef5c3ed"
I20260807 08:41:29.251636 21370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "862bee5a4dd7415aacbd4f6f085327db" candidate_uuid: "ad53df0b649149d2b4ce124eb16afdd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb6b90b823c14ffeb4b2f9a40bb77f3c"
I20260807 08:41:29.251718 21521 raft_consensus.cc:3037] T 862bee5a4dd7415aacbd4f6f085327db P 462abd5812f4443aa4174e2a4ef5c3ed [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:41:29.251740 21370 raft_consensus.cc:3037] T 862bee5a4dd7415aacbd4f6f085327db P eb6b90b823c14ffeb4b2f9a40bb77f3c [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:41:29.252933 21521 raft_consensus.cc:2454] T 862bee5a4dd7415aacbd4f6f085327db P 462abd5812f4443aa4174e2a4ef5c3ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad53df0b649149d2b4ce124eb16afdd1 in term 1.
I20260807 08:41:29.253057 21370 raft_consensus.cc:2454] T 862bee5a4dd7415aacbd4f6f085327db P eb6b90b823c14ffeb4b2f9a40bb77f3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad53df0b649149d2b4ce124eb16afdd1 in term 1.
I20260807 08:41:29.253384 21593 leader_election.cc:302] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad53df0b649149d2b4ce124eb16afdd1, eb6b90b823c14ffeb4b2f9a40bb77f3c; no voters:
I20260807 08:41:29.253731 21733 raft_consensus.cc:2781] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:41:29.254020 21733 raft_consensus.cc:686] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1 [term 1 LEADER]: Becoming Leader. State: Replica: ad53df0b649149d2b4ce124eb16afdd1, State: Running, Role: LEADER
I20260807 08:41:29.254371 21733 consensus_queue.cc:237] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad53df0b649149d2b4ce124eb16afdd1" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41151 } } peers { permanent_uuid: "eb6b90b823c14ffeb4b2f9a40bb77f3c" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35551 } } peers { permanent_uuid: "462abd5812f4443aa4174e2a4ef5c3ed" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 38189 } }
I20260807 08:41:29.257539 21194 catalog_manager.cc:5495] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad53df0b649149d2b4ce124eb16afdd1 (127.8.208.195). New cstate: current_term: 1 leader_uuid: "ad53df0b649149d2b4ce124eb16afdd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad53df0b649149d2b4ce124eb16afdd1" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb6b90b823c14ffeb4b2f9a40bb77f3c" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462abd5812f4443aa4174e2a4ef5c3ed" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 38189 } health_report { overall_health: UNKNOWN } } }
W20260807 08:41:29.267935 21425 tablet.cc:2369] T 862bee5a4dd7415aacbd4f6f085327db P eb6b90b823c14ffeb4b2f9a40bb77f3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 08:41:29.287302 21727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:41:29.283029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48918 (local address 127.8.208.195:41151)
0807 08:41:29.283136 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 08:41:29.283141 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:41:29.283192 (+ 51us) server_negotiation.cc:407] Connection header received
0807 08:41:29.283362 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:41:29.283365 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:41:29.283434 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:41:29.283537 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:41:29.283833 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.284580 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.285674 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:41:29.285984 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:41:29.286074 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:41:29.286425 (+ 351us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:41:29.286889 (+ 464us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:41:29.287013 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 08:41:29.287112 (+ 99us) server_negotiation.cc:299] Negotiation successful
0807 08:41:29.287165 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 08:41:29.294189 21521 raft_consensus.cc:1261] T 862bee5a4dd7415aacbd4f6f085327db P 462abd5812f4443aa4174e2a4ef5c3ed [term 1 FOLLOWER]: Refusing update from remote peer ad53df0b649149d2b4ce124eb16afdd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:41:29.294189 21370 raft_consensus.cc:1261] T 862bee5a4dd7415aacbd4f6f085327db P eb6b90b823c14ffeb4b2f9a40bb77f3c [term 1 FOLLOWER]: Refusing update from remote peer ad53df0b649149d2b4ce124eb16afdd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:41:29.294868 21733 consensus_queue.cc:1035] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "462abd5812f4443aa4174e2a4ef5c3ed" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 38189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:41:29.295275 21741 consensus_queue.cc:1035] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb6b90b823c14ffeb4b2f9a40bb77f3c" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:41:29.308771 21744 mvcc.cc:205] Tried to move back new op lower bound from 7315833197739950080 to 7315833197589082112. Current Snapshot: MvccSnapshot[applied={T|T < 7315833197739950080}]
I20260807 08:41:29.308985 21745 mvcc.cc:205] Tried to move back new op lower bound from 7315833197739950080 to 7315833197589082112. Current Snapshot: MvccSnapshot[applied={T|T < 7315833197739950080}]
I20260807 08:41:29.318499 21194 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49876:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:41:29.318663 21194 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49876:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:41:29.321172 21194 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1fd63ddfca5742cd82320d46af31da61: Sending DeleteTablet for 3 replicas of tablet 862bee5a4dd7415aacbd4f6f085327db
I20260807 08:41:29.321962 21499 tablet_service.cc:1514] Processing DeleteTablet for tablet 862bee5a4dd7415aacbd4f6f085327db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:41:29 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:44322
I20260807 08:41:29.322481 21755 tablet_replica.cc:330] T 862bee5a4dd7415aacbd4f6f085327db P 462abd5812f4443aa4174e2a4ef5c3ed: stopping tablet replica
I20260807 08:41:29.322667 21349 tablet_service.cc:1514] Processing DeleteTablet for tablet 862bee5a4dd7415aacbd4f6f085327db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:41:29 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:51922
I20260807 08:41:29.322839 21755 raft_consensus.cc:2229] T 862bee5a4dd7415aacbd4f6f085327db P 462abd5812f4443aa4174e2a4ef5c3ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:41:29.323138 21755 raft_consensus.cc:2258] T 862bee5a4dd7415aacbd4f6f085327db P 462abd5812f4443aa4174e2a4ef5c3ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:41:29.323300 21642 tablet_service.cc:1514] Processing DeleteTablet for tablet 862bee5a4dd7415aacbd4f6f085327db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:41:29 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:48902
I20260807 08:41:29.323731 21760 tablet_replica.cc:330] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1: stopping tablet replica
I20260807 08:41:29.324023 21760 raft_consensus.cc:2229] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1 [term 1 LEADER]: Raft consensus shutting down.
I20260807 08:41:29.324069 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 21281
I20260807 08:41:29.324394 21760 raft_consensus.cc:2258] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:41:29.327070 21760 ts_tablet_manager.cc:1905] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:41:29.328253 21755 ts_tablet_manager.cc:1905] T 862bee5a4dd7415aacbd4f6f085327db P 462abd5812f4443aa4174e2a4ef5c3ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:41:29.329777 21760 ts_tablet_manager.cc:1918] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:41:29.329941 21760 log.cc:1196] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/862bee5a4dd7415aacbd4f6f085327db
I20260807 08:41:29.330319 21760 ts_tablet_manager.cc:1939] T 862bee5a4dd7415aacbd4f6f085327db P ad53df0b649149d2b4ce124eb16afdd1: Deleting consensus metadata
I20260807 08:41:29.331499 21178 catalog_manager.cc:4841] TS ad53df0b649149d2b4ce124eb16afdd1 (127.8.208.195:41151): tablet 862bee5a4dd7415aacbd4f6f085327db (table test-table [id=c414867a68ee472c80e9da37af848d36]) successfully deleted
I20260807 08:41:29.342242 21755 ts_tablet_manager.cc:1918] T 862bee5a4dd7415aacbd4f6f085327db P 462abd5812f4443aa4174e2a4ef5c3ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:41:29.342381 21755 log.cc:1196] T 862bee5a4dd7415aacbd4f6f085327db P 462abd5812f4443aa4174e2a4ef5c3ed: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786091987266300-9027-0/minicluster-data/ts-1/wal/wals/862bee5a4dd7415aacbd4f6f085327db
I20260807 08:41:29.346109 21755 ts_tablet_manager.cc:1939] T 862bee5a4dd7415aacbd4f6f085327db P 462abd5812f4443aa4174e2a4ef5c3ed: Deleting consensus metadata
I20260807 08:41:29.347093 21178 catalog_manager.cc:4841] TS 462abd5812f4443aa4174e2a4ef5c3ed (127.8.208.194:38189): tablet 862bee5a4dd7415aacbd4f6f085327db (table test-table [id=c414867a68ee472c80e9da37af848d36]) successfully deleted
W20260807 08:41:29.350390 21177 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.208.193:35551 (error 108)
I20260807 08:41:29.351373 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 21432
I20260807 08:41:29.369237 21725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:41:29.368953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:35551 (local address 127.0.0.1:51928)
0807 08:41:29.369062 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0807 08:41:29.369148 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.193:35551: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260807 08:41:29.369445 21177 catalog_manager.cc:4584] TS eb6b90b823c14ffeb4b2f9a40bb77f3c (127.8.208.193:35551): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 862bee5a4dd7415aacbd4f6f085327db: Network error: Client connection negotiation failed: client connection to 127.8.208.193:35551: connect: Connection refused (error 111)
Aug 07 08:41:29 dist-test-slave-6nmv krb5kdc[20684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092088, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for HTTP/127.8.208.212@KRBTEST.COM
I20260807 08:41:29.392915 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 21576
I20260807 08:41:29.404139 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 21159
I20260807 08:41:29.415454 9027 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 08:41:29.760018 9027 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 08:41:29.760175 9027 mini_ranger.cc:66] Stopping Ranger...
I20260807 08:41:30.105032 9027 mini_ranger.cc:68] Stopped Ranger
2026-08-07 08:41:30.105 UTC [20717] LOG: received smart shutdown request
2026-08-07 08:41:30.108 UTC [20717] LOG: background worker "logical replication launcher" (PID 20726) exited with exit code 1
2026-08-07 08:41:30.109 UTC [20721] LOG: shutting down
2026-08-07 08:41:30.257 UTC [20717] LOG: database system is shut down
2026-08-07T08:41:30Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (42680 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:41:30 dist-test-slave-6nmv krb5kdc[21773](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:41:30 dist-test-slave-6nmv krb5kdc[21773](info): set up 2 sockets
Aug 07 08:41:30 dist-test-slave-6nmv krb5kdc[21773](info): commencing operation
krb5kdc: starting...
W20260807 08:41:31.398038 9027 mini_kdc.cc:121] Time spent starting KDC: real 1.001s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:41:31 dist-test-slave-6nmv krb5kdc[21773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092091, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:41:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:41:31Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.8.208.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.8.208.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.8.208.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/rangeradmin_127.8.208.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.8.208.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/rangeradmin_127.8.208.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.8.208.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.8.208.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.8.208.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/rangerlookup_127.8.208.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.8.208.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/rangerlookup_127.8.208.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.8.208.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.8.208.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.8.208.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/HTTP_127.8.208.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.8.208.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/HTTP_127.8.208.212@KRBTEST.COM.keytab.
I20260807 08:41:31.558413 9027 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task8uPgIu/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/postgres -l logfile start
2026-08-07 08:41:33.931 UTC [21805] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 08:41:33.931 UTC [21805] LOG: listening on IPv4 address "127.8.208.212", port 58143
2026-08-07 08:41:33.935 UTC [21805] LOG: listening on Unix socket "/tmp/.s.PGSQL.58143"
2026-08-07 08:41:33.955 UTC [21808] LOG: database system was shut down at 2026-08-07 08:41:32 UTC
2026-08-07 08:41:33.959 UTC [21805] LOG: database system is ready to accept connections
I20260807 08:41:34.881199 9027 mini_postgres.cc:96] Postgres bound to 58143
2026-08-07 08:41:34.888 UTC [21817] FATAL: database "slave" does not exist
127.8.208.212:58143 - accepting connections
I20260807 08:41:34.888504 9027 mini_ranger.cc:161] Starting Ranger...
I20260807 08:41:34.902693 9027 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 08:41:35.340603 9027 mini_ranger.cc:87] Created ranger Postgres database
I20260807 08:41:35.340672 9027 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ranger-admin
2026-08-07 08:41:35,616 [I] DB FLAVOR :POSTGRES
2026-08-07 08:41:35,617 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 08:41:35,617 [I] Checking connection..
2026-08-07 08:41:35,617 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:58143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 08:41:35,856 [I] Checking connection passed.
2026-08-07 08:41:35,857 [I] --------- Verifying version history table ---------
2026-08-07 08:41:35,857 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:58143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 08:41:36,105 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 08:41:36,105 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:58143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 08:41:36,356 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 08:41:36,356 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 08:41:36,356 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:58143/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 08:41:36.588 UTC [21886] WARNING: there is no transaction in progress
2026-08-07 08:41:36,594 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 08:41:36,595 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:58143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 08:41:36,831 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 08:41:36,831 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 08:41:36,832 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:58143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 08:41:37,059 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:58143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 08:41:37,289 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:58143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-6nmv.c.gcp-upstream.internal','N') ;"
2026-08-07 08:41:37,529 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:58143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 08:41:37,773 [I] Table x_portal_user does not exist in database ranger
2026-08-07 08:41:37,774 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:58143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 08:41:38,016 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 08:41:38,017 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:58143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 08:41:38,262 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:58143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 08:41:38,485 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 08:41:38,486 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:58143/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 08:41:39.367 UTC [22001] WARNING: there is no transaction in progress
2026-08-07 08:41:39.383 UTC [22001] WARNING: there is no transaction in progress
2026-08-07 08:41:39.398 UTC [22001] WARNING: there is no transaction in progress
2026-08-07 08:41:39.413 UTC [22001] WARNING: there is no transaction in progress
2026-08-07 08:41:39.429 UTC [22001] WARNING: there is no transaction in progress
2026-08-07 08:41:39.446 UTC [22001] WARNING: there is no transaction in progress
2026-08-07 08:41:39.513 UTC [22001] WARNING: there is no transaction in progress
2026-08-07 08:41:39.520 UTC [22001] WARNING: there is no transaction in progress
2026-08-07 08:41:39.533 UTC [22001] WARNING: there is no transaction in progress
2026-08-07 08:41:39.542 UTC [22001] WARNING: there is no transaction in progress
2026-08-07 08:41:39.551 UTC [22001] WARNING: there is no transaction in progress
2026-08-07 08:41:39.563 UTC [22001] WARNING: there is no transaction in progress
2026-08-07 08:41:39.571 UTC [22001] WARNING: there is no transaction in progress
2026-08-07 08:41:39.577 UTC [22001] WARNING: there is no transaction in progress
2026-08-07 08:41:39.582 UTC [22001] WARNING: there is no transaction in progress
2026-08-07 08:41:39.587 UTC [22001] WARNING: there is no transaction in progress
2026-08-07 08:41:40,228 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 08:41:40,229 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:58143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 08:41:40,472 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 08:41:40,472 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:58143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 08:41:40,716 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 08:41:40,716 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:58143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 08:41:40,959 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 08:41:40,959 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:58143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 08:41:41,208 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:58143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 08:41:41,452 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:58143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-6nmv.c.gcp-upstream.internal';"
2026-08-07 08:41:41,702 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 08:41:41,703 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:58143/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 08:41:41,946 [I] DB_PATCHES have already been applied
I20260807 08:41:41.952247 9027 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ranger-admin:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task8uPgIu/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 08:41:41.952306 9027 mini_ranger.cc:193] Using host: 127.8.208.212
I20260807 08:41:41.956313 9027 mini_ranger.cc:227] Ranger admin URL: http://127.8.208.212:59851
Aug 07, 2026 8:41:42 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 8:41:42 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 8:41:42 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 8:41:42 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 8:41:42 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 8:41:42 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 8:41:42 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 08:41:43.095549 9027 mini_ranger.cc:160] Time spent starting Ranger: real 8.207s user 0.000s sys 0.010s
Aug 07, 2026 8:42:02 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 8:42:02 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 07, 2026 8:42:02 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 8:42:02 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 8:42:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 8:42:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 8:42:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 8:42:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 8:42:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 8:42:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 8:42:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 8:42:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 8:42:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 8:42:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 8:42:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 8:42:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 8:42:02 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 8:42:03 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 08:42:03.947223 9027 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.8.208.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.8.208.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.8.208.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/rangerkms_127.8.208.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.8.208.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/rangerkms_127.8.208.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.8.208.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.8.208.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.8.208.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/HTTP_127.8.208.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.8.208.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/HTTP_127.8.208.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 08:42:04 dist-test-slave-6nmv krb5kdc[21773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092124, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 08:42:04.086951 9027 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 08:42:04.111488 9027 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 08:42:04.910311 9027 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 08:42:04.910398 9027 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ranger-kms
I20260807 08:42:04.910421 9027 mini_ranger_kms.cc:227] Using postgres at 127.8.208.212:58143
2026-08-07 08:42:05,069 [I] DB FLAVOR :POSTGRES
2026-08-07 08:42:05,070 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 08:42:05,070 [I] Checking connection
2026-08-07 08:42:05,070 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:58143/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 08:42:05,298 [I] connection success
2026-08-07 08:42:05,298 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 08:42:05,298 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 08:42:05,298 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:58143/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 08:42:05,522 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 08:42:05,523 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 08:42:05,523 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 08:42:05,523 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.208.212:58143/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 08:42:05,777 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 08:42:06.218387 9027 mini_ranger_kms.cc:310] Created kms service
I20260807 08:42:06.415498 9027 mini_ranger_kms.cc:326] Created kudu user
I20260807 08:42:06.455482 9027 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 08:42:06 dist-test-slave-6nmv krb5kdc[21773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092124, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.8.208.212@KRBTEST.COM
I20260807 08:42:06.825944 9027 mini_ranger_kms.cc:384] Added ranger policy
I20260807 08:42:06.826097 9027 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ranger-kms:/tmp/dist-test-task8uPgIu/build/debug/bin/postgresql.jar:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task8uPgIu/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 08:42:06.826120 9027 mini_ranger_kms.cc:240] Using host: 127.8.208.212
I20260807 08:42:06.830360 9027 mini_ranger_kms.cc:276] Ranger KMS PID: 22192
I20260807 08:42:06.830433 9027 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.8.208.212:39029
Aug 07, 2026 8:42:07 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 8:42:07 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 8:42:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 8:42:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 8:42:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 8:42:08 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260807 08:42:09.060997 9027 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 4.974s user 0.023s sys 0.127s
I20260807 08:42:09.061120 9027 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 08:42:09.061185 9027 mini_ranger_kms.cc:401] 127.8.208.212:39029/kms/v1/keys
Aug 07 08:42:09 dist-test-slave-6nmv krb5kdc[21773](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786092129, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.208.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 07 08:42:09 dist-test-slave-6nmv krb5kdc[21773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092129, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.208.212@KRBTEST.COM for HTTP/127.8.208.212@KRBTEST.COM
Aug 07 08:42:10 dist-test-slave-6nmv krb5kdc[21773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092129, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.208.212@KRBTEST.COM for HTTP/127.8.208.212@KRBTEST.COM
Aug 07 08:42:12 dist-test-slave-6nmv krb5kdc[21773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092132, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:42:12.220103 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:36123
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:35709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:36123
--ranger_config_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.208.212:39029/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:42:12.329463 22247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:12.329663 22247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:12.329695 22247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:12.333887 22247 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:42:12.333940 22247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:12.333964 22247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:12.333983 22247 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:42:12.334002 22247 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:42:12.339387 22247 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:35709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/wal
--ranger_kms_url=127.8.208.212:39029/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:36123
--ranger_config_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:36123
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22247
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:12.340198 22247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:12.341023 22247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:42:12.348927 22252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:12.348995 22255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:12.349007 22247 server_base.cc:1034] running on GCE node
W20260807 08:42:12.348963 22253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:12.349864 22247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:12.350826 22247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:12.352113 22247 hybrid_clock.cc:648] HybridClock initialized: now 1786092132352115 us; error 50 us; skew 500 ppm
Aug 07 08:42:12 dist-test-slave-6nmv krb5kdc[21773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092132, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:12.354751 22247 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:42:12.355485 22247 webserver.cc:460] Webserver started at http://127.8.208.254:32859/ using document root <none> and password file <none>
I20260807 08:42:12.355924 22247 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:12.355974 22247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:42:12.356127 22247 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 08:42:12 dist-test-slave-6nmv krb5kdc[21773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092132, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for HTTP/127.8.208.212@KRBTEST.COM
I20260807 08:42:12.404800 22247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "2e8469d194b641b3afca07c83590d769"
format_stamp: "Formatted at 2026-08-07 08:42:12 on dist-test-slave-6nmv"
server_key: "e26bbd969e419f00c24b79aadc17f87e"
server_key_iv: "d66410d02406a854230cbfda654360b1"
server_key_version: "kuduclusterkey@0"
I20260807 08:42:12.405359 22247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "2e8469d194b641b3afca07c83590d769"
format_stamp: "Formatted at 2026-08-07 08:42:12 on dist-test-slave-6nmv"
server_key: "e26bbd969e419f00c24b79aadc17f87e"
server_key_iv: "d66410d02406a854230cbfda654360b1"
server_key_version: "kuduclusterkey@0"
I20260807 08:42:12.409255 22247 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 08:42:12.424897 22262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:12.426249 22247 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 08:42:12.426407 22247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "2e8469d194b641b3afca07c83590d769"
format_stamp: "Formatted at 2026-08-07 08:42:12 on dist-test-slave-6nmv"
server_key: "e26bbd969e419f00c24b79aadc17f87e"
server_key_iv: "d66410d02406a854230cbfda654360b1"
server_key_version: "kuduclusterkey@0"
I20260807 08:42:12.426522 22247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:12.439939 22247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:12.442662 22247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:12.442838 22247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:12.449324 22247 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:36123
I20260807 08:42:12.449337 22317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:36123 every 8 connection(s)
I20260807 08:42:12.450274 22247 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:42:12.452733 22318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:42:12.456614 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 22247
I20260807 08:42:12.456744 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:42:12.457032 9027 external_mini_cluster.cc:1428] Setting key c84197bcb46bb52ae8615380f63dd254
I20260807 08:42:12.457603 22318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769: Bootstrap starting.
I20260807 08:42:12.459771 22318 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769: Neither blocks nor log segments found. Creating new log.
I20260807 08:42:12.460424 22318 log.cc:824] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769: Log is configured to *not* fsync() on all Append() calls
I20260807 08:42:12.462057 22318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769: No bootstrap required, opened a new log
Aug 07 08:42:12 dist-test-slave-6nmv krb5kdc[21773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092132, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:42:12.465047 22318 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e8469d194b641b3afca07c83590d769" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36123 } }
I20260807 08:42:12.465261 22318 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:42:12.465338 22318 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e8469d194b641b3afca07c83590d769, State: Initialized, Role: FOLLOWER
I20260807 08:42:12.465708 22318 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e8469d194b641b3afca07c83590d769" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36123 } }
I20260807 08:42:12.465857 22318 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:42:12.465921 22318 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:42:12.466048 22318 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:42:12.466858 22318 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e8469d194b641b3afca07c83590d769" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36123 } }
I20260807 08:42:12.467240 22318 leader_election.cc:302] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e8469d194b641b3afca07c83590d769; no voters:
I20260807 08:42:12.467613 22318 leader_election.cc:288] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:42:12.467691 22324 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:42:12.467904 22324 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [term 1 LEADER]: Becoming Leader. State: Replica: 2e8469d194b641b3afca07c83590d769, State: Running, Role: LEADER
I20260807 08:42:12.468243 22324 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e8469d194b641b3afca07c83590d769" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36123 } }
I20260807 08:42:12.468708 22318 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:42:12.469830 22326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e8469d194b641b3afca07c83590d769. Latest consensus state: current_term: 1 leader_uuid: "2e8469d194b641b3afca07c83590d769" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e8469d194b641b3afca07c83590d769" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36123 } } }
I20260807 08:42:12.469983 22326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [sys.catalog]: This master's current role is: LEADER
I20260807 08:42:12.470000 22325 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e8469d194b641b3afca07c83590d769" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e8469d194b641b3afca07c83590d769" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36123 } } }
I20260807 08:42:12.470052 22325 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [sys.catalog]: This master's current role is: LEADER
I20260807 08:42:12.470393 22333 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:42:12.470666 22322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:12.458304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60118 (local address 127.8.208.254:36123)
0807 08:42:12.458654 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:12.458667 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:12.458697 (+ 30us) server_negotiation.cc:407] Connection header received
0807 08:42:12.459218 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:12.459231 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:12.459515 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:12.459806 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:12.460517 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:12.461536 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:12.462413 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:12.462824 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:12.462981 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:12.465204 (+ 2223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:12.465208 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:12.465218 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:12.465240 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:12.466976 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:12.467507 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:12.467512 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:12.467515 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:12.467681 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:12.468020 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:12.468025 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:12.468027 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:12.468470 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:12.468647 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:12.469060 (+ 413us) server_negotiation.cc:299] Negotiation successful
0807 08:42:12.469458 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":108,"threads_started":1}
I20260807 08:42:12.473925 22333 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:42:12.474275 22318 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 08:42:12.482556 22333 catalog_manager.cc:1347] Generated new cluster ID: 263f784e8ea04284879be1c4cd15adbc
I20260807 08:42:12.482618 22333 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:42:12.499153 22333 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:42:12.500281 22333 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:42:12.510182 22333 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769: Generated new TSK 0
I20260807 08:42:12.510751 22333 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.208.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
I20260807 08:42:13.140736 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.208.212:39029/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:36123
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:35709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:42:13.276353 22369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:13.276585 22369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:13.276623 22369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:13.280642 22369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:13.280704 22369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:13.280778 22369 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:42:13.287716 22369 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:35709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.8.208.212:39029/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:36123
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22369
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:13.288739 22369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:13.289767 22369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:42:13.299698 22379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:13.299683 22382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:13.300174 22380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:13.300628 22369 server_base.cc:1034] running on GCE node
I20260807 08:42:13.301043 22369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:13.301786 22369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:13.303316 22369 hybrid_clock.cc:648] HybridClock initialized: now 1786092133303289 us; error 31 us; skew 500 ppm
Aug 07 08:42:13 dist-test-slave-6nmv krb5kdc[21773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092133, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:13.308228 22369 init.cc:377] Logged in from keytab as kudu/127.8.208.193@KRBTEST.COM (short username kudu)
I20260807 08:42:13.309332 22369 webserver.cc:460] Webserver started at http://127.8.208.193:36939/ using document root <none> and password file <none>
I20260807 08:42:13.310045 22369 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:13.310185 22369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:42:13.310467 22369 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 08:42:13 dist-test-slave-6nmv krb5kdc[21773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092133, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for HTTP/127.8.208.212@KRBTEST.COM
I20260807 08:42:13.327236 22369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "e426ed0db97d449baae30341348e0fe3"
format_stamp: "Formatted at 2026-08-07 08:42:13 on dist-test-slave-6nmv"
server_key: "91c95c2a0f01f17e98e9a663c902c46c"
server_key_iv: "4926daf00b4b749325be9253348c0738"
server_key_version: "kuduclusterkey@0"
I20260807 08:42:13.328045 22369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "e426ed0db97d449baae30341348e0fe3"
format_stamp: "Formatted at 2026-08-07 08:42:13 on dist-test-slave-6nmv"
server_key: "91c95c2a0f01f17e98e9a663c902c46c"
server_key_iv: "4926daf00b4b749325be9253348c0738"
server_key_version: "kuduclusterkey@0"
I20260807 08:42:13.335258 22369 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.003s
I20260807 08:42:13.356206 22391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:13.357671 22369 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260807 08:42:13.357843 22369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "e426ed0db97d449baae30341348e0fe3"
format_stamp: "Formatted at 2026-08-07 08:42:13 on dist-test-slave-6nmv"
server_key: "91c95c2a0f01f17e98e9a663c902c46c"
server_key_iv: "4926daf00b4b749325be9253348c0738"
server_key_version: "kuduclusterkey@0"
I20260807 08:42:13.357996 22369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:13.381687 22369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:13.384806 22369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:13.385048 22369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:13.385740 22369 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:42:13.386821 22369 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:42:13.386952 22369 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:13.387087 22369 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:42:13.387176 22369 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:13.398553 22369 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:45825
I20260807 08:42:13.399487 22369 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:42:13.400372 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 22369
I20260807 08:42:13.400511 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
I20260807 08:42:13.400861 9027 external_mini_cluster.cc:1428] Setting key bbe37600252bdb54b2c38c49e328ee46
I20260807 08:42:13.402403 22513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:45825 every 8 connection(s)
WARNING: no policy specified for kudu/127.8.208.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.194@KRBTEST.COM" created.
Aug 07 08:42:13 dist-test-slave-6nmv krb5kdc[21773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092133, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:42:13.423578 22518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:13.406932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36123 (local address 127.8.208.193:46713)
0807 08:42:13.408503 (+ 1571us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:13.408571 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:13.409586 (+ 1015us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:13.410554 (+ 968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:13.410566 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:13.410939 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:13.411554 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:13.411573 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:13.412744 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:13.412749 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:13.414069 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:13.414080 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:13.414757 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:13.414761 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:13.414985 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:13.415667 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:13.415690 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:13.417784 (+ 2094us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:13.420352 (+ 2568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:13.420359 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:13.420373 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:13.420704 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:13.421084 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:13.421088 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:13.421090 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:13.421262 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:13.421797 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:13.421803 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:13.422125 (+ 322us) client_negotiation.cc:769] Sending connection context
0807 08:42:13.422323 (+ 198us) client_negotiation.cc:240] Negotiation successful
0807 08:42:13.422634 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1323,"thread_start_us":153,"threads_started":1}
I20260807 08:42:13.424189 22519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:13.408045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:46713 (local address 127.8.208.254:36123)
0807 08:42:13.410027 (+ 1982us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:13.410041 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:13.410057 (+ 16us) server_negotiation.cc:407] Connection header received
0807 08:42:13.410101 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:13.410104 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:13.410152 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:13.410242 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:13.411749 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:13.412564 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:13.414201 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:13.414521 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:13.414636 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:13.418042 (+ 3406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:13.418046 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:13.418049 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:13.418097 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:13.420207 (+ 2110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:13.420836 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:13.420839 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:13.420841 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:13.420963 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:13.421386 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:13.421390 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:13.421392 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:13.421625 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:13.421742 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:13.423845 (+ 2103us) server_negotiation.cc:299] Negotiation successful
0807 08:42:13.424010 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1896,"thread_start_us":109,"threads_started":1}
I20260807 08:42:13.425884 22514 heartbeater.cc:347] Connected to a master server at 127.8.208.254:36123
I20260807 08:42:13.426134 22514 heartbeater.cc:464] Registering TS with master...
I20260807 08:42:13.426663 22514 heartbeater.cc:511] Master 127.8.208.254:36123 requested a full tablet report, sending...
I20260807 08:42:13.428401 22279 ts_manager.cc:194] Registered new tserver with Master: e426ed0db97d449baae30341348e0fe3 (127.8.208.193:45825)
I20260807 08:42:13.430163 22279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.193@KRBTEST.COM'} at 127.8.208.193:46713
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
I20260807 08:42:13.438818 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.208.212:39029/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:36123
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:35709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 08:42:13 dist-test-slave-6nmv krb5kdc[21773](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786092133, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 08:42:13.576857 22521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:13.577116 22521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:13.577206 22521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:13.580950 22521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:13.581029 22521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:13.581120 22521 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:42:13.585749 22521 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:35709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.8.208.212:39029/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:36123
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:13.586704 22521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:13.587682 22521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:42:13.596709 22527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:13.597144 22530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:13.597508 22528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:13.597661 22521 server_base.cc:1034] running on GCE node
I20260807 08:42:13.598098 22521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:13.598758 22521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:13.599969 22521 hybrid_clock.cc:648] HybridClock initialized: now 1786092133599952 us; error 42 us; skew 500 ppm
Aug 07 08:42:13 dist-test-slave-6nmv krb5kdc[21773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092133, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:13.603634 22521 init.cc:377] Logged in from keytab as kudu/127.8.208.194@KRBTEST.COM (short username kudu)
I20260807 08:42:13.604643 22521 webserver.cc:460] Webserver started at http://127.8.208.194:39341/ using document root <none> and password file <none>
I20260807 08:42:13.605324 22521 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:13.605400 22521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:42:13.605657 22521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 08:42:13 dist-test-slave-6nmv krb5kdc[21773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092133, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for HTTP/127.8.208.212@KRBTEST.COM
I20260807 08:42:13.629204 22521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "129b0f6fc344479292ffc5cd4d531b21"
format_stamp: "Formatted at 2026-08-07 08:42:13 on dist-test-slave-6nmv"
server_key: "8ea9783442dbb58a88ad4d90296009a7"
server_key_iv: "e18fd2dfaad6667c2ec97798040f7292"
server_key_version: "kuduclusterkey@0"
I20260807 08:42:13.629905 22521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "129b0f6fc344479292ffc5cd4d531b21"
format_stamp: "Formatted at 2026-08-07 08:42:13 on dist-test-slave-6nmv"
server_key: "8ea9783442dbb58a88ad4d90296009a7"
server_key_iv: "e18fd2dfaad6667c2ec97798040f7292"
server_key_version: "kuduclusterkey@0"
I20260807 08:42:13.638602 22521 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.003s sys 0.000s
I20260807 08:42:13.655428 22539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:13.656981 22521 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 08:42:13.657107 22521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "129b0f6fc344479292ffc5cd4d531b21"
format_stamp: "Formatted at 2026-08-07 08:42:13 on dist-test-slave-6nmv"
server_key: "8ea9783442dbb58a88ad4d90296009a7"
server_key_iv: "e18fd2dfaad6667c2ec97798040f7292"
server_key_version: "kuduclusterkey@0"
I20260807 08:42:13.657239 22521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:13.678833 22521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:13.681905 22521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:13.682093 22521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:13.682672 22521 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:42:13.683586 22521 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:42:13.683647 22521 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:13.683703 22521 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:42:13.683732 22521 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:13.693029 22521 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:37743
I20260807 08:42:13.694883 22521 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:42:13.695977 22658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:37743 every 8 connection(s)
I20260807 08:42:13.696143 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 22521
I20260807 08:42:13.696250 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:42:13.696599 9027 external_mini_cluster.cc:1428] Setting key a483521e68f19fa0a28767ba034a238d
WARNING: no policy specified for kudu/127.8.208.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.195@KRBTEST.COM" created.
Aug 07 08:42:13 dist-test-slave-6nmv krb5kdc[21773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092133, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:42:13.726789 22519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:13.699590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:49057 (local address 127.8.208.254:36123)
0807 08:42:13.699756 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:13.699762 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:13.710472 (+ 10710us) server_negotiation.cc:407] Connection header received
0807 08:42:13.713530 (+ 3058us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:13.713533 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:13.713586 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:13.713646 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:13.715089 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:13.715835 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:13.717472 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:13.717878 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:13.717951 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:13.722688 (+ 4737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:13.722691 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:13.722693 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:13.722718 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:13.724281 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:13.724828 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:13.724831 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:13.724833 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:13.724911 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:13.725365 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:13.725370 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:13.725371 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:13.725590 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:13.725674 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:13.726471 (+ 797us) server_negotiation.cc:299] Negotiation successful
0807 08:42:13.726622 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260807 08:42:13.727906 22662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:13.698674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36123 (local address 127.8.208.194:49057)
0807 08:42:13.710258 (+ 11584us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:13.710321 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:13.713271 (+ 2950us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:13.714050 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:13.714058 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:13.714346 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:13.714938 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:13.714955 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:13.715982 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:13.715985 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:13.717314 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:13.717325 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:13.718134 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:13.718138 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:13.718317 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:13.720986 (+ 2669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:13.721004 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:13.722521 (+ 1517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:13.724407 (+ 1886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:13.724412 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:13.724424 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:13.724721 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:13.725011 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:13.725014 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:13.725016 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:13.725233 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:13.725740 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:13.725745 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:13.726074 (+ 329us) client_negotiation.cc:769] Sending connection context
0807 08:42:13.726305 (+ 231us) client_negotiation.cc:240] Negotiation successful
0807 08:42:13.726652 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11319,"thread_start_us":129,"threads_started":1}
I20260807 08:42:13.729138 22659 heartbeater.cc:347] Connected to a master server at 127.8.208.254:36123
I20260807 08:42:13.729360 22659 heartbeater.cc:464] Registering TS with master...
I20260807 08:42:13.729952 22659 heartbeater.cc:511] Master 127.8.208.254:36123 requested a full tablet report, sending...
I20260807 08:42:13.731150 22279 ts_manager.cc:194] Registered new tserver with Master: 129b0f6fc344479292ffc5cd4d531b21 (127.8.208.194:37743)
I20260807 08:42:13.731758 22279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.194@KRBTEST.COM'} at 127.8.208.194:49057
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
I20260807 08:42:13.741369 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.208.212:39029/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:36123
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:35709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:42:13.887738 22665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:13.888502 22665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:13.888674 22665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:13.894483 22665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:13.894630 22665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:13.894767 22665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:42:13.902019 22665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:35709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.8.208.212:39029/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:36123
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:13.903672 22665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:13.905305 22665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:42:13.917975 22671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:13.918874 22675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:13.919106 22665 server_base.cc:1034] running on GCE node
W20260807 08:42:13.919525 22670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:13.920038 22665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:13.920738 22665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:13.921893 22665 hybrid_clock.cc:648] HybridClock initialized: now 1786092133921832 us; error 76 us; skew 500 ppm
Aug 07 08:42:13 dist-test-slave-6nmv krb5kdc[21773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092133, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:13.925284 22665 init.cc:377] Logged in from keytab as kudu/127.8.208.195@KRBTEST.COM (short username kudu)
I20260807 08:42:13.926260 22665 webserver.cc:460] Webserver started at http://127.8.208.195:42157/ using document root <none> and password file <none>
I20260807 08:42:13.926944 22665 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:13.927030 22665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:42:13.927249 22665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 08:42:13 dist-test-slave-6nmv krb5kdc[21773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092133, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for HTTP/127.8.208.212@KRBTEST.COM
I20260807 08:42:13.943449 22665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "811829adf8c44048a93f9be0fe91a418"
format_stamp: "Formatted at 2026-08-07 08:42:13 on dist-test-slave-6nmv"
server_key: "6bc19004b10c34ff7b93a5c0d929eb42"
server_key_iv: "e570d09e30ff08fad13b3ebf6880e7d3"
server_key_version: "kuduclusterkey@0"
I20260807 08:42:13.944135 22665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "811829adf8c44048a93f9be0fe91a418"
format_stamp: "Formatted at 2026-08-07 08:42:13 on dist-test-slave-6nmv"
server_key: "6bc19004b10c34ff7b93a5c0d929eb42"
server_key_iv: "e570d09e30ff08fad13b3ebf6880e7d3"
server_key_version: "kuduclusterkey@0"
I20260807 08:42:13.949177 22665 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260807 08:42:13.968789 22682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
Aug 07 08:42:13 dist-test-slave-6nmv krb5kdc[21773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092133, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for HTTP/127.8.208.212@KRBTEST.COM
I20260807 08:42:13.970239 22665 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 08:42:13.970346 22665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "811829adf8c44048a93f9be0fe91a418"
format_stamp: "Formatted at 2026-08-07 08:42:13 on dist-test-slave-6nmv"
server_key: "6bc19004b10c34ff7b93a5c0d929eb42"
server_key_iv: "e570d09e30ff08fad13b3ebf6880e7d3"
server_key_version: "kuduclusterkey@0"
I20260807 08:42:13.970463 22665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:13.989353 22665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:13.992409 22665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:13.992571 22665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:13.993121 22665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:42:13.993970 22665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:42:13.994024 22665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:13.994072 22665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:42:13.994096 22665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:14.003465 22665 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:34719
I20260807 08:42:14.004500 22665 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:42:14.007676 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 22665
I20260807 08:42:14.007826 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:42:14.008128 9027 external_mini_cluster.cc:1428] Setting key 41ebba2e9b261ed551b98feaf303c168
I20260807 08:42:14.016393 22808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:34719 every 8 connection(s)
Aug 07 08:42:14 dist-test-slave-6nmv krb5kdc[21773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092133, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:42:14.035269 22519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:14.016170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:50877 (local address 127.8.208.254:36123)
0807 08:42:14.016279 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:14.016282 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:14.017156 (+ 874us) server_negotiation.cc:407] Connection header received
0807 08:42:14.018333 (+ 1177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:14.018336 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:14.018398 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:14.018443 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:14.019931 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:14.020721 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:14.025567 (+ 4846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:14.025899 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:14.025980 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:14.029080 (+ 3100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:14.029083 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:14.029085 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:14.029108 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:14.030801 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:14.031581 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:14.031585 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:14.031587 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:14.031702 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:14.032444 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:14.032448 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:14.032450 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:14.032670 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:14.032738 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:14.035005 (+ 2267us) server_negotiation.cc:299] Negotiation successful
0807 08:42:14.035119 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 08:42:14.037773 22811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:14.015218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36123 (local address 127.8.208.195:50877)
0807 08:42:14.017019 (+ 1801us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:14.017069 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:14.018109 (+ 1040us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:14.018806 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:14.018813 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:14.019147 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:14.019776 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:14.019792 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:14.022743 (+ 2951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:14.022746 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:14.025441 (+ 2695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:14.025453 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:14.026164 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:14.026167 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:14.026342 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:14.027062 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:14.027081 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:14.028907 (+ 1826us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:14.030986 (+ 2079us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:14.030991 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:14.031005 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:14.031474 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:14.031809 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:14.031812 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:14.031813 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:14.032339 (+ 526us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:14.034414 (+ 2075us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:14.034420 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:14.034711 (+ 291us) client_negotiation.cc:769] Sending connection context
0807 08:42:14.035656 (+ 945us) client_negotiation.cc:240] Negotiation successful
0807 08:42:14.036121 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1589,"thread_start_us":138,"threads_started":1}
I20260807 08:42:14.039695 22809 heartbeater.cc:347] Connected to a master server at 127.8.208.254:36123
I20260807 08:42:14.039913 22809 heartbeater.cc:464] Registering TS with master...
I20260807 08:42:14.040434 22809 heartbeater.cc:511] Master 127.8.208.254:36123 requested a full tablet report, sending...
I20260807 08:42:14.041750 22279 ts_manager.cc:194] Registered new tserver with Master: 811829adf8c44048a93f9be0fe91a418 (127.8.208.195:34719)
I20260807 08:42:14.042384 22279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.195@KRBTEST.COM'} at 127.8.208.195:50877
I20260807 08:42:14.046178 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 08:42:14.046872 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 22369
I20260807 08:42:14.071954 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 22521
I20260807 08:42:14.083557 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 22665
I20260807 08:42:14.090898 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 22247
I20260807 08:42:14.098623 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:36123
--webserver_interface=127.8.208.254
--webserver_port=32859
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:35709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:36123
--ranger_config_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.208.212:39029/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.8.208.212:39029/kms with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:42:14.201988 22812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:14.202308 22812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:14.202418 22812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:14.206535 22812 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:42:14.206614 22812 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:14.206672 22812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:14.206717 22812 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:42:14.206755 22812 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:42:14.211510 22812 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:35709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.8.208.212:39029/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:36123
--ranger_config_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:36123
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=32859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22812
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:14.212435 22812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:14.213376 22812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:42:14.221241 22817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:14.221351 22818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:14.221494 22812 server_base.cc:1034] running on GCE node
W20260807 08:42:14.221241 22821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:14.222148 22812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:14.223165 22812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:14.224308 22812 hybrid_clock.cc:648] HybridClock initialized: now 1786092134224281 us; error 47 us; skew 500 ppm
Aug 07 08:42:14 dist-test-slave-6nmv krb5kdc[21773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092134, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:14.226809 22812 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:42:14.227578 22812 webserver.cc:460] Webserver started at http://127.8.208.254:32859/ using document root <none> and password file <none>
I20260807 08:42:14.228058 22812 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:14.228114 22812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 08:42:14 dist-test-slave-6nmv krb5kdc[21773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092134, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for HTTP/127.8.208.212@KRBTEST.COM
I20260807 08:42:14.283679 22812 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 08:42:14.286151 22830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:14.287410 22812 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 08:42:14.287549 22812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "2e8469d194b641b3afca07c83590d769"
format_stamp: "Formatted at 2026-08-07 08:42:12 on dist-test-slave-6nmv"
server_key: "e26bbd969e419f00c24b79aadc17f87e"
server_key_iv: "d66410d02406a854230cbfda654360b1"
server_key_version: "kuduclusterkey@0"
I20260807 08:42:14.288132 22812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:14.336756 22812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:14.340185 22812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:14.340407 22812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:14.347353 22812 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:36123
I20260807 08:42:14.347378 22889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:36123 every 8 connection(s)
I20260807 08:42:14.348397 22812 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:42:14.352581 22890 sys_catalog.cc:263] Verifying existing consensus state
I20260807 08:42:14.354121 22890 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769: Bootstrap starting.
I20260807 08:42:14.356128 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 22812
I20260807 08:42:14.356585 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.208.212:39029/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:45825
--local_ip_for_outbound_sockets=127.8.208.193
--tserver_master_addrs=127.8.208.254:36123
--webserver_port=36939
--webserver_interface=127.8.208.193
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:35709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.8.208.212:39029/kms with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 08:42:14.370846 22890 log.cc:824] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769: Log is configured to *not* fsync() on all Append() calls
I20260807 08:42:14.377167 22890 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 08:42:14.377550 22890 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769: Bootstrap complete.
I20260807 08:42:14.381486 22890 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e8469d194b641b3afca07c83590d769" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36123 } }
I20260807 08:42:14.381850 22890 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e8469d194b641b3afca07c83590d769, State: Initialized, Role: FOLLOWER
I20260807 08:42:14.382270 22890 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e8469d194b641b3afca07c83590d769" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36123 } }
I20260807 08:42:14.382409 22890 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:42:14.382479 22890 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:42:14.382586 22890 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [term 1 FOLLOWER]: Advancing to term 2
I20260807 08:42:14.384151 22890 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e8469d194b641b3afca07c83590d769" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36123 } }
I20260807 08:42:14.384459 22890 leader_election.cc:302] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e8469d194b641b3afca07c83590d769; no voters:
I20260807 08:42:14.384737 22890 leader_election.cc:288] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 08:42:14.384892 22895 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 08:42:14.385229 22895 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [term 2 LEADER]: Becoming Leader. State: Replica: 2e8469d194b641b3afca07c83590d769, State: Running, Role: LEADER
I20260807 08:42:14.385537 22895 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e8469d194b641b3afca07c83590d769" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36123 } }
I20260807 08:42:14.385758 22890 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:42:14.386926 22897 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e8469d194b641b3afca07c83590d769. Latest consensus state: current_term: 2 leader_uuid: "2e8469d194b641b3afca07c83590d769" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e8469d194b641b3afca07c83590d769" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36123 } } }
I20260807 08:42:14.387048 22897 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [sys.catalog]: This master's current role is: LEADER
I20260807 08:42:14.387385 22904 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:42:14.387343 22896 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2e8469d194b641b3afca07c83590d769" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e8469d194b641b3afca07c83590d769" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36123 } } }
I20260807 08:42:14.387494 22896 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769 [sys.catalog]: This master's current role is: LEADER
I20260807 08:42:14.388005 22890 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 08:42:14.393844 22904 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:42:14.394596 22904 catalog_manager.cc:1259] Loaded cluster ID: 263f784e8ea04284879be1c4cd15adbc
I20260807 08:42:14.394678 22904 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:42:14.397099 22904 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:42:14.397871 22904 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769: Loaded TSK: 0
I20260807 08:42:14.399067 22904 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 08:42:14.485405 22893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:14.485693 22893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:14.485780 22893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:14.490514 22893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:14.490644 22893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:14.490803 22893 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:42:14.497197 22893 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:35709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.8.208.212:39029/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:45825
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=36939
--tserver_master_addrs=127.8.208.254:36123
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:14.498306 22893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:14.499320 22893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:42:14.508450 22930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:14.508710 22929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:14.508905 22893 server_base.cc:1034] running on GCE node
W20260807 08:42:14.508971 22932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:14.509546 22893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:14.510289 22893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:14.511495 22893 hybrid_clock.cc:648] HybridClock initialized: now 1786092134511453 us; error 57 us; skew 500 ppm
Aug 07 08:42:14 dist-test-slave-6nmv krb5kdc[21773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092134, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:14.514966 22893 init.cc:377] Logged in from keytab as kudu/127.8.208.193@KRBTEST.COM (short username kudu)
I20260807 08:42:14.515995 22893 webserver.cc:460] Webserver started at http://127.8.208.193:36939/ using document root <none> and password file <none>
I20260807 08:42:14.516651 22893 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:14.516758 22893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 08:42:14 dist-test-slave-6nmv krb5kdc[21773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092134, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for HTTP/127.8.208.212@KRBTEST.COM
I20260807 08:42:14.548650 22893 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.002s sys 0.000s
I20260807 08:42:14.554162 22942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:14.555644 22893 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20260807 08:42:14.555737 22893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "e426ed0db97d449baae30341348e0fe3"
format_stamp: "Formatted at 2026-08-07 08:42:13 on dist-test-slave-6nmv"
server_key: "91c95c2a0f01f17e98e9a663c902c46c"
server_key_iv: "4926daf00b4b749325be9253348c0738"
server_key_version: "kuduclusterkey@0"
I20260807 08:42:14.556274 22893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:14.573913 22893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:14.577255 22893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:14.577437 22893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:14.578181 22893 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:42:14.579156 22893 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:42:14.579241 22893 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:14.579326 22893 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:42:14.579384 22893 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:14.589397 22893 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:45825
I20260807 08:42:14.590546 22893 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:42:14.593776 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 22893
I20260807 08:42:14.594305 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.208.212:39029/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:37743
--local_ip_for_outbound_sockets=127.8.208.194
--tserver_master_addrs=127.8.208.254:36123
--webserver_port=39341
--webserver_interface=127.8.208.194
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:35709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.8.208.212:39029/kms with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 08:42:14.597082 23072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:45825 every 8 connection(s)
Aug 07 08:42:14 dist-test-slave-6nmv krb5kdc[21773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092134, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:42:14.623687 23076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:14.599117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36123 (local address 127.8.208.193:55517)
0807 08:42:14.604888 (+ 5771us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:14.604938 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:14.605912 (+ 974us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:14.609018 (+ 3106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:14.609029 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:14.609395 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:14.610076 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:14.610099 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:14.611930 (+ 1831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:14.611934 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:14.613130 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:14.613139 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:14.614398 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:14.614402 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:14.614556 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:14.615159 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:14.615177 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:14.616675 (+ 1498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:14.619343 (+ 2668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:14.619348 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:14.619359 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:14.619679 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:14.620112 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:14.620115 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:14.620116 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:14.620278 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:14.621057 (+ 779us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:14.621062 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:14.621316 (+ 254us) client_negotiation.cc:769] Sending connection context
0807 08:42:14.621503 (+ 187us) client_negotiation.cc:240] Negotiation successful
0807 08:42:14.621768 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5569,"thread_start_us":135,"threads_started":1}
I20260807 08:42:14.624449 23078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:14.604710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:55517 (local address 127.8.208.254:36123)
0807 08:42:14.607282 (+ 2572us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:14.607306 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:14.607355 (+ 49us) server_negotiation.cc:407] Connection header received
0807 08:42:14.607670 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:14.607687 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:14.608118 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:14.608455 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:14.610268 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:14.611781 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:14.613250 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:14.614094 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:14.614221 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:14.616898 (+ 2677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:14.616905 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:14.616921 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:14.616955 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:14.619188 (+ 2233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:14.619823 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:14.619830 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:14.619837 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:14.619990 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:14.620399 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:14.620404 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:14.620406 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:14.620846 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:14.620997 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:14.622009 (+ 1012us) server_negotiation.cc:299] Negotiation successful
0807 08:42:14.622262 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2402,"thread_start_us":149,"threads_started":1}
I20260807 08:42:14.627290 23073 heartbeater.cc:347] Connected to a master server at 127.8.208.254:36123
I20260807 08:42:14.627540 23073 heartbeater.cc:464] Registering TS with master...
I20260807 08:42:14.628062 23073 heartbeater.cc:511] Master 127.8.208.254:36123 requested a full tablet report, sending...
W20260807 08:42:14.629977 23073 heartbeater.cc:644] Failed to heartbeat to 127.8.208.254:36123 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 08:42:14.630080 23073 heartbeater.cc:464] Registering TS with master...
I20260807 08:42:14.630219 23073 heartbeater.cc:511] Master 127.8.208.254:36123 requested a full tablet report, sending...
I20260807 08:42:14.630972 23073 heartbeater.cc:464] Registering TS with master...
I20260807 08:42:14.631127 23073 heartbeater.cc:511] Master 127.8.208.254:36123 requested a full tablet report, sending...
W20260807 08:42:14.631834 23073 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 08:42:14.728917 23075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:14.729198 23075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:14.729269 23075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:14.733199 23075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:14.733263 23075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:14.733335 23075 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:42:14.739706 23075 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:35709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.8.208.212:39029/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:37743
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=39341
--tserver_master_addrs=127.8.208.254:36123
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23075
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:14.740938 23075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:14.742076 23075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:42:14.752328 23084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:14.752442 23086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:14.752328 23083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:14.753453 23075 server_base.cc:1034] running on GCE node
I20260807 08:42:14.754120 23075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:14.754779 23075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:14.756006 23075 hybrid_clock.cc:648] HybridClock initialized: now 1786092134755936 us; error 85 us; skew 500 ppm
Aug 07 08:42:14 dist-test-slave-6nmv krb5kdc[21773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092134, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:14.763278 23075 init.cc:377] Logged in from keytab as kudu/127.8.208.194@KRBTEST.COM (short username kudu)
I20260807 08:42:14.764097 23075 webserver.cc:460] Webserver started at http://127.8.208.194:39341/ using document root <none> and password file <none>
I20260807 08:42:14.764672 23075 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:14.764740 23075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 08:42:14 dist-test-slave-6nmv krb5kdc[21773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092134, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for HTTP/127.8.208.212@KRBTEST.COM
I20260807 08:42:14.795332 23075 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 08:42:14.798408 23094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:14.799798 23075 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 08:42:14.799944 23075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "129b0f6fc344479292ffc5cd4d531b21"
format_stamp: "Formatted at 2026-08-07 08:42:13 on dist-test-slave-6nmv"
server_key: "8ea9783442dbb58a88ad4d90296009a7"
server_key_iv: "e18fd2dfaad6667c2ec97798040f7292"
server_key_version: "kuduclusterkey@0"
I20260807 08:42:14.800612 23075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:14.822149 23075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:14.826208 23075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:14.826411 23075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:14.827008 23075 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:42:14.827929 23075 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:42:14.828011 23075 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:14.828099 23075 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:42:14.828146 23075 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:14.839407 23075 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:37743
I20260807 08:42:14.839735 23221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:37743 every 8 connection(s)
I20260807 08:42:14.840765 23075 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:42:14.851094 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 23075
I20260807 08:42:14.851686 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.208.212:39029/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:34719
--local_ip_for_outbound_sockets=127.8.208.195
--tserver_master_addrs=127.8.208.254:36123
--webserver_port=42157
--webserver_interface=127.8.208.195
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:35709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.8.208.212:39029/kms with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 08:42:14 dist-test-slave-6nmv krb5kdc[21773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092134, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:42:14.860167 23078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:14.842843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:56407 (local address 127.8.208.254:36123)
0807 08:42:14.842997 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:14.843002 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:14.843994 (+ 992us) server_negotiation.cc:407] Connection header received
0807 08:42:14.845257 (+ 1263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:14.845260 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:14.845319 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:14.845417 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:14.846932 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:14.847782 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:14.849475 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:14.849854 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:14.849961 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:14.855961 (+ 6000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:14.855965 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:14.855968 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:14.855994 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:14.857850 (+ 1856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:14.858467 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:14.858470 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:14.858472 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:14.858559 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:14.858940 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:14.858943 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:14.858945 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:14.859150 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:14.859215 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:14.859886 (+ 671us) server_negotiation.cc:299] Negotiation successful
0807 08:42:14.860008 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 08:42:14.861716 23224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:14.843275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36123 (local address 127.8.208.194:56407)
0807 08:42:14.843824 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:14.843881 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:14.845006 (+ 1125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:14.845624 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:14.845634 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:14.846031 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:14.846749 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:14.846772 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:14.847935 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:14.847940 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:14.849289 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:14.849301 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:14.850175 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:14.850179 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:14.850413 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:14.854194 (+ 3781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:14.854217 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:14.855771 (+ 1554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:14.857973 (+ 2202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:14.857978 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:14.857991 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:14.858334 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:14.858671 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:14.858674 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:14.858676 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:14.858835 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:14.859300 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:14.859305 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:14.859632 (+ 327us) client_negotiation.cc:769] Sending connection context
0807 08:42:14.860338 (+ 706us) client_negotiation.cc:240] Negotiation successful
0807 08:42:14.860723 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":120,"threads_started":1}
I20260807 08:42:14.863011 23222 heartbeater.cc:347] Connected to a master server at 127.8.208.254:36123
I20260807 08:42:14.863276 23222 heartbeater.cc:464] Registering TS with master...
I20260807 08:42:14.863883 23222 heartbeater.cc:511] Master 127.8.208.254:36123 requested a full tablet report, sending...
W20260807 08:42:14.865674 23222 heartbeater.cc:644] Failed to heartbeat to 127.8.208.254:36123 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 08:42:14.865832 23222 heartbeater.cc:464] Registering TS with master...
I20260807 08:42:14.866027 23222 heartbeater.cc:511] Master 127.8.208.254:36123 requested a full tablet report, sending...
I20260807 08:42:14.866956 23222 heartbeater.cc:464] Registering TS with master...
I20260807 08:42:14.867156 23222 heartbeater.cc:511] Master 127.8.208.254:36123 requested a full tablet report, sending...
W20260807 08:42:14.868094 23222 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 08:42:14.989646 23225 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:14.989980 23225 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:14.990043 23225 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:14.995671 23225 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:14.995743 23225 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:14.995817 23225 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:42:15.002691 23225 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:35709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.8.208.212:39029/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:34719
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=42157
--tserver_master_addrs=127.8.208.254:36123
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23225
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:15.003943 23225 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:15.005183 23225 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:42:15.019739 23232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:15.020092 23231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:15.020345 23225 server_base.cc:1034] running on GCE node
W20260807 08:42:15.020396 23234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:15.020834 23225 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:15.021561 23225 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:15.022760 23225 hybrid_clock.cc:648] HybridClock initialized: now 1786092135022731 us; error 41 us; skew 500 ppm
Aug 07 08:42:15 dist-test-slave-6nmv krb5kdc[21773](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092135, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:15.025660 23225 init.cc:377] Logged in from keytab as kudu/127.8.208.195@KRBTEST.COM (short username kudu)
I20260807 08:42:15.026479 23225 webserver.cc:460] Webserver started at http://127.8.208.195:42157/ using document root <none> and password file <none>
I20260807 08:42:15.027064 23225 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:15.027174 23225 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 08:42:15 dist-test-slave-6nmv krb5kdc[21773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092135, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for HTTP/127.8.208.212@KRBTEST.COM
I20260807 08:42:15.051910 23225 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.001s
I20260807 08:42:15.054839 23244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:15.056373 23225 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 08:42:15.056509 23225 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "811829adf8c44048a93f9be0fe91a418"
format_stamp: "Formatted at 2026-08-07 08:42:13 on dist-test-slave-6nmv"
server_key: "6bc19004b10c34ff7b93a5c0d929eb42"
server_key_iv: "e570d09e30ff08fad13b3ebf6880e7d3"
server_key_version: "kuduclusterkey@0"
I20260807 08:42:15.057240 23225 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:15.082839 23225 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:15.086483 23225 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:15.086707 23225 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:15.087459 23225 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:42:15.088548 23225 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:42:15.088610 23225 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:15.088666 23225 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:42:15.088691 23225 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:15.099372 23225 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:34719
I20260807 08:42:15.100545 23225 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:42:15.100835 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 23225
I20260807 08:42:15.102110 23366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:34719 every 8 connection(s)
I20260807 08:42:15.112010 23078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:15.101524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56772 (local address 127.8.208.254:36123)
0807 08:42:15.101675 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:15.101680 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:15.102163 (+ 483us) server_negotiation.cc:407] Connection header received
0807 08:42:15.102381 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:15.102386 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:15.102435 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:15.102488 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:15.103517 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.104316 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.105314 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.105638 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.105745 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:15.107489 (+ 1744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:15.107493 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:15.107495 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:15.107520 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:15.109345 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:15.109868 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:15.109873 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:15.109876 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:15.109966 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:15.111069 (+ 1103us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:15.111072 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:15.111074 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:15.111286 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:15.111502 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:15.111732 (+ 230us) server_negotiation.cc:299] Negotiation successful
0807 08:42:15.111856 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
Aug 07 08:42:15 dist-test-slave-6nmv krb5kdc[21773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092135, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:42:15.119431 23371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:15.104760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:58647 (local address 127.8.208.254:36123)
0807 08:42:15.105060 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:15.105064 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:15.105078 (+ 14us) server_negotiation.cc:407] Connection header received
0807 08:42:15.106869 (+ 1791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:15.106873 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:15.106920 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:15.107020 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:15.108367 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.109039 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.110525 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.110764 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.110871 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:15.113790 (+ 2919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:15.113793 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:15.113795 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:15.113840 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:15.115239 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:15.115791 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:15.115797 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:15.115800 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:15.117804 (+ 2004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:15.118267 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:15.118271 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:15.118272 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:15.118489 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:15.118587 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:15.119131 (+ 544us) server_negotiation.cc:299] Negotiation successful
0807 08:42:15.119250 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":83,"threads_started":1}
I20260807 08:42:15.120241 23370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:15.103655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36123 (local address 127.8.208.195:58647)
0807 08:42:15.104165 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:15.104218 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:15.106605 (+ 2387us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:15.107211 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:15.107219 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:15.107566 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:15.108235 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:15.108250 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.109172 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.109175 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:15.110411 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:15.110420 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.110908 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.110913 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:15.111084 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:15.112042 (+ 958us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:15.112083 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:15.113642 (+ 1559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:15.115342 (+ 1700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:15.115347 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:15.115357 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:15.115666 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:15.117972 (+ 2306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:15.117976 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:15.117978 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:15.118148 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:15.118605 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:15.118612 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:15.118895 (+ 283us) client_negotiation.cc:769] Sending connection context
0807 08:42:15.119087 (+ 192us) client_negotiation.cc:240] Negotiation successful
0807 08:42:15.119380 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":166,"threads_started":1}
I20260807 08:42:15.121359 23367 heartbeater.cc:347] Connected to a master server at 127.8.208.254:36123
I20260807 08:42:15.121578 23367 heartbeater.cc:464] Registering TS with master...
I20260807 08:42:15.122064 23367 heartbeater.cc:511] Master 127.8.208.254:36123 requested a full tablet report, sending...
W20260807 08:42:15.123577 23367 heartbeater.cc:644] Failed to heartbeat to 127.8.208.254:36123 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 08:42:15.123675 23367 heartbeater.cc:464] Registering TS with master...
I20260807 08:42:15.123799 23367 heartbeater.cc:511] Master 127.8.208.254:36123 requested a full tablet report, sending...
I20260807 08:42:15.124696 23367 heartbeater.cc:464] Registering TS with master...
I20260807 08:42:15.125061 23367 heartbeater.cc:511] Master 127.8.208.254:36123 requested a full tablet report, sending...
I20260807 08:42:15.126291 22849 ts_manager.cc:194] Registered new tserver with Master: 811829adf8c44048a93f9be0fe91a418 (127.8.208.195:34719)
I20260807 08:42:15.128003 22849 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.195@KRBTEST.COM'} at 127.8.208.195:58647
Aug 07 08:42:15 dist-test-slave-6nmv krb5kdc[21773](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786092135, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:15.632057 23073 heartbeater.cc:464] Registering TS with master...
I20260807 08:42:15.632323 23073 heartbeater.cc:511] Master 127.8.208.254:36123 requested a full tablet report, sending...
I20260807 08:42:15.633095 22849 ts_manager.cc:194] Registered new tserver with Master: e426ed0db97d449baae30341348e0fe3 (127.8.208.193:45825)
I20260807 08:42:15.633718 22849 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.193@KRBTEST.COM'} at 127.8.208.193:55517
Aug 07 08:42:15 dist-test-slave-6nmv krb5kdc[21773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092135, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for HTTP/127.8.208.212@KRBTEST.COM
I20260807 08:42:15.868368 23222 heartbeater.cc:464] Registering TS with master...
I20260807 08:42:15.868670 23222 heartbeater.cc:511] Master 127.8.208.254:36123 requested a full tablet report, sending...
I20260807 08:42:15.869415 22849 ts_manager.cc:194] Registered new tserver with Master: 129b0f6fc344479292ffc5cd4d531b21 (127.8.208.194:37743)
I20260807 08:42:15.870162 22849 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.194@KRBTEST.COM'} at 127.8.208.194:56407
I20260807 08:42:15.872835 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 08:42:15.883260 23389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:15.874748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56784 (local address 127.8.208.254:36123)
0807 08:42:15.875243 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:15.875246 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:15.875255 (+ 9us) server_negotiation.cc:407] Connection header received
0807 08:42:15.875283 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:15.875285 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:15.875317 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:15.875408 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:15.876063 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.876604 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.877440 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.877669 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.877777 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:15.879336 (+ 1559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:15.879341 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:15.879346 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:15.879380 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:15.881515 (+ 2135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:15.882050 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:15.882053 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:15.882055 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:15.882145 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:15.882446 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:15.882449 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:15.882451 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:15.882635 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:15.882752 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:15.882993 (+ 241us) server_negotiation.cc:299] Negotiation successful
0807 08:42:15.883104 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":130,"threads_started":1}
I20260807 08:42:15.887060 22849 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56784:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 08:42:15.891431 22849 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:42:15.914551 23397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:15.903694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:45825 (local address 127.0.0.1:56016)
0807 08:42:15.908993 (+ 5299us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:15.909006 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:15.909098 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:15.909931 (+ 833us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:15.909937 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:15.909962 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:42:15.910079 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:15.910085 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.911329 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.911332 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:15.912780 (+ 1448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:15.912793 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.914045 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.914048 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:15.914151 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:15.914187 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 08:42:15.914289 (+ 102us) client_negotiation.cc:240] Negotiation successful
0807 08:42:15.914395 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5243,"mutex_wait_us":31,"thread_start_us":91,"threads_started":1}
I20260807 08:42:15.915154 23400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:15.903860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56016 (local address 127.8.208.193:45825)
0807 08:42:15.904227 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:15.904236 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:15.909462 (+ 5226us) server_negotiation.cc:407] Connection header received
0807 08:42:15.909544 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:15.909549 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:15.909754 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:15.909927 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:42:15.910212 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.911210 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.912965 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.913703 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.913832 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:15.913979 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:15.914938 (+ 959us) server_negotiation.cc:299] Negotiation successful
0807 08:42:15.915032 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":74,"threads_started":1}
I20260807 08:42:15.918231 23395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:15.902466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:37743 (local address 127.0.0.1:39808)
0807 08:42:15.906111 (+ 3645us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:15.906124 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:15.906268 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:15.910765 (+ 4497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:15.910768 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:15.910783 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:42:15.910864 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:15.910870 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.914466 (+ 3596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.914469 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:15.915663 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:15.915673 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.917866 (+ 2193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.917869 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:15.917961 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:15.917984 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 08:42:15.918048 (+ 64us) client_negotiation.cc:240] Negotiation successful
0807 08:42:15.918110 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3448,"thread_start_us":86,"threads_started":1}
I20260807 08:42:15.918301 22995 tablet_service.cc:1467] Processing CreateTablet for tablet dd9323a4224340a0963da85f8d9e69e9 (DEFAULT_TABLE table=test-table [id=682e06a2d4e5438388313b71d1336e38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:42:15.919057 23398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:15.902932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39808 (local address 127.8.208.194:37743)
0807 08:42:15.910183 (+ 7251us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:15.910189 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:15.910209 (+ 20us) server_negotiation.cc:407] Connection header received
0807 08:42:15.910278 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:15.910284 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:15.910482 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:15.910613 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:42:15.913264 (+ 2651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.914317 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.916222 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.916945 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.917048 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:15.918728 (+ 1680us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:15.918781 (+ 53us) server_negotiation.cc:299] Negotiation successful
0807 08:42:15.918875 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7157,"thread_start_us":92,"threads_started":1}
I20260807 08:42:15.919118 23399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:15.902161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:34719 (local address 127.0.0.1:35034)
0807 08:42:15.904094 (+ 1933us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:15.904140 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:15.904256 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:15.911307 (+ 7051us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:15.911309 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:15.911325 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:42:15.911461 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:15.911467 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.916196 (+ 4729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.916199 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:15.917320 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:15.917330 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.918714 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.918718 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:15.918822 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:15.918846 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 08:42:15.918916 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 08:42:15.918981 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1765,"mutex_wait_us":23,"thread_start_us":88,"threads_started":1}
I20260807 08:42:15.919507 22995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd9323a4224340a0963da85f8d9e69e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:42:15.919632 23396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:15.902284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35034 (local address 127.8.208.195:34719)
0807 08:42:15.909318 (+ 7034us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:15.909324 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:15.909345 (+ 21us) server_negotiation.cc:407] Connection header received
0807 08:42:15.911006 (+ 1661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:15.911011 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:15.911172 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:15.911624 (+ 452us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:42:15.911798 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.916079 (+ 4281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.917486 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.918399 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.918519 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:15.918649 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:15.919394 (+ 745us) server_negotiation.cc:299] Negotiation successful
0807 08:42:15.919509 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6939,"thread_start_us":119,"threads_started":1}
I20260807 08:42:15.921720 23131 tablet_service.cc:1467] Processing CreateTablet for tablet dd9323a4224340a0963da85f8d9e69e9 (DEFAULT_TABLE table=test-table [id=682e06a2d4e5438388313b71d1336e38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:42:15.922288 23295 tablet_service.cc:1467] Processing CreateTablet for tablet dd9323a4224340a0963da85f8d9e69e9 (DEFAULT_TABLE table=test-table [id=682e06a2d4e5438388313b71d1336e38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:42:15.922797 23131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd9323a4224340a0963da85f8d9e69e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:42:15.923213 23295 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd9323a4224340a0963da85f8d9e69e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:42:15.932178 23403 tablet_bootstrap.cc:492] T dd9323a4224340a0963da85f8d9e69e9 P e426ed0db97d449baae30341348e0fe3: Bootstrap starting.
I20260807 08:42:15.933035 23402 tablet_bootstrap.cc:492] T dd9323a4224340a0963da85f8d9e69e9 P 129b0f6fc344479292ffc5cd4d531b21: Bootstrap starting.
I20260807 08:42:15.934573 23403 tablet_bootstrap.cc:654] T dd9323a4224340a0963da85f8d9e69e9 P e426ed0db97d449baae30341348e0fe3: Neither blocks nor log segments found. Creating new log.
I20260807 08:42:15.935070 23402 tablet_bootstrap.cc:654] T dd9323a4224340a0963da85f8d9e69e9 P 129b0f6fc344479292ffc5cd4d531b21: Neither blocks nor log segments found. Creating new log.
I20260807 08:42:15.935503 23403 log.cc:824] T dd9323a4224340a0963da85f8d9e69e9 P e426ed0db97d449baae30341348e0fe3: Log is configured to *not* fsync() on all Append() calls
I20260807 08:42:15.935958 23402 log.cc:824] T dd9323a4224340a0963da85f8d9e69e9 P 129b0f6fc344479292ffc5cd4d531b21: Log is configured to *not* fsync() on all Append() calls
I20260807 08:42:15.936616 23401 tablet_bootstrap.cc:492] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418: Bootstrap starting.
I20260807 08:42:15.938207 23402 tablet_bootstrap.cc:492] T dd9323a4224340a0963da85f8d9e69e9 P 129b0f6fc344479292ffc5cd4d531b21: No bootstrap required, opened a new log
I20260807 08:42:15.938449 23402 ts_tablet_manager.cc:1397] T dd9323a4224340a0963da85f8d9e69e9 P 129b0f6fc344479292ffc5cd4d531b21: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 08:42:15.939757 23401 tablet_bootstrap.cc:654] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418: Neither blocks nor log segments found. Creating new log.
I20260807 08:42:15.940550 23401 log.cc:824] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418: Log is configured to *not* fsync() on all Append() calls
I20260807 08:42:15.942461 23403 tablet_bootstrap.cc:492] T dd9323a4224340a0963da85f8d9e69e9 P e426ed0db97d449baae30341348e0fe3: No bootstrap required, opened a new log
I20260807 08:42:15.942401 23402 raft_consensus.cc:348] T dd9323a4224340a0963da85f8d9e69e9 P 129b0f6fc344479292ffc5cd4d531b21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "811829adf8c44048a93f9be0fe91a418" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34719 } } peers { permanent_uuid: "129b0f6fc344479292ffc5cd4d531b21" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 37743 } } peers { permanent_uuid: "e426ed0db97d449baae30341348e0fe3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45825 } }
I20260807 08:42:15.942621 23403 ts_tablet_manager.cc:1397] T dd9323a4224340a0963da85f8d9e69e9 P e426ed0db97d449baae30341348e0fe3: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.000s
I20260807 08:42:15.942620 23402 raft_consensus.cc:374] T dd9323a4224340a0963da85f8d9e69e9 P 129b0f6fc344479292ffc5cd4d531b21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:42:15.942667 23402 raft_consensus.cc:729] T dd9323a4224340a0963da85f8d9e69e9 P 129b0f6fc344479292ffc5cd4d531b21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129b0f6fc344479292ffc5cd4d531b21, State: Initialized, Role: FOLLOWER
I20260807 08:42:15.943095 23402 consensus_queue.cc:260] T dd9323a4224340a0963da85f8d9e69e9 P 129b0f6fc344479292ffc5cd4d531b21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "811829adf8c44048a93f9be0fe91a418" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34719 } } peers { permanent_uuid: "129b0f6fc344479292ffc5cd4d531b21" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 37743 } } peers { permanent_uuid: "e426ed0db97d449baae30341348e0fe3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45825 } }
I20260807 08:42:15.944063 23402 ts_tablet_manager.cc:1428] T dd9323a4224340a0963da85f8d9e69e9 P 129b0f6fc344479292ffc5cd4d531b21: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 08:42:15.944375 23222 heartbeater.cc:503] Master 127.8.208.254:36123 was elected leader, sending a full tablet report...
I20260807 08:42:15.946264 23403 raft_consensus.cc:348] T dd9323a4224340a0963da85f8d9e69e9 P e426ed0db97d449baae30341348e0fe3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "811829adf8c44048a93f9be0fe91a418" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34719 } } peers { permanent_uuid: "129b0f6fc344479292ffc5cd4d531b21" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 37743 } } peers { permanent_uuid: "e426ed0db97d449baae30341348e0fe3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45825 } }
I20260807 08:42:15.946480 23403 raft_consensus.cc:374] T dd9323a4224340a0963da85f8d9e69e9 P e426ed0db97d449baae30341348e0fe3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:42:15.946519 23403 raft_consensus.cc:729] T dd9323a4224340a0963da85f8d9e69e9 P e426ed0db97d449baae30341348e0fe3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e426ed0db97d449baae30341348e0fe3, State: Initialized, Role: FOLLOWER
I20260807 08:42:15.947147 23403 consensus_queue.cc:260] T dd9323a4224340a0963da85f8d9e69e9 P e426ed0db97d449baae30341348e0fe3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "811829adf8c44048a93f9be0fe91a418" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34719 } } peers { permanent_uuid: "129b0f6fc344479292ffc5cd4d531b21" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 37743 } } peers { permanent_uuid: "e426ed0db97d449baae30341348e0fe3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45825 } }
I20260807 08:42:15.947947 23073 heartbeater.cc:503] Master 127.8.208.254:36123 was elected leader, sending a full tablet report...
I20260807 08:42:15.948108 23403 ts_tablet_manager.cc:1428] T dd9323a4224340a0963da85f8d9e69e9 P e426ed0db97d449baae30341348e0fe3: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 08:42:15.949991 23401 tablet_bootstrap.cc:492] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418: No bootstrap required, opened a new log
I20260807 08:42:15.950191 23401 ts_tablet_manager.cc:1397] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260807 08:42:15.953976 23401 raft_consensus.cc:348] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "811829adf8c44048a93f9be0fe91a418" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34719 } } peers { permanent_uuid: "129b0f6fc344479292ffc5cd4d531b21" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 37743 } } peers { permanent_uuid: "e426ed0db97d449baae30341348e0fe3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45825 } }
I20260807 08:42:15.954180 23401 raft_consensus.cc:374] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:42:15.954216 23401 raft_consensus.cc:729] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811829adf8c44048a93f9be0fe91a418, State: Initialized, Role: FOLLOWER
I20260807 08:42:15.954602 23401 consensus_queue.cc:260] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "811829adf8c44048a93f9be0fe91a418" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34719 } } peers { permanent_uuid: "129b0f6fc344479292ffc5cd4d531b21" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 37743 } } peers { permanent_uuid: "e426ed0db97d449baae30341348e0fe3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45825 } }
I20260807 08:42:15.955156 23367 heartbeater.cc:503] Master 127.8.208.254:36123 was elected leader, sending a full tablet report...
I20260807 08:42:15.955360 23401 ts_tablet_manager.cc:1428] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 08:42:15.973055 23410 raft_consensus.cc:482] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:42:15.973241 23410 raft_consensus.cc:504] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "811829adf8c44048a93f9be0fe91a418" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34719 } } peers { permanent_uuid: "129b0f6fc344479292ffc5cd4d531b21" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 37743 } } peers { permanent_uuid: "e426ed0db97d449baae30341348e0fe3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45825 } }
I20260807 08:42:15.974272 23410 leader_election.cc:288] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 129b0f6fc344479292ffc5cd4d531b21 (127.8.208.194:37743), e426ed0db97d449baae30341348e0fe3 (127.8.208.193:45825)
I20260807 08:42:15.978196 23409 raft_consensus.cc:482] T dd9323a4224340a0963da85f8d9e69e9 P e426ed0db97d449baae30341348e0fe3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:42:15.978333 23409 raft_consensus.cc:504] T dd9323a4224340a0963da85f8d9e69e9 P e426ed0db97d449baae30341348e0fe3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "811829adf8c44048a93f9be0fe91a418" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34719 } } peers { permanent_uuid: "129b0f6fc344479292ffc5cd4d531b21" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 37743 } } peers { permanent_uuid: "e426ed0db97d449baae30341348e0fe3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45825 } }
I20260807 08:42:15.979287 23409 leader_election.cc:288] T dd9323a4224340a0963da85f8d9e69e9 P e426ed0db97d449baae30341348e0fe3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 811829adf8c44048a93f9be0fe91a418 (127.8.208.195:34719), 129b0f6fc344479292ffc5cd4d531b21 (127.8.208.194:37743)
I20260807 08:42:15.982458 23400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:15.974992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:41143 (local address 127.8.208.193:45825)
0807 08:42:15.975101 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:15.975105 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:15.975590 (+ 485us) server_negotiation.cc:407] Connection header received
0807 08:42:15.975742 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:15.975745 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:15.975783 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:15.975820 (+ 37us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:42:15.976206 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.976877 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.981125 (+ 4248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.981728 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.981812 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:15.981881 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:15.982251 (+ 370us) server_negotiation.cc:299] Negotiation successful
0807 08:42:15.982337 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 08:42:15.982506 23411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:15.974882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:45825 (local address 127.8.208.195:41143)
0807 08:42:15.975516 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:15.975528 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:15.975647 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:15.975932 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:15.975934 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:15.975961 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:42:15.976075 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:15.976081 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.977023 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.977026 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:15.980993 (+ 3967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:15.981003 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.981999 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.982004 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:15.982089 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:15.982122 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 08:42:15.982216 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 08:42:15.982283 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"mutex_wait_us":2691,"thread_start_us":86,"threads_started":1}
I20260807 08:42:15.982676 23398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:15.974561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:38519 (local address 127.8.208.194:37743)
0807 08:42:15.974663 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:15.974667 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:15.975296 (+ 629us) server_negotiation.cc:407] Connection header received
0807 08:42:15.975395 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:15.975398 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:15.975441 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:15.975507 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:42:15.975865 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.976522 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.980653 (+ 4131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.981233 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.981369 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:15.981422 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:15.982457 (+ 1035us) server_negotiation.cc:299] Negotiation successful
0807 08:42:15.982541 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 08:42:15.983202 22998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd9323a4224340a0963da85f8d9e69e9" candidate_uuid: "811829adf8c44048a93f9be0fe91a418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e426ed0db97d449baae30341348e0fe3" is_pre_election: true
I20260807 08:42:15.983287 23412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:15.974456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:37743 (local address 127.8.208.195:38519)
0807 08:42:15.975193 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:15.975209 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:15.975316 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:15.975614 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:15.975617 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:15.975633 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:42:15.975756 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:15.975761 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.976693 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.976697 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:15.980471 (+ 3774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:15.980480 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.982129 (+ 1649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.982131 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:15.982250 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:15.982274 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 08:42:15.983048 (+ 774us) client_negotiation.cc:240] Negotiation successful
0807 08:42:15.983114 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":664,"thread_start_us":105,"threads_started":1}
I20260807 08:42:15.983422 22998 raft_consensus.cc:2454] T dd9323a4224340a0963da85f8d9e69e9 P e426ed0db97d449baae30341348e0fe3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 811829adf8c44048a93f9be0fe91a418 in term 0.
I20260807 08:42:15.983803 23162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd9323a4224340a0963da85f8d9e69e9" candidate_uuid: "811829adf8c44048a93f9be0fe91a418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129b0f6fc344479292ffc5cd4d531b21" is_pre_election: true
I20260807 08:42:15.983865 23245 leader_election.cc:302] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 811829adf8c44048a93f9be0fe91a418, e426ed0db97d449baae30341348e0fe3; no voters:
I20260807 08:42:15.984082 23162 raft_consensus.cc:2454] T dd9323a4224340a0963da85f8d9e69e9 P 129b0f6fc344479292ffc5cd4d531b21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 811829adf8c44048a93f9be0fe91a418 in term 0.
I20260807 08:42:15.984171 23410 raft_consensus.cc:2781] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:42:15.984249 23410 raft_consensus.cc:482] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:42:15.984292 23410 raft_consensus.cc:3037] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:42:15.985656 23410 raft_consensus.cc:504] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "811829adf8c44048a93f9be0fe91a418" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34719 } } peers { permanent_uuid: "129b0f6fc344479292ffc5cd4d531b21" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 37743 } } peers { permanent_uuid: "e426ed0db97d449baae30341348e0fe3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45825 } }
I20260807 08:42:15.986028 23410 leader_election.cc:288] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418 [CANDIDATE]: Term 1 election: Requested vote from peers 129b0f6fc344479292ffc5cd4d531b21 (127.8.208.194:37743), e426ed0db97d449baae30341348e0fe3 (127.8.208.193:45825)
I20260807 08:42:15.986585 23162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd9323a4224340a0963da85f8d9e69e9" candidate_uuid: "811829adf8c44048a93f9be0fe91a418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129b0f6fc344479292ffc5cd4d531b21"
I20260807 08:42:15.986708 23162 raft_consensus.cc:3037] T dd9323a4224340a0963da85f8d9e69e9 P 129b0f6fc344479292ffc5cd4d531b21 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:42:15.988018 23162 raft_consensus.cc:2454] T dd9323a4224340a0963da85f8d9e69e9 P 129b0f6fc344479292ffc5cd4d531b21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811829adf8c44048a93f9be0fe91a418 in term 1.
I20260807 08:42:15.988405 23248 leader_election.cc:302] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129b0f6fc344479292ffc5cd4d531b21, 811829adf8c44048a93f9be0fe91a418; no voters:
I20260807 08:42:15.988867 22998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd9323a4224340a0963da85f8d9e69e9" candidate_uuid: "811829adf8c44048a93f9be0fe91a418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e426ed0db97d449baae30341348e0fe3"
I20260807 08:42:15.988970 23396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:15.979939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:56309 (local address 127.8.208.195:34719)
0807 08:42:15.980025 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:15.980028 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:15.983090 (+ 3062us) server_negotiation.cc:407] Connection header received
0807 08:42:15.983272 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:15.983275 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:15.983313 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:15.983355 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:42:15.985111 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.985912 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.987722 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.988311 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.988401 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:15.988458 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:15.988805 (+ 347us) server_negotiation.cc:299] Negotiation successful
0807 08:42:15.988872 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 08:42:15.988993 22998 raft_consensus.cc:3037] T dd9323a4224340a0963da85f8d9e69e9 P e426ed0db97d449baae30341348e0fe3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:42:15.989367 23414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:15.979583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:34719 (local address 127.8.208.193:56309)
0807 08:42:15.983012 (+ 3429us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:15.983025 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:15.983169 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:15.984822 (+ 1653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:15.984842 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:15.984861 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:42:15.984984 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:15.984990 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.986081 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.986084 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:15.987534 (+ 1450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:15.987545 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.988557 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.988560 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:15.988661 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:15.988685 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 08:42:15.989136 (+ 451us) client_negotiation.cc:240] Negotiation successful
0807 08:42:15.989211 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3366,"thread_start_us":89,"threads_started":1}
I20260807 08:42:15.989949 23296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd9323a4224340a0963da85f8d9e69e9" candidate_uuid: "e426ed0db97d449baae30341348e0fe3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811829adf8c44048a93f9be0fe91a418" is_pre_election: true
I20260807 08:42:15.990187 23296 raft_consensus.cc:2379] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e426ed0db97d449baae30341348e0fe3 in current term 1: Already voted for candidate 811829adf8c44048a93f9be0fe91a418 in this term.
I20260807 08:42:15.990218 22998 raft_consensus.cc:2454] T dd9323a4224340a0963da85f8d9e69e9 P e426ed0db97d449baae30341348e0fe3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811829adf8c44048a93f9be0fe91a418 in term 1.
I20260807 08:42:15.990825 23410 raft_consensus.cc:2781] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:42:15.991043 23410 raft_consensus.cc:686] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418 [term 1 LEADER]: Becoming Leader. State: Replica: 811829adf8c44048a93f9be0fe91a418, State: Running, Role: LEADER
I20260807 08:42:15.991353 23410 consensus_queue.cc:237] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "811829adf8c44048a93f9be0fe91a418" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34719 } } peers { permanent_uuid: "129b0f6fc344479292ffc5cd4d531b21" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 37743 } } peers { permanent_uuid: "e426ed0db97d449baae30341348e0fe3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45825 } }
I20260807 08:42:15.993773 23398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:15.980487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:53453 (local address 127.8.208.194:37743)
0807 08:42:15.982822 (+ 2335us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:15.982826 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:15.989939 (+ 7113us) server_negotiation.cc:407] Connection header received
0807 08:42:15.990112 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:15.990115 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:15.990156 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:15.990200 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:42:15.990526 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.991143 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.992582 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.993107 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.993198 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:15.993245 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:15.993584 (+ 339us) server_negotiation.cc:299] Negotiation successful
0807 08:42:15.993654 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2276,"thread_start_us":114,"threads_started":1}
I20260807 08:42:15.994309 23414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:15.980208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:37743 (local address 127.8.208.193:53453)
0807 08:42:15.989869 (+ 9661us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:15.989883 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:15.990001 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:15.990320 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:15.990322 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:15.990336 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:42:15.990394 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:15.990398 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.991282 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.991285 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:15.992439 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:15.992450 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:15.993340 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:15.993347 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:15.993450 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:15.993474 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 08:42:15.994113 (+ 639us) client_negotiation.cc:240] Negotiation successful
0807 08:42:15.994192 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9598,"thread_start_us":90,"threads_started":1}
I20260807 08:42:15.994823 23162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd9323a4224340a0963da85f8d9e69e9" candidate_uuid: "e426ed0db97d449baae30341348e0fe3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129b0f6fc344479292ffc5cd4d531b21" is_pre_election: true
I20260807 08:42:15.995031 23162 raft_consensus.cc:2379] T dd9323a4224340a0963da85f8d9e69e9 P 129b0f6fc344479292ffc5cd4d531b21 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e426ed0db97d449baae30341348e0fe3 in current term 1: Already voted for candidate 811829adf8c44048a93f9be0fe91a418 in this term.
I20260807 08:42:15.995519 22946 leader_election.cc:302] T dd9323a4224340a0963da85f8d9e69e9 P e426ed0db97d449baae30341348e0fe3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e426ed0db97d449baae30341348e0fe3; no voters: 129b0f6fc344479292ffc5cd4d531b21, 811829adf8c44048a93f9be0fe91a418
I20260807 08:42:15.995942 23409 raft_consensus.cc:2726] T dd9323a4224340a0963da85f8d9e69e9 P e426ed0db97d449baae30341348e0fe3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 08:42:15.998533 22849 catalog_manager.cc:5495] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418 reported cstate change: term changed from 0 to 1, leader changed from <none> to 811829adf8c44048a93f9be0fe91a418 (127.8.208.195). New cstate: current_term: 1 leader_uuid: "811829adf8c44048a93f9be0fe91a418" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "811829adf8c44048a93f9be0fe91a418" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 34719 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "129b0f6fc344479292ffc5cd4d531b21" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 37743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e426ed0db97d449baae30341348e0fe3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45825 } health_report { overall_health: UNKNOWN } } }
I20260807 08:42:16.033212 23396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:16.029460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35048 (local address 127.8.208.195:34719)
0807 08:42:16.029599 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:16.029603 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:16.029618 (+ 15us) server_negotiation.cc:407] Connection header received
0807 08:42:16.029688 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:16.029691 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:16.029748 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:16.029868 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:42:16.030226 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:16.030721 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:16.031567 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:16.031799 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:16.031920 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:16.032314 (+ 394us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:42:16.032851 (+ 537us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:42:16.032976 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:16.033030 (+ 54us) server_negotiation.cc:299] Negotiation successful
0807 08:42:16.033089 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 08:42:16.043118 23162 raft_consensus.cc:1261] T dd9323a4224340a0963da85f8d9e69e9 P 129b0f6fc344479292ffc5cd4d531b21 [term 1 FOLLOWER]: Refusing update from remote peer 811829adf8c44048a93f9be0fe91a418: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:42:16.043789 23410 consensus_queue.cc:1035] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129b0f6fc344479292ffc5cd4d531b21" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 37743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:42:16.044137 22998 raft_consensus.cc:1261] T dd9323a4224340a0963da85f8d9e69e9 P e426ed0db97d449baae30341348e0fe3 [term 1 FOLLOWER]: Refusing update from remote peer 811829adf8c44048a93f9be0fe91a418: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:42:16.046247 23410 consensus_queue.cc:1035] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e426ed0db97d449baae30341348e0fe3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:42:16.053220 23421 mvcc.cc:205] Tried to move back new op lower bound from 7315833389216075776 to 7315833389032464384. Current Snapshot: MvccSnapshot[applied={T|T < 7315833389216075776}]
I20260807 08:42:16.055905 23422 mvcc.cc:205] Tried to move back new op lower bound from 7315833389216075776 to 7315833389032464384. Current Snapshot: MvccSnapshot[applied={T|T < 7315833389216075776}]
Aug 07 08:42:16 dist-test-slave-6nmv krb5kdc[21773](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092135, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for HTTP/127.8.208.212@KRBTEST.COM
I20260807 08:42:16.061993 22848 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:42:16.062139 22848 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:42:16.063694 23424 mvcc.cc:205] Tried to move back new op lower bound from 7315833389216075776 to 7315833389032464384. Current Snapshot: MvccSnapshot[applied={T|T < 7315833389216075776}]
I20260807 08:42:16.064815 22848 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2e8469d194b641b3afca07c83590d769: Sending DeleteTablet for 3 replicas of tablet dd9323a4224340a0963da85f8d9e69e9
I20260807 08:42:16.066022 23295 tablet_service.cc:1514] Processing DeleteTablet for tablet dd9323a4224340a0963da85f8d9e69e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:42:16 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:35034
I20260807 08:42:16.066247 22995 tablet_service.cc:1514] Processing DeleteTablet for tablet dd9323a4224340a0963da85f8d9e69e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:42:16 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:56016
I20260807 08:42:16.066366 23131 tablet_service.cc:1514] Processing DeleteTablet for tablet dd9323a4224340a0963da85f8d9e69e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:42:16 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:39808
I20260807 08:42:16.066476 23431 tablet_replica.cc:330] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418: stopping tablet replica
I20260807 08:42:16.066763 23431 raft_consensus.cc:2229] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418 [term 1 LEADER]: Raft consensus shutting down.
I20260807 08:42:16.067142 23431 raft_consensus.cc:2258] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:42:16.067991 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 22893
I20260807 08:42:16.068943 23431 ts_tablet_manager.cc:1905] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:42:16.072506 23431 ts_tablet_manager.cc:1918] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:42:16.072629 23431 log.cc:1196] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/dd9323a4224340a0963da85f8d9e69e9
I20260807 08:42:16.072933 23433 tablet_replica.cc:330] T dd9323a4224340a0963da85f8d9e69e9 P 129b0f6fc344479292ffc5cd4d531b21: stopping tablet replica
I20260807 08:42:16.073019 23431 ts_tablet_manager.cc:1939] T dd9323a4224340a0963da85f8d9e69e9 P 811829adf8c44048a93f9be0fe91a418: Deleting consensus metadata
I20260807 08:42:16.073287 23433 raft_consensus.cc:2229] T dd9323a4224340a0963da85f8d9e69e9 P 129b0f6fc344479292ffc5cd4d531b21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:42:16.073622 23433 raft_consensus.cc:2258] T dd9323a4224340a0963da85f8d9e69e9 P 129b0f6fc344479292ffc5cd4d531b21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:42:16.074241 22832 catalog_manager.cc:4841] TS 811829adf8c44048a93f9be0fe91a418 (127.8.208.195:34719): tablet dd9323a4224340a0963da85f8d9e69e9 (table test-table [id=682e06a2d4e5438388313b71d1336e38]) successfully deleted
W20260807 08:42:16.084551 22831 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.208.193:45825 (error 108)
I20260807 08:42:16.086140 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 23075
I20260807 08:42:16.086236 23399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:16.085905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:45825 (local address 127.0.0.1:56020)
0807 08:42:16.086055 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:16.086151 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.193:45825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260807 08:42:16.094197 22831 catalog_manager.cc:4584] TS e426ed0db97d449baae30341348e0fe3 (127.8.208.193:45825): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dd9323a4224340a0963da85f8d9e69e9: Network error: Client connection negotiation failed: client connection to 127.8.208.193:45825: connect: Connection refused (error 111)
W20260807 08:42:16.100639 23399 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:42:16.100361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:37743 (local address 127.0.0.1:39818)
0807 08:42:16.100492 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:16.100551 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.194:37743: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":33}
I20260807 08:42:16.100890 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 23225
I20260807 08:42:16.109647 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 22812
I20260807 08:42:16.119995 9027 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 08:42:16.464231 9027 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 08:42:16.464334 9027 mini_ranger.cc:66] Stopping Ranger...
I20260807 08:42:16.808562 9027 mini_ranger.cc:68] Stopped Ranger
2026-08-07 08:42:16.808 UTC [21805] LOG: received smart shutdown request
2026-08-07 08:42:16.813 UTC [21805] LOG: background worker "logical replication launcher" (PID 21815) exited with exit code 1
2026-08-07 08:42:16.813 UTC [21809] LOG: shutting down
2026-08-07 08:42:16.969 UTC [21805] LOG: database system is shut down
2026-08-07T08:42:16Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (46705 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:42:17 dist-test-slave-6nmv krb5kdc[23444](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:42:17 dist-test-slave-6nmv krb5kdc[23444](info): set up 2 sockets
Aug 07 08:42:17 dist-test-slave-6nmv krb5kdc[23444](info): commencing operation
krb5kdc: starting...
W20260807 08:42:18.084486 9027 mini_kdc.cc:121] Time spent starting KDC: real 0.982s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:42:18 dist-test-slave-6nmv krb5kdc[23444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:42:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:42:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:42:18.200388 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:33165
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:40001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:33165,127.8.208.253:35557,127.8.208.252:41091
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:42:18.301226 23458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:18.301471 23458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:18.301524 23458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:18.305310 23458 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:42:18.305356 23458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:18.305372 23458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:18.305387 23458 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:42:18.305398 23458 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:42:18.310047 23458 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:40001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:33165,127.8.208.253:35557,127.8.208.252:41091
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:33165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23458
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:18.310858 23458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:18.311705 23458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:42:18.321329 23463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:18.321390 23465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:18.321532 23458 server_base.cc:1034] running on GCE node
W20260807 08:42:18.321624 23468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:18.322161 23458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:18.323452 23458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:18.324635 23458 hybrid_clock.cc:648] HybridClock initialized: now 1786092138324618 us; error 43 us; skew 500 ppm
Aug 07 08:42:18 dist-test-slave-6nmv krb5kdc[23444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092138, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:18.327346 23458 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:42:18.328073 23458 webserver.cc:460] Webserver started at http://127.8.208.254:37803/ using document root <none> and password file <none>
I20260807 08:42:18.328531 23458 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:18.328580 23458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:42:18.328712 23458 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:42:18.330411 23458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9"
format_stamp: "Formatted at 2026-08-07 08:42:18 on dist-test-slave-6nmv"
server_key: "2f499453ba87505110b3109c302f25c4"
server_key_iv: "3b14b2bf4c8c7b714a639640fa77c72a"
server_key_version: "encryptionkey@0"
I20260807 08:42:18.330842 23458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9"
format_stamp: "Formatted at 2026-08-07 08:42:18 on dist-test-slave-6nmv"
server_key: "2f499453ba87505110b3109c302f25c4"
server_key_iv: "3b14b2bf4c8c7b714a639640fa77c72a"
server_key_version: "encryptionkey@0"
I20260807 08:42:18.334031 23458 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 08:42:18.335994 23475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:18.337013 23458 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:42:18.337133 23458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9"
format_stamp: "Formatted at 2026-08-07 08:42:18 on dist-test-slave-6nmv"
server_key: "2f499453ba87505110b3109c302f25c4"
server_key_iv: "3b14b2bf4c8c7b714a639640fa77c72a"
server_key_version: "encryptionkey@0"
I20260807 08:42:18.337229 23458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:18.346464 23458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:18.349229 23458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:18.349421 23458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:18.356796 23458 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:33165
I20260807 08:42:18.356805 23531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:33165 every 8 connection(s)
I20260807 08:42:18.357734 23458 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:42:18.360234 23532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:42:18.363593 23532 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33165 } has no permanent_uuid. Determining permanent_uuid...
I20260807 08:42:18.365227 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 23458
I20260807 08:42:18.365397 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:42:18.365705 9027 external_mini_cluster.cc:1428] Setting key 0563be7990ad7a7b3a993ab61a050fee
Aug 07 08:42:18 dist-test-slave-6nmv krb5kdc[23444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092138, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.208.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.253@KRBTEST.COM" created.
I20260807 08:42:18.378800 23534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.365614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53880 (local address 127.8.208.254:33165)
0807 08:42:18.365994 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:18.366007 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:18.366304 (+ 297us) server_negotiation.cc:407] Connection header received
0807 08:42:18.367268 (+ 964us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:18.367272 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:18.367434 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:18.367653 (+ 219us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:18.368460 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.369406 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.371049 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.371722 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.371912 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:18.374217 (+ 2305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:18.374226 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:18.374240 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:18.374269 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:18.375980 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.376431 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.376435 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.376436 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.376540 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.376919 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.376921 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.376922 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.377305 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:18.377430 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:18.377922 (+ 492us) server_negotiation.cc:299] Negotiation successful
0807 08:42:18.378078 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":151,"threads_started":1}
I20260807 08:42:18.378806 23535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.365615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:33165 (local address 127.0.0.1:53880)
0807 08:42:18.366181 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.366211 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:18.366986 (+ 775us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:18.367709 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:18.367716 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:18.368042 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:18.368301 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:18.368313 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.369569 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.369576 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:18.370921 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:18.370935 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.371924 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.371928 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:18.372024 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:18.372616 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:18.372632 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:18.374046 (+ 1414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:18.376082 (+ 2036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:18.376090 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:18.376096 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:18.376317 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:18.376633 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:18.376636 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:18.376637 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:18.376828 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:18.377450 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:18.377454 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:18.377620 (+ 166us) client_negotiation.cc:769] Sending connection context
0807 08:42:18.377778 (+ 158us) client_negotiation.cc:240] Negotiation successful
0807 08:42:18.378238 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"mutex_wait_us":70,"thread_start_us":193,"threads_started":1}
I20260807 08:42:18.381248 23532 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 } has no permanent_uuid. Determining permanent_uuid...
I20260807 08:42:18.382052 23535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.381763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:35557 (local address 127.0.0.1:57742)
0807 08:42:18.381911 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.381999 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.253:35557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260807 08:42:18.382287 23478 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.208.253:35557: connect: Connection refused (error 111)
I20260807 08:42:18.383116 23535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.382913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:35557 (local address 127.0.0.1:57744)
0807 08:42:18.383021 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.383068 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.253:35557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 08:42:18.383332 23532 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.253:35557: Network error: Client connection negotiation failed: client connection to 127.8.208.253:35557: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.253.keytab.
Entry for principal kudu/127.8.208.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.253.keytab.
I20260807 08:42:18.393339 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.253:35557
--webserver_interface=127.8.208.253
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.253.keytab
--principal=kudu/127.8.208.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:40001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:33165,127.8.208.253:35557,127.8.208.252:41091
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 08:42:18.432574 23532 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 } attempt: 1
I20260807 08:42:18.433414 23535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.433144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:35557 (local address 127.0.0.1:57752)
0807 08:42:18.433282 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.433336 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.253:35557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 08:42:18.434149 23535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.433935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:35557 (local address 127.0.0.1:57756)
0807 08:42:18.434036 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.434085 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.253:35557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260807 08:42:18.434263 23532 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.253:35557: Network error: Client connection negotiation failed: client connection to 127.8.208.253:35557: connect: Connection refused (error 111)
W20260807 08:42:18.495043 23539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:18.495294 23539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:18.495355 23539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:18.498981 23539 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:42:18.499043 23539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:18.499076 23539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:18.499106 23539 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:42:18.499132 23539 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:42:18.502421 23532 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 } attempt: 2
I20260807 08:42:18.503228 23535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.502946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:35557 (local address 127.0.0.1:57766)
0807 08:42:18.503100 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.503160 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.253:35557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260807 08:42:18.503616 23539 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:40001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:33165,127.8.208.253:35557,127.8.208.252:41091
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.253.keytab
--principal=kudu/127.8.208.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.253:35557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.208.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23539
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:18.504022 23535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.503784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:35557 (local address 127.0.0.1:57774)
0807 08:42:18.503923 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.503972 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.253:35557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260807 08:42:18.504148 23532 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.253:35557: Network error: Client connection negotiation failed: client connection to 127.8.208.253:35557: connect: Connection refused (error 111)
I20260807 08:42:18.504611 23539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:18.505435 23539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:42:18.513015 23546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:18.513063 23544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:18.513149 23539 server_base.cc:1034] running on GCE node
W20260807 08:42:18.513021 23548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:18.513773 23539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:18.514770 23539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:18.515920 23539 hybrid_clock.cc:648] HybridClock initialized: now 1786092138515894 us; error 38 us; skew 500 ppm
Aug 07 08:42:18 dist-test-slave-6nmv krb5kdc[23444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092138, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:18.518720 23539 init.cc:377] Logged in from keytab as kudu/127.8.208.253@KRBTEST.COM (short username kudu)
I20260807 08:42:18.519519 23539 webserver.cc:460] Webserver started at http://127.8.208.253:36475/ using document root <none> and password file <none>
I20260807 08:42:18.520002 23539 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:18.520112 23539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:42:18.520334 23539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:42:18.522222 23539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-1/data/instance:
uuid: "ec3b1c5aa91443cfba514098cf55d012"
format_stamp: "Formatted at 2026-08-07 08:42:18 on dist-test-slave-6nmv"
server_key: "1db09aeec86ebd4dc4abc9d05ac54e30"
server_key_iv: "284d980b4e3d5b36eaa75268db34ea01"
server_key_version: "encryptionkey@0"
I20260807 08:42:18.522771 23539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-1/wal/instance:
uuid: "ec3b1c5aa91443cfba514098cf55d012"
format_stamp: "Formatted at 2026-08-07 08:42:18 on dist-test-slave-6nmv"
server_key: "1db09aeec86ebd4dc4abc9d05ac54e30"
server_key_iv: "284d980b4e3d5b36eaa75268db34ea01"
server_key_version: "encryptionkey@0"
I20260807 08:42:18.526116 23539 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 08:42:18.528388 23555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:18.529549 23539 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:42:18.529640 23539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-1/wal
uuid: "ec3b1c5aa91443cfba514098cf55d012"
format_stamp: "Formatted at 2026-08-07 08:42:18 on dist-test-slave-6nmv"
server_key: "1db09aeec86ebd4dc4abc9d05ac54e30"
server_key_iv: "284d980b4e3d5b36eaa75268db34ea01"
server_key_version: "encryptionkey@0"
I20260807 08:42:18.529759 23539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:18.542312 23539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:18.545428 23539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:18.545604 23539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:18.552515 23539 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.253:35557
I20260807 08:42:18.552546 23613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.253:35557 every 8 connection(s)
I20260807 08:42:18.553383 23539 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-1/data/info.pb
I20260807 08:42:18.555967 23614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:42:18.558735 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 23539
I20260807 08:42:18.558904 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-1/wal/instance
I20260807 08:42:18.559216 9027 external_mini_cluster.cc:1428] Setting key 379ab0c4e2449767ee81e3fa70ef641a
I20260807 08:42:18.560083 23614 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33165 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.8.208.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.252@KRBTEST.COM" created.
Aug 07 08:42:18 dist-test-slave-6nmv krb5kdc[23444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092138, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.253@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:42:18.575261 23534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.562197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53896 (local address 127.8.208.254:33165)
0807 08:42:18.562397 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:18.562403 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:18.563127 (+ 724us) server_negotiation.cc:407] Connection header received
0807 08:42:18.564063 (+ 936us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:18.564067 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:18.564131 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:18.564231 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:18.565220 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.566046 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.567122 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.567512 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.567638 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:18.571359 (+ 3721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:18.571362 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:18.571364 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:18.571385 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:18.573187 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.573632 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.573639 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.573643 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.573735 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.574085 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.574091 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.574096 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.574352 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:18.574468 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:18.574917 (+ 449us) server_negotiation.cc:299] Negotiation successful
0807 08:42:18.575054 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 08:42:18.575750 23617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.562532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:33165 (local address 127.0.0.1:53896)
0807 08:42:18.562945 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.562992 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:18.563854 (+ 862us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:18.564357 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:18.564362 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:18.564662 (+ 300us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:18.565076 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:18.565086 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.566171 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.566173 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:18.566990 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:18.566998 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.567691 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.567694 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:18.567827 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:18.568367 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:18.568383 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:18.571188 (+ 2805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:18.573282 (+ 2094us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:18.573286 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:18.573296 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:18.573536 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:18.573871 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:18.573873 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:18.573874 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:18.573992 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:18.574468 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:18.574475 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:18.574686 (+ 211us) client_negotiation.cc:769] Sending connection context
0807 08:42:18.574823 (+ 137us) client_negotiation.cc:240] Negotiation successful
0807 08:42:18.575033 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":123,"threads_started":1}
I20260807 08:42:18.577185 23614 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 08:42:18 dist-test-slave-6nmv krb5kdc[23444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092138, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.253@KRBTEST.COM for kudu/127.8.208.253@KRBTEST.COM
I20260807 08:42:18.585214 23617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.577653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:35557 (local address 127.0.0.1:57778)
0807 08:42:18.577756 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.577771 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:18.577875 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:18.578466 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:18.578468 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:18.578612 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:18.578685 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:18.578689 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.579524 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.579529 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:18.580033 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:18.580040 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.580590 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.580593 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:18.580688 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:18.581093 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:18.581106 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:18.582243 (+ 1137us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:18.583929 (+ 1686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:18.583931 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:18.583932 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:18.584103 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:18.584349 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:18.584353 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:18.584359 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:18.584428 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:18.584777 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:18.584779 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:18.584847 (+ 68us) client_negotiation.cc:769] Sending connection context
0807 08:42:18.585031 (+ 184us) client_negotiation.cc:240] Negotiation successful
0807 08:42:18.585121 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260807 08:42:18.585417 23619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.577803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57778 (local address 127.8.208.253:35557)
0807 08:42:18.578158 (+ 355us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:18.578189 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:18.578204 (+ 15us) server_negotiation.cc:407] Connection header received
0807 08:42:18.578231 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:18.578234 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:18.578361 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:18.578484 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:18.578785 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.579425 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.580142 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.580471 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.580591 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:18.582368 (+ 1777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:18.582375 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:18.582393 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:18.582413 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:18.583826 (+ 1413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.584187 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.584190 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.584191 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.584258 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.584502 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.584504 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.584505 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.584696 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:18.584786 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:18.585089 (+ 303us) server_negotiation.cc:299] Negotiation successful
0807 08:42:18.585186 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":164,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.252.keytab.
Entry for principal kudu/127.8.208.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.252.keytab.
I20260807 08:42:18.586688 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.252:41091
--webserver_interface=127.8.208.252
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.252.keytab
--principal=kudu/127.8.208.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:40001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:33165,127.8.208.253:35557,127.8.208.252:41091
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 08:42:18.586925 23614 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } has no permanent_uuid. Determining permanent_uuid...
I20260807 08:42:18.587606 23617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.587295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:41091 (local address 127.0.0.1:40904)
0807 08:42:18.587437 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.587524 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:41091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 08:42:18.587806 23560 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.208.252:41091: connect: Connection refused (error 111)
I20260807 08:42:18.588581 23617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.588389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:41091 (local address 127.0.0.1:40906)
0807 08:42:18.588507 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.588542 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:41091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260807 08:42:18.588719 23614 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.252:41091: Network error: Client connection negotiation failed: client connection to 127.8.208.252:41091: connect: Connection refused (error 111)
I20260807 08:42:18.595290 23532 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 } attempt: 3
Aug 07 08:42:18 dist-test-slave-6nmv krb5kdc[23444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092138, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for kudu/127.8.208.253@KRBTEST.COM
I20260807 08:42:18.604957 23535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.595681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:35557 (local address 127.0.0.1:57792)
0807 08:42:18.595814 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.595828 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:18.595914 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:18.596160 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:18.596163 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:18.596317 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:18.596751 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:18.596757 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.597790 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.597795 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:18.598359 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:18.598366 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.598788 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.598791 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:18.598892 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:18.599333 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:18.599359 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:18.600634 (+ 1275us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:18.603152 (+ 2518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:18.603155 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:18.603157 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:18.603413 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:18.603823 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:18.603826 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:18.603828 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:18.603918 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:18.604481 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:18.604483 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:18.604578 (+ 95us) client_negotiation.cc:769] Sending connection context
0807 08:42:18.604679 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 08:42:18.604798 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260807 08:42:18.605032 23619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.595734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57792 (local address 127.8.208.253:35557)
0807 08:42:18.595834 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:18.595840 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:18.595873 (+ 33us) server_negotiation.cc:407] Connection header received
0807 08:42:18.596023 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:18.596026 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:18.596069 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:18.596144 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:18.596859 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.597677 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.598471 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.598684 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.598782 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:18.600829 (+ 2047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:18.600836 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:18.600840 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:18.600868 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:18.603013 (+ 2145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.603516 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.603522 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.603524 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.603685 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.604002 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.604008 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.604011 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.604351 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:18.604505 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:18.604786 (+ 281us) server_negotiation.cc:299] Negotiation successful
0807 08:42:18.604884 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 08:42:18.606608 23532 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } has no permanent_uuid. Determining permanent_uuid...
I20260807 08:42:18.607337 23535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.607053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:41091 (local address 127.0.0.1:40908)
0807 08:42:18.607180 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.607257 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:41091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260807 08:42:18.608364 23535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.607960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:41091 (local address 127.0.0.1:40910)
0807 08:42:18.608235 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.608303 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:41091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170}
W20260807 08:42:18.608518 23532 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.252:41091: Network error: Client connection negotiation failed: client connection to 127.8.208.252:41091: connect: Connection refused (error 111)
I20260807 08:42:18.637889 23614 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } attempt: 1
I20260807 08:42:18.638652 23617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.638399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:41091 (local address 127.0.0.1:40922)
0807 08:42:18.638528 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.638579 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:41091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260807 08:42:18.639312 23617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.639108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:41091 (local address 127.0.0.1:40930)
0807 08:42:18.639212 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.639262 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:41091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 08:42:18.639433 23614 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.252:41091: Network error: Client connection negotiation failed: client connection to 127.8.208.252:41091: connect: Connection refused (error 111)
I20260807 08:42:18.639664 23532 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } attempt: 1
I20260807 08:42:18.640226 23535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.640002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:41091 (local address 127.0.0.1:40940)
0807 08:42:18.640123 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.640165 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:41091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 08:42:18.640889 23535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.640687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:41091 (local address 127.0.0.1:40948)
0807 08:42:18.640814 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.640848 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:41091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260807 08:42:18.641004 23532 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.252:41091: Network error: Client connection negotiation failed: client connection to 127.8.208.252:41091: connect: Connection refused (error 111)
W20260807 08:42:18.700593 23620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:18.700894 23620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:18.700989 23620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:18.705000 23620 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:42:18.705080 23620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:18.705116 23620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:18.705170 23620 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:42:18.705209 23620 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:42:18.707599 23614 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } attempt: 2
I20260807 08:42:18.708469 23617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.708140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:41091 (local address 127.0.0.1:40954)
0807 08:42:18.708309 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.708380 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:41091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260807 08:42:18.709239 23617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.709009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:41091 (local address 127.0.0.1:40962)
0807 08:42:18.709126 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.709181 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:41091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 08:42:18.709393 23614 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.252:41091: Network error: Client connection negotiation failed: client connection to 127.8.208.252:41091: connect: Connection refused (error 111)
I20260807 08:42:18.710685 23620 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:40001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:33165,127.8.208.253:35557,127.8.208.252:41091
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.252.keytab
--principal=kudu/127.8.208.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.252:41091
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.208.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:18.711587 23620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:18.712602 23620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 08:42:18.716156 23532 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } attempt: 2
I20260807 08:42:18.716980 23535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.716613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:41091 (local address 127.0.0.1:40966)
0807 08:42:18.716796 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.716869 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:41091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260807 08:42:18.717885 23535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.717590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:41091 (local address 127.0.0.1:40974)
0807 08:42:18.717725 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.717784 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:41091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 08:42:18.718071 23532 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.252:41091: Network error: Client connection negotiation failed: client connection to 127.8.208.252:41091: connect: Connection refused (error 111)
W20260807 08:42:18.721525 23629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:18.721519 23627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:18.721519 23626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:18.721794 23620 server_base.cc:1034] running on GCE node
I20260807 08:42:18.722414 23620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:18.723476 23620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:18.724639 23620 hybrid_clock.cc:648] HybridClock initialized: now 1786092138724609 us; error 42 us; skew 500 ppm
Aug 07 08:42:18 dist-test-slave-6nmv krb5kdc[23444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092138, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:18.727308 23620 init.cc:377] Logged in from keytab as kudu/127.8.208.252@KRBTEST.COM (short username kudu)
I20260807 08:42:18.728196 23620 webserver.cc:460] Webserver started at http://127.8.208.252:39699/ using document root <none> and password file <none>
I20260807 08:42:18.728755 23620 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:18.728845 23620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:42:18.729091 23620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:42:18.731081 23620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-2/data/instance:
uuid: "68735bb356274057b2a327587510103b"
format_stamp: "Formatted at 2026-08-07 08:42:18 on dist-test-slave-6nmv"
server_key: "941f60cddd8c318a2a4538843e777bda"
server_key_iv: "dd2b3130308c64ef6197c2ef261a7744"
server_key_version: "encryptionkey@0"
I20260807 08:42:18.731690 23620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-2/wal/instance:
uuid: "68735bb356274057b2a327587510103b"
format_stamp: "Formatted at 2026-08-07 08:42:18 on dist-test-slave-6nmv"
server_key: "941f60cddd8c318a2a4538843e777bda"
server_key_iv: "dd2b3130308c64ef6197c2ef261a7744"
server_key_version: "encryptionkey@0"
I20260807 08:42:18.735512 23620 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 08:42:18.738011 23636 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:18.739296 23620 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:42:18.739447 23620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-2/wal
uuid: "68735bb356274057b2a327587510103b"
format_stamp: "Formatted at 2026-08-07 08:42:18 on dist-test-slave-6nmv"
server_key: "941f60cddd8c318a2a4538843e777bda"
server_key_iv: "dd2b3130308c64ef6197c2ef261a7744"
server_key_version: "encryptionkey@0"
I20260807 08:42:18.739552 23620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:18.771512 23620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:18.774737 23620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:18.774964 23620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:18.782256 23620 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.252:41091
I20260807 08:42:18.782320 23695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.252:41091 every 8 connection(s)
I20260807 08:42:18.783291 23620 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-2/data/info.pb
I20260807 08:42:18.783509 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 23620
I20260807 08:42:18.783661 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786091987266300-9027-0/minicluster-data/master-2/wal/instance
I20260807 08:42:18.784014 9027 external_mini_cluster.cc:1428] Setting key be354ae7f7a61ba0006f12ae145d51f0
I20260807 08:42:18.786419 23697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:42:18.790421 23697 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33165 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 08:42:18 dist-test-slave-6nmv krb5kdc[23444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.252@KRBTEST.COM
Aug 07 08:42:18 dist-test-slave-6nmv krb5kdc[23444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092138, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.252@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:42:18.798496 23700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.785343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40978 (local address 127.8.208.252:41091)
0807 08:42:18.785741 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:18.785761 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:18.785844 (+ 83us) server_negotiation.cc:407] Connection header received
0807 08:42:18.786520 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:18.786541 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:18.786871 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:18.787180 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:18.788090 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.789043 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.790070 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.790519 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.790639 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:18.793508 (+ 2869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:18.793513 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:18.793521 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:18.793545 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:18.795525 (+ 1980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.795981 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.795986 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.795991 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.796119 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.796409 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.796411 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.796412 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.796761 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:18.797046 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:18.797314 (+ 268us) server_negotiation.cc:299] Negotiation successful
0807 08:42:18.797625 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":133,"threads_started":1}
I20260807 08:42:18.800561 23614 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } attempt: 3
I20260807 08:42:18.802224 23534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.792415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53904 (local address 127.8.208.254:33165)
0807 08:42:18.792579 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:18.792584 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:18.792931 (+ 347us) server_negotiation.cc:407] Connection header received
0807 08:42:18.793068 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:18.793071 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:18.793127 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:18.793201 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:18.794054 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.794950 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.795857 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.796159 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.796255 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:18.798550 (+ 2295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:18.798555 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:18.798559 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:18.798585 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:18.800115 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.800655 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.800663 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.800665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.800768 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.801122 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.801126 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.801127 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.801382 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:18.801488 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:18.801964 (+ 476us) server_negotiation.cc:299] Negotiation successful
0807 08:42:18.802081 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 08:42:18.802353 23701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.792338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:33165 (local address 127.0.0.1:53904)
0807 08:42:18.792777 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.792827 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:18.792966 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:18.793281 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:18.793288 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:18.793704 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:18.793889 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:18.793899 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.795067 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.795069 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:18.795747 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:18.795756 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.796263 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.796269 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:18.796402 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:18.796888 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:18.796921 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:18.798411 (+ 1490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:18.800268 (+ 1857us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:18.800274 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:18.800277 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:18.800556 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:18.800878 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:18.800882 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:18.800884 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:18.800993 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:18.801572 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:18.801579 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:18.801689 (+ 110us) client_negotiation.cc:769] Sending connection context
0807 08:42:18.801908 (+ 219us) client_negotiation.cc:240] Negotiation successful
0807 08:42:18.802100 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"mutex_wait_us":1,"thread_start_us":154,"threads_started":1}
I20260807 08:42:18.803381 23697 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 08:42:18 dist-test-slave-6nmv krb5kdc[23444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092138, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.253@KRBTEST.COM for kudu/127.8.208.252@KRBTEST.COM
Aug 07 08:42:18 dist-test-slave-6nmv krb5kdc[23444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:42:18.809792 23617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.801027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:41091 (local address 127.0.0.1:40984)
0807 08:42:18.801280 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.801294 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:18.801380 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:18.801624 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:18.801627 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:18.801829 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:18.801943 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:18.801950 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.802860 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.802864 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:18.803717 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:18.803729 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.804304 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.804307 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:18.804377 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:18.804776 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:18.804794 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:18.806496 (+ 1702us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:18.808333 (+ 1837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:18.808335 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:18.808337 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:18.808601 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:18.808897 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:18.808900 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:18.808901 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:18.808995 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:18.809436 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:18.809441 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:18.809535 (+ 94us) client_negotiation.cc:769] Sending connection context
0807 08:42:18.809608 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 08:42:18.809696 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176}
Aug 07 08:42:18 dist-test-slave-6nmv krb5kdc[23444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092138, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.252@KRBTEST.COM for kudu/127.8.208.253@KRBTEST.COM
I20260807 08:42:18.810310 23700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.801254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40984 (local address 127.8.208.252:41091)
0807 08:42:18.801356 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:18.801360 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:18.801375 (+ 15us) server_negotiation.cc:407] Connection header received
0807 08:42:18.801446 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:18.801450 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:18.801505 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:18.801583 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:18.802067 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.802757 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.803843 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.804198 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.804294 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:18.806629 (+ 2335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:18.806632 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:18.806635 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:18.806656 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:18.808213 (+ 1557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.808694 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.808699 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.808700 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.808797 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.809109 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.809113 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.809115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.809291 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:18.810000 (+ 709us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:18.810072 (+ 72us) server_negotiation.cc:299] Negotiation successful
0807 08:42:18.810166 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260807 08:42:18.811914 23702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.801088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53914 (local address 127.8.208.254:33165)
0807 08:42:18.801586 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:18.801595 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:18.801606 (+ 11us) server_negotiation.cc:407] Connection header received
0807 08:42:18.801633 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:18.801635 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:18.801676 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:18.801763 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:18.802599 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.803479 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.804604 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.805008 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.805112 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:18.807980 (+ 2868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:18.807985 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:18.807988 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:18.808014 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:18.809783 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.810329 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.810332 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.810333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.810421 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.810720 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.810724 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.810725 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.810940 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:18.811630 (+ 690us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:18.811711 (+ 81us) server_negotiation.cc:299] Negotiation successful
0807 08:42:18.811797 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":105,"threads_started":1}
I20260807 08:42:18.813879 23701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.803840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:35557 (local address 127.0.0.1:57802)
0807 08:42:18.804424 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.804436 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:18.804509 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:18.804819 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:18.804821 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:18.804940 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:18.805467 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:18.805476 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.806643 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.806646 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:18.807548 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:18.807559 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.808231 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.808233 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:18.808342 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:18.808965 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:18.808977 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:18.810323 (+ 1346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:18.812293 (+ 1970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:18.812295 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:18.812297 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:18.812475 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:18.812799 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:18.812802 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:18.812804 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:18.812906 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:18.813365 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:18.813368 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:18.813462 (+ 94us) client_negotiation.cc:769] Sending connection context
0807 08:42:18.813574 (+ 112us) client_negotiation.cc:240] Negotiation successful
0807 08:42:18.813698 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515}
I20260807 08:42:18.813779 23614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec3b1c5aa91443cfba514098cf55d012: Bootstrap starting.
I20260807 08:42:18.813942 23619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.803900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57802 (local address 127.8.208.253:35557)
0807 08:42:18.804007 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:18.804018 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:18.804498 (+ 480us) server_negotiation.cc:407] Connection header received
0807 08:42:18.804588 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:18.804591 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:18.804639 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:18.804709 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:18.805580 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.806493 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.807695 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.808031 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.808094 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:18.810474 (+ 2380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:18.810480 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:18.810482 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:18.810504 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:18.812201 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.812591 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.812594 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.812596 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.812684 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.813012 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.813015 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.813017 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.813226 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:18.813293 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:18.813622 (+ 329us) server_negotiation.cc:299] Negotiation successful
0807 08:42:18.813715 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 08:42:18.816112 23614 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec3b1c5aa91443cfba514098cf55d012: Neither blocks nor log segments found. Creating new log.
I20260807 08:42:18.816810 23614 log.cc:824] T 00000000000000000000000000000000 P ec3b1c5aa91443cfba514098cf55d012: Log is configured to *not* fsync() on all Append() calls
I20260807 08:42:18.817915 23532 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } attempt: 3
Aug 07 08:42:18 dist-test-slave-6nmv krb5kdc[23444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.253@KRBTEST.COM
I20260807 08:42:18.818761 23697 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } has no permanent_uuid. Determining permanent_uuid...
I20260807 08:42:18.819825 23614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec3b1c5aa91443cfba514098cf55d012: No bootstrap required, opened a new log
I20260807 08:42:18.822569 23619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.813951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57816 (local address 127.8.208.253:35557)
0807 08:42:18.814088 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:18.814092 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:18.814105 (+ 13us) server_negotiation.cc:407] Connection header received
0807 08:42:18.814137 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:18.814139 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:18.814174 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:18.814266 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:18.814800 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.815248 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.815924 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.816114 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.816205 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:18.819122 (+ 2917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:18.819125 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:18.819128 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:18.819153 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:18.820772 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.821227 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.821231 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.821232 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.821309 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.821617 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.821621 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.821622 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.821841 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:18.821989 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:18.822304 (+ 315us) server_negotiation.cc:299] Negotiation successful
0807 08:42:18.822414 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66,"thread_start_us":96,"threads_started":1}
I20260807 08:42:18.823964 23614 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec3b1c5aa91443cfba514098cf55d012 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33165 } } peers { permanent_uuid: "ec3b1c5aa91443cfba514098cf55d012" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 } } peers { permanent_uuid: "68735bb356274057b2a327587510103b" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } }
I20260807 08:42:18.824203 23614 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec3b1c5aa91443cfba514098cf55d012 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:42:18.824249 23614 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec3b1c5aa91443cfba514098cf55d012 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec3b1c5aa91443cfba514098cf55d012, State: Initialized, Role: FOLLOWER
Aug 07 08:42:18 dist-test-slave-6nmv krb5kdc[23444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092138, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for kudu/127.8.208.252@KRBTEST.COM
Aug 07 08:42:18 dist-test-slave-6nmv krb5kdc[23444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092138, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.252@KRBTEST.COM for kudu/127.8.208.252@KRBTEST.COM
I20260807 08:42:18.824733 23614 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec3b1c5aa91443cfba514098cf55d012 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33165 } } peers { permanent_uuid: "ec3b1c5aa91443cfba514098cf55d012" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 } } peers { permanent_uuid: "68735bb356274057b2a327587510103b" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } }
I20260807 08:42:18.826207 23614 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec3b1c5aa91443cfba514098cf55d012 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:42:18.826273 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 08:42:18.826598 23708 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec3b1c5aa91443cfba514098cf55d012 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33165 } } peers { permanent_uuid: "ec3b1c5aa91443cfba514098cf55d012" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 } } peers { permanent_uuid: "68735bb356274057b2a327587510103b" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } } }
I20260807 08:42:18.826754 23708 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec3b1c5aa91443cfba514098cf55d012 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:42:18.829562 23701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.819195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:41091 (local address 127.0.0.1:40996)
0807 08:42:18.819664 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.819678 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:18.819755 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:18.820243 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:18.820247 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:18.820401 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:18.820496 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:18.820502 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.821543 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.821549 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:18.822318 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:18.822326 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.822840 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.822843 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:18.822909 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:18.823267 (+ 358us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:18.823280 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:18.825623 (+ 2343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:18.827971 (+ 2348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:18.827973 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:18.827975 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:18.828221 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:18.828523 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:18.828529 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:18.828531 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:18.828610 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:18.829069 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:18.829073 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:18.829172 (+ 99us) client_negotiation.cc:769] Sending connection context
0807 08:42:18.829271 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 08:42:18.829396 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"mutex_wait_us":20}
I20260807 08:42:18.829581 23535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.818385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:41091 (local address 127.0.0.1:40990)
0807 08:42:18.818532 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:18.818559 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:18.818631 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:18.819638 (+ 1007us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:18.819641 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:18.819811 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:18.820160 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:18.820170 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.821134 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.821138 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:18.821930 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:18.821939 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.822518 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.822521 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:18.822600 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:18.823029 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:18.823043 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:18.825139 (+ 2096us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:18.827968 (+ 2829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:18.827971 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:18.827973 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:18.828174 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:18.828511 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:18.828514 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:18.828516 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:18.828614 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:18.829096 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:18.829099 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:18.829196 (+ 97us) client_negotiation.cc:769] Sending connection context
0807 08:42:18.829282 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 08:42:18.829426 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260807 08:42:18.830061 23707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.819403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40996 (local address 127.8.208.252:41091)
0807 08:42:18.820019 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:18.820031 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:18.820045 (+ 14us) server_negotiation.cc:407] Connection header received
0807 08:42:18.820074 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:18.820077 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:18.820116 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:18.820600 (+ 484us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:18.820691 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.821438 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.822420 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.822730 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.823094 (+ 364us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:18.825749 (+ 2655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:18.825753 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:18.825755 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:18.825776 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:18.827850 (+ 2074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.828320 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.828323 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.828324 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.828414 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.828706 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.828709 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.828710 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.828903 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:18.829029 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:18.829767 (+ 738us) server_negotiation.cc:299] Negotiation successful
0807 08:42:18.829897 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":524,"spinlock_wait_cycles":1280,"thread_start_us":129,"threads_started":1}
I20260807 08:42:18.833112 23697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68735bb356274057b2a327587510103b: Bootstrap starting.
W20260807 08:42:18.834167 23723 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ec3b1c5aa91443cfba514098cf55d012: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:42:18.834237 23723 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:42:18.831249 23539 master_runner.cc:186] Error getting master registration for 127.8.208.254:33165: OK, instance_id { permanent_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" instance_seqno: 1786092138354834 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 08:42:18.835044 23539 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 08:42:18.835768 23700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.818610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40990 (local address 127.8.208.252:41091)
0807 08:42:18.819163 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:18.819166 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:18.819178 (+ 12us) server_negotiation.cc:407] Connection header received
0807 08:42:18.819225 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:18.819227 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:18.819263 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:18.820282 (+ 1019us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:18.820364 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.821009 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.822063 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.822397 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.825262 (+ 2865us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:18.825354 (+ 92us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:18.825357 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:18.825359 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:18.825374 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:18.827875 (+ 2501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.828288 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.828294 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.828298 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.828391 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.828746 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.828749 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.828752 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.828988 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:18.835441 (+ 6453us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:18.835515 (+ 74us) server_negotiation.cc:299] Negotiation successful
0807 08:42:18.835620 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":489}
I20260807 08:42:18.835798 23697 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68735bb356274057b2a327587510103b: Neither blocks nor log segments found. Creating new log.
I20260807 08:42:18.836700 23697 log.cc:824] T 00000000000000000000000000000000 P 68735bb356274057b2a327587510103b: Log is configured to *not* fsync() on all Append() calls
I20260807 08:42:18.838905 23532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9: Bootstrap starting.
I20260807 08:42:18.840137 23707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.829517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41012 (local address 127.8.208.252:41091)
0807 08:42:18.830222 (+ 705us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:18.830226 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:18.831046 (+ 820us) server_negotiation.cc:407] Connection header received
0807 08:42:18.831212 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:18.831215 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:18.831248 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:18.831288 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:18.832219 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.832966 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.834132 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.834500 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.834589 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:18.836877 (+ 2288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:18.836880 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:18.836883 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:18.836905 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:18.838370 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.838873 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.838878 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.838880 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.838967 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.839275 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.839278 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.839280 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.839485 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:18.839599 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:18.839910 (+ 311us) server_negotiation.cc:299] Negotiation successful
0807 08:42:18.840012 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":647,"thread_start_us":86,"threads_started":1}
I20260807 08:42:18.840601 23697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68735bb356274057b2a327587510103b: No bootstrap required, opened a new log
I20260807 08:42:18.841547 23532 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9: Neither blocks nor log segments found. Creating new log.
I20260807 08:42:18.842411 23532 log.cc:824] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9: Log is configured to *not* fsync() on all Append() calls
I20260807 08:42:18.844928 23697 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68735bb356274057b2a327587510103b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33165 } } peers { permanent_uuid: "ec3b1c5aa91443cfba514098cf55d012" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 } } peers { permanent_uuid: "68735bb356274057b2a327587510103b" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } }
I20260807 08:42:18.845466 23697 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68735bb356274057b2a327587510103b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:42:18.845537 23697 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68735bb356274057b2a327587510103b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68735bb356274057b2a327587510103b, State: Initialized, Role: FOLLOWER
I20260807 08:42:18.846072 23697 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68735bb356274057b2a327587510103b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33165 } } peers { permanent_uuid: "ec3b1c5aa91443cfba514098cf55d012" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 } } peers { permanent_uuid: "68735bb356274057b2a327587510103b" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } }
I20260807 08:42:18.848394 23697 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68735bb356274057b2a327587510103b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:42:18.850070 23532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9: No bootstrap required, opened a new log
I20260807 08:42:18.850492 23705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.830311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57820 (local address 127.8.208.253:35557)
0807 08:42:18.830425 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:18.830433 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:18.840982 (+ 10549us) server_negotiation.cc:407] Connection header received
0807 08:42:18.841143 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:18.841146 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:18.841190 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:18.841246 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:18.842183 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.843006 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.844147 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.844524 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.844597 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:18.846467 (+ 1870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:18.846472 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:18.846474 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:18.846497 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:18.848331 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.848875 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.848879 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.848882 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.848987 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.849318 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.849321 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.849323 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.849578 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:18.849715 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:18.850088 (+ 373us) server_negotiation.cc:299] Negotiation successful
0807 08:42:18.850269 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 08:42:18.855732 23702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:18.829099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53920 (local address 127.8.208.254:33165)
0807 08:42:18.829196 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:18.829199 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:18.843002 (+ 13803us) server_negotiation.cc:407] Connection header received
0807 08:42:18.843292 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:18.843295 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:18.843353 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:18.843402 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:18.844478 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.845240 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.846375 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:18.846709 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:18.846804 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:18.848441 (+ 1637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:18.848444 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:18.848447 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:18.848474 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:18.853391 (+ 4917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.854224 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.854228 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.854230 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.854306 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:18.854584 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:18.854586 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:18.854588 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:18.854763 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:18.854863 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:18.855470 (+ 607us) server_negotiation.cc:299] Negotiation successful
0807 08:42:18.855577 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 08:42:18.852744 23620 master_runner.cc:186] Error getting master registration for 127.8.208.254:33165: OK, instance_id { permanent_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" instance_seqno: 1786092138354834 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 08:42:18.856055 23620 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 08:42:18.857187 23744 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 68735bb356274057b2a327587510103b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:42:18.857272 23744 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:42:18.857337 23532 raft_consensus.cc:348] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33165 } } peers { permanent_uuid: "ec3b1c5aa91443cfba514098cf55d012" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 } } peers { permanent_uuid: "68735bb356274057b2a327587510103b" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } }
I20260807 08:42:18.857537 23532 raft_consensus.cc:374] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:42:18.857589 23532 raft_consensus.cc:729] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf6375e2604d4a7c92c7bab2c9b32bb9, State: Initialized, Role: FOLLOWER
I20260807 08:42:18.857951 23731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68735bb356274057b2a327587510103b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33165 } } peers { permanent_uuid: "ec3b1c5aa91443cfba514098cf55d012" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 } } peers { permanent_uuid: "68735bb356274057b2a327587510103b" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } } }
I20260807 08:42:18.858072 23731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68735bb356274057b2a327587510103b [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:42:18.858047 23532 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33165 } } peers { permanent_uuid: "ec3b1c5aa91443cfba514098cf55d012" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 } } peers { permanent_uuid: "68735bb356274057b2a327587510103b" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } }
I20260807 08:42:18.858520 23746 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33165 } } peers { permanent_uuid: "ec3b1c5aa91443cfba514098cf55d012" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 } } peers { permanent_uuid: "68735bb356274057b2a327587510103b" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } } }
I20260807 08:42:18.858695 23746 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:42:18.859185 23532 sys_catalog.cc:564] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:42:18.868245 23458 master_runner.cc:263] No leader master found from master bf6375e2604d4a7c92c7bab2c9b32bb9
I20260807 08:42:18.868310 23458 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 08:42:18.869452 23746 raft_consensus.cc:482] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:42:18.869576 23746 raft_consensus.cc:504] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33165 } } peers { permanent_uuid: "ec3b1c5aa91443cfba514098cf55d012" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 } } peers { permanent_uuid: "68735bb356274057b2a327587510103b" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } }
I20260807 08:42:18.870409 23746 leader_election.cc:288] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec3b1c5aa91443cfba514098cf55d012 (127.8.208.253:35557), 68735bb356274057b2a327587510103b (127.8.208.252:41091)
I20260807 08:42:18.871069 23666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68735bb356274057b2a327587510103b" is_pre_election: true
I20260807 08:42:18.871335 23666 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 68735bb356274057b2a327587510103b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf6375e2604d4a7c92c7bab2c9b32bb9 in term 0.
I20260807 08:42:18.871745 23479 leader_election.cc:302] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68735bb356274057b2a327587510103b, bf6375e2604d4a7c92c7bab2c9b32bb9; no voters:
I20260807 08:42:18.872131 23585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec3b1c5aa91443cfba514098cf55d012" is_pre_election: true
I20260807 08:42:18.872363 23585 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ec3b1c5aa91443cfba514098cf55d012 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf6375e2604d4a7c92c7bab2c9b32bb9 in term 0.
I20260807 08:42:18.872910 23746 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:42:18.872989 23746 raft_consensus.cc:482] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:42:18.873039 23746 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [term 0 FOLLOWER]: Advancing to term 1
W20260807 08:42:18.873143 23758 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:42:18.873239 23758 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:42:18.874168 23746 raft_consensus.cc:504] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33165 } } peers { permanent_uuid: "ec3b1c5aa91443cfba514098cf55d012" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 } } peers { permanent_uuid: "68735bb356274057b2a327587510103b" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } }
I20260807 08:42:18.874464 23746 leader_election.cc:288] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [CANDIDATE]: Term 1 election: Requested vote from peers ec3b1c5aa91443cfba514098cf55d012 (127.8.208.253:35557), 68735bb356274057b2a327587510103b (127.8.208.252:41091)
I20260807 08:42:18.875206 23666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68735bb356274057b2a327587510103b"
I20260807 08:42:18.875329 23666 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68735bb356274057b2a327587510103b [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:42:18.876406 23666 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 68735bb356274057b2a327587510103b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf6375e2604d4a7c92c7bab2c9b32bb9 in term 1.
I20260807 08:42:18.876695 23479 leader_election.cc:302] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68735bb356274057b2a327587510103b, bf6375e2604d4a7c92c7bab2c9b32bb9; no voters:
I20260807 08:42:18.877367 23585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec3b1c5aa91443cfba514098cf55d012"
I20260807 08:42:18.877496 23585 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec3b1c5aa91443cfba514098cf55d012 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:42:18.879112 23585 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ec3b1c5aa91443cfba514098cf55d012 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf6375e2604d4a7c92c7bab2c9b32bb9 in term 1.
I20260807 08:42:18.879468 23746 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:42:18.879680 23746 raft_consensus.cc:686] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [term 1 LEADER]: Becoming Leader. State: Replica: bf6375e2604d4a7c92c7bab2c9b32bb9, State: Running, Role: LEADER
I20260807 08:42:18.879948 23746 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33165 } } peers { permanent_uuid: "ec3b1c5aa91443cfba514098cf55d012" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 } } peers { permanent_uuid: "68735bb356274057b2a327587510103b" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } }
I20260807 08:42:18.883711 23746 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf6375e2604d4a7c92c7bab2c9b32bb9. Latest consensus state: current_term: 1 leader_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33165 } } peers { permanent_uuid: "ec3b1c5aa91443cfba514098cf55d012" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 } } peers { permanent_uuid: "68735bb356274057b2a327587510103b" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } } }
I20260807 08:42:18.883829 23746 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [sys.catalog]: This master's current role is: LEADER
I20260807 08:42:18.885346 23762 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:42:18.886165 23762 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:42:18.890719 23666 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 68735bb356274057b2a327587510103b [term 1 FOLLOWER]: Refusing update from remote peer bf6375e2604d4a7c92c7bab2c9b32bb9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:42:18.893110 23760 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68735bb356274057b2a327587510103b" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:42:18.896673 23731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68735bb356274057b2a327587510103b [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf6375e2604d4a7c92c7bab2c9b32bb9. Latest consensus state: current_term: 1 leader_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33165 } } peers { permanent_uuid: "ec3b1c5aa91443cfba514098cf55d012" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 } } peers { permanent_uuid: "68735bb356274057b2a327587510103b" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } } }
I20260807 08:42:18.896795 23731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68735bb356274057b2a327587510103b [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:42:18.896965 23585 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ec3b1c5aa91443cfba514098cf55d012 [term 1 FOLLOWER]: Refusing update from remote peer bf6375e2604d4a7c92c7bab2c9b32bb9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:42:18.897503 23760 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec3b1c5aa91443cfba514098cf55d012" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:42:18.900753 23708 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec3b1c5aa91443cfba514098cf55d012 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf6375e2604d4a7c92c7bab2c9b32bb9. Latest consensus state: current_term: 1 leader_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33165 } } peers { permanent_uuid: "ec3b1c5aa91443cfba514098cf55d012" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 } } peers { permanent_uuid: "68735bb356274057b2a327587510103b" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } } }
I20260807 08:42:18.900859 23708 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec3b1c5aa91443cfba514098cf55d012 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:42:18.905874 23760 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33165 } } peers { permanent_uuid: "ec3b1c5aa91443cfba514098cf55d012" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 } } peers { permanent_uuid: "68735bb356274057b2a327587510103b" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } } }
I20260807 08:42:18.905974 23760 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [sys.catalog]: This master's current role is: LEADER
I20260807 08:42:18.906914 23731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68735bb356274057b2a327587510103b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33165 } } peers { permanent_uuid: "ec3b1c5aa91443cfba514098cf55d012" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 } } peers { permanent_uuid: "68735bb356274057b2a327587510103b" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } } }
I20260807 08:42:18.907037 23731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68735bb356274057b2a327587510103b [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:42:18.907229 23763 mvcc.cc:205] Tried to move back new op lower bound from 7315833400890433536 to 7315833400855064576. Current Snapshot: MvccSnapshot[applied={T|T < 7315833400890433536}]
I20260807 08:42:18.907377 23765 mvcc.cc:205] Tried to move back new op lower bound from 7315833400890433536 to 7315833400855064576. Current Snapshot: MvccSnapshot[applied={T|T < 7315833400890433536}]
I20260807 08:42:18.911329 23762 catalog_manager.cc:1347] Generated new cluster ID: 96e6392aba50400daac679f8448ca200
I20260807 08:42:18.911393 23762 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:42:18.912488 23746 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33165 } } peers { permanent_uuid: "ec3b1c5aa91443cfba514098cf55d012" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 } } peers { permanent_uuid: "68735bb356274057b2a327587510103b" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } } }
I20260807 08:42:18.912590 23746 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9 [sys.catalog]: This master's current role is: LEADER
I20260807 08:42:18.913630 23767 mvcc.cc:205] Tried to move back new op lower bound from 7315833400890433536 to 7315833400855064576. Current Snapshot: MvccSnapshot[applied={T|T < 7315833400890433536}]
I20260807 08:42:18.915146 23708 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec3b1c5aa91443cfba514098cf55d012 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf6375e2604d4a7c92c7bab2c9b32bb9" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 33165 } } peers { permanent_uuid: "ec3b1c5aa91443cfba514098cf55d012" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 35557 } } peers { permanent_uuid: "68735bb356274057b2a327587510103b" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 41091 } } }
I20260807 08:42:18.915237 23708 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec3b1c5aa91443cfba514098cf55d012 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:42:18.958034 23762 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:42:18.959281 23762 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:42:18.975503 23762 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bf6375e2604d4a7c92c7bab2c9b32bb9: Generated new TSK 0
I20260807 08:42:18.976258 23762 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:42:19.835511 23723 catalog_manager.cc:1259] Loaded cluster ID: 96e6392aba50400daac679f8448ca200
I20260807 08:42:19.835633 23723 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ec3b1c5aa91443cfba514098cf55d012: loading cluster ID for follower catalog manager: success
I20260807 08:42:19.837270 23723 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ec3b1c5aa91443cfba514098cf55d012: acquiring CA information for follower catalog manager: success
I20260807 08:42:19.838461 23723 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ec3b1c5aa91443cfba514098cf55d012: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 08:42:19.858408 23744 catalog_manager.cc:1259] Loaded cluster ID: 96e6392aba50400daac679f8448ca200
I20260807 08:42:19.858475 23744 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 68735bb356274057b2a327587510103b: loading cluster ID for follower catalog manager: success
I20260807 08:42:19.859997 23744 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 68735bb356274057b2a327587510103b: acquiring CA information for follower catalog manager: success
I20260807 08:42:19.861112 23744 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 68735bb356274057b2a327587510103b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 08:42:20.046510 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 23458
I20260807 08:42:20.055186 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 23539
I20260807 08:42:20.061870 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 23620
2026-08-07T08:42:20Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (2981 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:42:20 dist-test-slave-6nmv krb5kdc[23780](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:42:20 dist-test-slave-6nmv krb5kdc[23780](info): set up 2 sockets
Aug 07 08:42:20 dist-test-slave-6nmv krb5kdc[23780](info): commencing operation
krb5kdc: starting...
W20260807 08:42:21.102733 9027 mini_kdc.cc:121] Time spent starting KDC: real 1.018s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:42:21 dist-test-slave-6nmv krb5kdc[23780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092141, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:42:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:42:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:42:21.224614 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:43093
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:34009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:43093
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:42:21.328464 23797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:21.328685 23797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:21.328720 23797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:21.332346 23797 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:42:21.332392 23797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:21.332409 23797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:21.332458 23797 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:42:21.332485 23797 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:42:21.337041 23797 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:34009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:43093
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:43093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:21.337975 23797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:21.338915 23797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:42:21.346649 23806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:21.346710 23804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:21.346679 23803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:21.346926 23797 server_base.cc:1034] running on GCE node
I20260807 08:42:21.347491 23797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:21.348521 23797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:21.349704 23797 hybrid_clock.cc:648] HybridClock initialized: now 1786092141349674 us; error 34 us; skew 500 ppm
Aug 07 08:42:21 dist-test-slave-6nmv krb5kdc[23780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092141, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:21.352299 23797 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:42:21.353170 23797 webserver.cc:460] Webserver started at http://127.8.208.254:38501/ using document root <none> and password file <none>
I20260807 08:42:21.353691 23797 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:21.353771 23797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:42:21.353989 23797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:42:21.355758 23797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "d3ff3b57063a45439da09a844d4c39e4"
format_stamp: "Formatted at 2026-08-07 08:42:21 on dist-test-slave-6nmv"
server_key: "79d9fc6ece88bd29260dee6a1ea18e1c"
server_key_iv: "7dcad0683adcde5e35ee1a304e37dc54"
server_key_version: "encryptionkey@0"
I20260807 08:42:21.356271 23797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "d3ff3b57063a45439da09a844d4c39e4"
format_stamp: "Formatted at 2026-08-07 08:42:21 on dist-test-slave-6nmv"
server_key: "79d9fc6ece88bd29260dee6a1ea18e1c"
server_key_iv: "7dcad0683adcde5e35ee1a304e37dc54"
server_key_version: "encryptionkey@0"
I20260807 08:42:21.359762 23797 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 08:42:21.362010 23813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:21.363528 23797 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 08:42:21.363649 23797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "d3ff3b57063a45439da09a844d4c39e4"
format_stamp: "Formatted at 2026-08-07 08:42:21 on dist-test-slave-6nmv"
server_key: "79d9fc6ece88bd29260dee6a1ea18e1c"
server_key_iv: "7dcad0683adcde5e35ee1a304e37dc54"
server_key_version: "encryptionkey@0"
I20260807 08:42:21.363755 23797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:21.378932 23797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:21.382125 23797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:21.382301 23797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:21.389304 23797 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:43093
I20260807 08:42:21.389326 23870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:43093 every 8 connection(s)
I20260807 08:42:21.390242 23797 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:42:21.392937 23871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:42:21.398394 23871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3ff3b57063a45439da09a844d4c39e4: Bootstrap starting.
I20260807 08:42:21.400214 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 23797
I20260807 08:42:21.400357 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:42:21.400720 9027 external_mini_cluster.cc:1428] Setting key 53f3d644e4a297030c27c440348ba436
I20260807 08:42:21.401127 23871 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3ff3b57063a45439da09a844d4c39e4: Neither blocks nor log segments found. Creating new log.
I20260807 08:42:21.402050 23871 log.cc:824] T 00000000000000000000000000000000 P d3ff3b57063a45439da09a844d4c39e4: Log is configured to *not* fsync() on all Append() calls
I20260807 08:42:21.403810 23871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3ff3b57063a45439da09a844d4c39e4: No bootstrap required, opened a new log
I20260807 08:42:21.406975 23871 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3ff3b57063a45439da09a844d4c39e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3ff3b57063a45439da09a844d4c39e4" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43093 } }
I20260807 08:42:21.407214 23871 raft_consensus.cc:374] T 00000000000000000000000000000000 P d3ff3b57063a45439da09a844d4c39e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:42:21.407330 23871 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3ff3b57063a45439da09a844d4c39e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3ff3b57063a45439da09a844d4c39e4, State: Initialized, Role: FOLLOWER
I20260807 08:42:21.407753 23871 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3ff3b57063a45439da09a844d4c39e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3ff3b57063a45439da09a844d4c39e4" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43093 } }
I20260807 08:42:21.407943 23871 raft_consensus.cc:388] T 00000000000000000000000000000000 P d3ff3b57063a45439da09a844d4c39e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:42:21.408044 23871 raft_consensus.cc:482] T 00000000000000000000000000000000 P d3ff3b57063a45439da09a844d4c39e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:42:21.408167 23871 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3ff3b57063a45439da09a844d4c39e4 [term 0 FOLLOWER]: Advancing to term 1
Aug 07 08:42:21 dist-test-slave-6nmv krb5kdc[23780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092141, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:42:21.409113 23871 raft_consensus.cc:504] T 00000000000000000000000000000000 P d3ff3b57063a45439da09a844d4c39e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3ff3b57063a45439da09a844d4c39e4" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43093 } }
I20260807 08:42:21.409446 23871 leader_election.cc:302] T 00000000000000000000000000000000 P d3ff3b57063a45439da09a844d4c39e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3ff3b57063a45439da09a844d4c39e4; no voters:
I20260807 08:42:21.409755 23871 leader_election.cc:288] T 00000000000000000000000000000000 P d3ff3b57063a45439da09a844d4c39e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:42:21.409842 23876 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d3ff3b57063a45439da09a844d4c39e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:42:21.410023 23876 raft_consensus.cc:686] T 00000000000000000000000000000000 P d3ff3b57063a45439da09a844d4c39e4 [term 1 LEADER]: Becoming Leader. State: Replica: d3ff3b57063a45439da09a844d4c39e4, State: Running, Role: LEADER
I20260807 08:42:21.410346 23876 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3ff3b57063a45439da09a844d4c39e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3ff3b57063a45439da09a844d4c39e4" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43093 } }
I20260807 08:42:21.410917 23871 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3ff3b57063a45439da09a844d4c39e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:42:21.412072 23878 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3ff3b57063a45439da09a844d4c39e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3ff3b57063a45439da09a844d4c39e4. Latest consensus state: current_term: 1 leader_uuid: "d3ff3b57063a45439da09a844d4c39e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3ff3b57063a45439da09a844d4c39e4" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43093 } } }
I20260807 08:42:21.412200 23878 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3ff3b57063a45439da09a844d4c39e4 [sys.catalog]: This master's current role is: LEADER
I20260807 08:42:21.412494 23877 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3ff3b57063a45439da09a844d4c39e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d3ff3b57063a45439da09a844d4c39e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3ff3b57063a45439da09a844d4c39e4" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43093 } } }
I20260807 08:42:21.412586 23885 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:42:21.412595 23877 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3ff3b57063a45439da09a844d4c39e4 [sys.catalog]: This master's current role is: LEADER
I20260807 08:42:21.414861 23874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:21.401906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47232 (local address 127.8.208.254:43093)
0807 08:42:21.402339 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:21.402352 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:21.402383 (+ 31us) server_negotiation.cc:407] Connection header received
0807 08:42:21.402926 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:21.402948 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:21.403218 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:21.403511 (+ 293us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:21.404239 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:21.405096 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:21.405951 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:21.406390 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:21.406566 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:21.409262 (+ 2696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:21.409269 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:21.409283 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:21.409314 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:21.411064 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:21.411541 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:21.411547 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:21.411553 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:21.411742 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:21.412093 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:21.412099 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:21.412103 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:21.412625 (+ 522us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:21.412898 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:21.413642 (+ 744us) server_negotiation.cc:299] Negotiation successful
0807 08:42:21.413972 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":141,"threads_started":1}
I20260807 08:42:21.415468 23885 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:42:21.417886 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 08:42:21.420506 23885 catalog_manager.cc:1347] Generated new cluster ID: 19724c52ea244608aefa10e830c4b36f
I20260807 08:42:21.420571 23885 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:42:21.442272 23885 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:42:21.443022 23885 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:42:21.454797 23885 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d3ff3b57063a45439da09a844d4c39e4: Generated new TSK 0
I20260807 08:42:21.455330 23885 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:42:21.472815 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 23797
2026-08-07T08:42:21Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1409 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:42:21 dist-test-slave-6nmv krb5kdc[23901](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:42:21 dist-test-slave-6nmv krb5kdc[23901](info): set up 2 sockets
Aug 07 08:42:21 dist-test-slave-6nmv krb5kdc[23901](info): commencing operation
krb5kdc: starting...
W20260807 08:42:22.500012 9027 mini_kdc.cc:121] Time spent starting KDC: real 1.006s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:42:22 dist-test-slave-6nmv krb5kdc[23901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092142, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:42:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:42:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:42:22.622939 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:43987
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:43987
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:42:22.729502 23916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:22.729748 23916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:22.729787 23916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:22.733672 23916 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:42:22.733724 23916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:22.733742 23916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:22.733757 23916 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:42:22.733771 23916 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:42:22.738894 23916 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:43987
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:43987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23916
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:22.739734 23916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:22.740592 23916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:42:22.748636 23926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:22.748651 23924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:22.748766 23916 server_base.cc:1034] running on GCE node
W20260807 08:42:22.748653 23923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:22.749351 23916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:22.750465 23916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:22.751631 23916 hybrid_clock.cc:648] HybridClock initialized: now 1786092142751615 us; error 26 us; skew 500 ppm
Aug 07 08:42:22 dist-test-slave-6nmv krb5kdc[23901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092142, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:22.754374 23916 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:42:22.755110 23916 webserver.cc:460] Webserver started at http://127.8.208.254:41363/ using document root <none> and password file <none>
I20260807 08:42:22.755600 23916 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:22.755683 23916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:42:22.755904 23916 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:42:22.757860 23916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "55a34663645a4670abe559251bcfc80e"
format_stamp: "Formatted at 2026-08-07 08:42:22 on dist-test-slave-6nmv"
server_key: "59f8f49b18692e796894a58794b546bd"
server_key_iv: "64a88a063e267f04b4f9a20d8f8c6aa1"
server_key_version: "encryptionkey@0"
I20260807 08:42:22.758435 23916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "55a34663645a4670abe559251bcfc80e"
format_stamp: "Formatted at 2026-08-07 08:42:22 on dist-test-slave-6nmv"
server_key: "59f8f49b18692e796894a58794b546bd"
server_key_iv: "64a88a063e267f04b4f9a20d8f8c6aa1"
server_key_version: "encryptionkey@0"
I20260807 08:42:22.761713 23916 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 08:42:22.763948 23934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:22.765075 23916 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:42:22.765209 23916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "55a34663645a4670abe559251bcfc80e"
format_stamp: "Formatted at 2026-08-07 08:42:22 on dist-test-slave-6nmv"
server_key: "59f8f49b18692e796894a58794b546bd"
server_key_iv: "64a88a063e267f04b4f9a20d8f8c6aa1"
server_key_version: "encryptionkey@0"
I20260807 08:42:22.765306 23916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:22.791757 23916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:22.794495 23916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:22.794672 23916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:22.801285 23916 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:43987
I20260807 08:42:22.801311 23989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:43987 every 8 connection(s)
I20260807 08:42:22.802193 23916 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:42:22.804771 23990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:42:22.809369 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 23916
I20260807 08:42:22.809522 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:42:22.809864 9027 external_mini_cluster.cc:1428] Setting key 73d2deb13243045342be8fadbe9f6c97
I20260807 08:42:22.810521 23990 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e: Bootstrap starting.
I20260807 08:42:22.812899 23990 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e: Neither blocks nor log segments found. Creating new log.
I20260807 08:42:22.813624 23990 log.cc:824] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e: Log is configured to *not* fsync() on all Append() calls
I20260807 08:42:22.815510 23990 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e: No bootstrap required, opened a new log
Aug 07 08:42:22 dist-test-slave-6nmv krb5kdc[23901](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092142, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:42:22.819310 23990 raft_consensus.cc:348] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55a34663645a4670abe559251bcfc80e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43987 } }
I20260807 08:42:22.819515 23990 raft_consensus.cc:374] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:42:22.819582 23990 raft_consensus.cc:729] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a34663645a4670abe559251bcfc80e, State: Initialized, Role: FOLLOWER
I20260807 08:42:22.820050 23990 consensus_queue.cc:260] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55a34663645a4670abe559251bcfc80e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43987 } }
I20260807 08:42:22.820191 23990 raft_consensus.cc:388] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:42:22.820263 23990 raft_consensus.cc:482] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:42:22.820363 23990 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:42:22.821141 23990 raft_consensus.cc:504] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55a34663645a4670abe559251bcfc80e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43987 } }
I20260807 08:42:22.821458 23990 leader_election.cc:302] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 55a34663645a4670abe559251bcfc80e; no voters:
I20260807 08:42:22.821786 23990 leader_election.cc:288] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:42:22.821862 23996 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:42:22.822057 23996 raft_consensus.cc:686] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [term 1 LEADER]: Becoming Leader. State: Replica: 55a34663645a4670abe559251bcfc80e, State: Running, Role: LEADER
I20260807 08:42:22.822372 23996 consensus_queue.cc:237] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55a34663645a4670abe559251bcfc80e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43987 } }
I20260807 08:42:22.822994 23990 sys_catalog.cc:564] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:42:22.823861 23998 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 55a34663645a4670abe559251bcfc80e. Latest consensus state: current_term: 1 leader_uuid: "55a34663645a4670abe559251bcfc80e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55a34663645a4670abe559251bcfc80e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43987 } } }
I20260807 08:42:22.824004 23998 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [sys.catalog]: This master's current role is: LEADER
I20260807 08:42:22.824127 23994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:22.811227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45240 (local address 127.8.208.254:43987)
0807 08:42:22.811684 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:22.811698 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:22.811732 (+ 34us) server_negotiation.cc:407] Connection header received
0807 08:42:22.812365 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:22.812379 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:22.812695 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:22.813048 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:22.813844 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:22.815028 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:22.815893 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:22.816352 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:22.816529 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:22.819295 (+ 2766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:22.819301 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:22.819313 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:22.819337 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:22.821043 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:22.821521 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:22.821526 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:22.821530 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:22.821670 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:22.821983 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:22.821986 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:22.821987 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:22.822461 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:22.822672 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:22.822958 (+ 286us) server_negotiation.cc:299] Negotiation successful
0807 08:42:22.823243 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":152,"threads_started":1}
I20260807 08:42:22.824311 23997 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "55a34663645a4670abe559251bcfc80e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55a34663645a4670abe559251bcfc80e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43987 } } }
I20260807 08:42:22.824390 23997 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [sys.catalog]: This master's current role is: LEADER
W20260807 08:42:22.828305 24015 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:42:22.828393 24015 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:42:22.828452 24006 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:42:22.829321 24006 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:42:22.834604 24006 catalog_manager.cc:1347] Generated new cluster ID: 41b42360e7da4a81b0810779a3a35e65
I20260807 08:42:22.834666 24006 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:42:22.858893 24006 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:42:22.859859 24006 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:42:22.865847 24006 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e: Generated new TSK 0
I20260807 08:42:22.866473 24006 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.208.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
I20260807 08:42:22.897632 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:43987
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:42:22.999989 24020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:23.000216 24020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:23.000283 24020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:23.003788 24020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:23.003865 24020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:23.003963 24020 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:42:23.008636 24020 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:43987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24020
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:23.009501 24020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:23.010426 24020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:42:23.018847 24025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:23.018873 24028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:23.018926 24026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:23.018990 24020 server_base.cc:1034] running on GCE node
I20260807 08:42:23.019404 24020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:23.019953 24020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:23.021119 24020 hybrid_clock.cc:648] HybridClock initialized: now 1786092143021110 us; error 23 us; skew 500 ppm
Aug 07 08:42:23 dist-test-slave-6nmv krb5kdc[23901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092143, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:23.023870 24020 init.cc:377] Logged in from keytab as kudu/127.8.208.193@KRBTEST.COM (short username kudu)
I20260807 08:42:23.024646 24020 webserver.cc:460] Webserver started at http://127.8.208.193:44027/ using document root <none> and password file <none>
I20260807 08:42:23.025115 24020 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:23.025197 24020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:42:23.025393 24020 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:42:23.027238 24020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "954136526c744651881234fdba1585a3"
format_stamp: "Formatted at 2026-08-07 08:42:23 on dist-test-slave-6nmv"
server_key: "334b41b6f46ad46035898bd98616392f"
server_key_iv: "d9f789603e9407e3d0a9e4f8f1d6fee1"
server_key_version: "encryptionkey@0"
I20260807 08:42:23.027767 24020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "954136526c744651881234fdba1585a3"
format_stamp: "Formatted at 2026-08-07 08:42:23 on dist-test-slave-6nmv"
server_key: "334b41b6f46ad46035898bd98616392f"
server_key_iv: "d9f789603e9407e3d0a9e4f8f1d6fee1"
server_key_version: "encryptionkey@0"
I20260807 08:42:23.031111 24020 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 08:42:23.033288 24037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:23.034368 24020 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:42:23.034451 24020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "954136526c744651881234fdba1585a3"
format_stamp: "Formatted at 2026-08-07 08:42:23 on dist-test-slave-6nmv"
server_key: "334b41b6f46ad46035898bd98616392f"
server_key_iv: "d9f789603e9407e3d0a9e4f8f1d6fee1"
server_key_version: "encryptionkey@0"
I20260807 08:42:23.034520 24020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:23.051492 24020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:23.053992 24020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:23.054108 24020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:23.054503 24020 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:42:23.055119 24020 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:42:23.055158 24020 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:23.055189 24020 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:42:23.055202 24020 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:23.063766 24020 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:46495
I20260807 08:42:23.063792 24161 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:46495 every 8 connection(s)
I20260807 08:42:23.064528 24020 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
Aug 07 08:42:23 dist-test-slave-6nmv krb5kdc[23901](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092143, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:42:23.073341 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 24020
I20260807 08:42:23.073486 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
I20260807 08:42:23.073848 9027 external_mini_cluster.cc:1428] Setting key 19616b9cde40fe4a1fa3a1f3ac3c1305
I20260807 08:42:23.077170 23994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:23.066115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:56019 (local address 127.8.208.254:43987)
0807 08:42:23.066260 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:23.066264 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:23.066952 (+ 688us) server_negotiation.cc:407] Connection header received
0807 08:42:23.068071 (+ 1119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:23.068074 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:23.068122 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:23.068195 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:23.069270 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.069899 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.070915 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.071121 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.071195 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:23.073393 (+ 2198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:23.073396 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:23.073398 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:23.073420 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:23.075200 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:23.075746 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:23.075748 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:23.075749 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:23.075825 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:23.076191 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:23.076193 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:23.076194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:23.076352 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:23.076438 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:23.076965 (+ 527us) server_negotiation.cc:299] Negotiation successful
0807 08:42:23.077056 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 08:42:23.078088 24165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:23.066441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.193:56019)
0807 08:42:23.066819 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:23.066855 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:23.067893 (+ 1038us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:23.068382 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:23.068388 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:23.068766 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:23.069153 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:23.069164 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.070031 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.070034 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:23.070808 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:23.070817 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.071236 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.071238 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:23.071358 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:23.071824 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:23.071838 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:23.073238 (+ 1400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:23.075293 (+ 2055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:23.075319 (+ 26us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:23.075336 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:23.075653 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:23.075918 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:23.075923 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:23.075927 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:23.076099 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:23.076457 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:23.076465 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:23.076727 (+ 262us) client_negotiation.cc:769] Sending connection context
0807 08:42:23.076911 (+ 184us) client_negotiation.cc:240] Negotiation successful
0807 08:42:23.077251 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":101,"threads_started":1}
I20260807 08:42:23.079236 24162 heartbeater.cc:347] Connected to a master server at 127.8.208.254:43987
I20260807 08:42:23.079449 24162 heartbeater.cc:464] Registering TS with master...
I20260807 08:42:23.079936 24162 heartbeater.cc:511] Master 127.8.208.254:43987 requested a full tablet report, sending...
I20260807 08:42:23.081396 23952 ts_manager.cc:194] Registered new tserver with Master: 954136526c744651881234fdba1585a3 (127.8.208.193:46495)
I20260807 08:42:23.082571 23952 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.193@KRBTEST.COM'} at 127.8.208.193:56019
WARNING: no policy specified for kudu/127.8.208.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
I20260807 08:42:23.101298 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:43987
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:42:23.202085 24168 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:23.202303 24168 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:23.202339 24168 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:23.205803 24168 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:23.205868 24168 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:23.205968 24168 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:42:23.210424 24168 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:43987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24168
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:23.211239 24168 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:23.212131 24168 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 08:42:23.220566 24168 server_base.cc:1034] running on GCE node
W20260807 08:42:23.220537 24174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:23.220551 24173 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:23.220537 24176 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:23.221076 24168 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:23.221585 24168 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:23.222774 24168 hybrid_clock.cc:648] HybridClock initialized: now 1786092143222755 us; error 28 us; skew 500 ppm
Aug 07 08:42:23 dist-test-slave-6nmv krb5kdc[23901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092143, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:23.225440 24168 init.cc:377] Logged in from keytab as kudu/127.8.208.194@KRBTEST.COM (short username kudu)
I20260807 08:42:23.226207 24168 webserver.cc:460] Webserver started at http://127.8.208.194:32819/ using document root <none> and password file <none>
I20260807 08:42:23.226643 24168 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:23.226696 24168 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:42:23.226830 24168 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:42:23.228550 24168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "c2a31e674dce4db491ac84136d40f921"
format_stamp: "Formatted at 2026-08-07 08:42:23 on dist-test-slave-6nmv"
server_key: "ce9dc868771518f6c1956da320e141dc"
server_key_iv: "cf83a81e6dafb84fa31dc3e3b658879b"
server_key_version: "encryptionkey@0"
I20260807 08:42:23.229031 24168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "c2a31e674dce4db491ac84136d40f921"
format_stamp: "Formatted at 2026-08-07 08:42:23 on dist-test-slave-6nmv"
server_key: "ce9dc868771518f6c1956da320e141dc"
server_key_iv: "cf83a81e6dafb84fa31dc3e3b658879b"
server_key_version: "encryptionkey@0"
I20260807 08:42:23.232123 24168 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260807 08:42:23.234318 24184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:23.235374 24168 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:42:23.235502 24168 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "c2a31e674dce4db491ac84136d40f921"
format_stamp: "Formatted at 2026-08-07 08:42:23 on dist-test-slave-6nmv"
server_key: "ce9dc868771518f6c1956da320e141dc"
server_key_iv: "cf83a81e6dafb84fa31dc3e3b658879b"
server_key_version: "encryptionkey@0"
I20260807 08:42:23.235599 24168 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:23.247153 24168 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:23.250173 24168 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:23.250346 24168 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:23.250828 24168 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:42:23.251511 24168 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:42:23.251554 24168 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:23.251618 24168 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:42:23.251667 24168 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:23.260462 24168 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:39983
I20260807 08:42:23.260489 24312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:39983 every 8 connection(s)
I20260807 08:42:23.261227 24168 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:42:23.266505 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 24168
I20260807 08:42:23.266650 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:42:23.266909 9027 external_mini_cluster.cc:1428] Setting key e4b7e2425d3f32dcebbf47890acb6bf6
Aug 07 08:42:23 dist-test-slave-6nmv krb5kdc[23901](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092143, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:42:23.274705 23994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:23.262851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:38727 (local address 127.8.208.254:43987)
0807 08:42:23.262983 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:23.262987 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:23.263659 (+ 672us) server_negotiation.cc:407] Connection header received
0807 08:42:23.264814 (+ 1155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:23.264818 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:23.264873 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:23.264957 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:23.265980 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.266470 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.267753 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.267986 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.268112 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:23.270827 (+ 2715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:23.270834 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:23.270837 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:23.270871 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:23.272478 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:23.272978 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:23.272985 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:23.272989 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:23.273092 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:23.273485 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:23.273490 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:23.273494 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:23.273717 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:23.273836 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:23.274303 (+ 467us) server_negotiation.cc:299] Negotiation successful
0807 08:42:23.274460 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 08:42:23.275188 24315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:23.263142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.194:38727)
0807 08:42:23.263523 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:23.263560 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:23.264621 (+ 1061us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:23.265111 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:23.265117 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:23.265419 (+ 302us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:23.265837 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:23.265849 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.266591 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.266595 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:23.267639 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:23.267651 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.268155 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.268160 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:23.268332 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:23.268918 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:23.268932 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:23.270664 (+ 1732us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:23.272597 (+ 1933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:23.272602 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:23.272612 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:23.272854 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:23.273202 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:23.273203 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:23.273205 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:23.273377 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:23.273857 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:23.273866 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:23.274073 (+ 207us) client_negotiation.cc:769] Sending connection context
0807 08:42:23.274215 (+ 142us) client_negotiation.cc:240] Negotiation successful
0807 08:42:23.274444 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":107,"threads_started":1}
I20260807 08:42:23.276182 24313 heartbeater.cc:347] Connected to a master server at 127.8.208.254:43987
I20260807 08:42:23.276408 24313 heartbeater.cc:464] Registering TS with master...
I20260807 08:42:23.276823 24313 heartbeater.cc:511] Master 127.8.208.254:43987 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.8.208.195@KRBTEST.COM; defaulting to no policy
I20260807 08:42:23.277801 23952 ts_manager.cc:194] Registered new tserver with Master: c2a31e674dce4db491ac84136d40f921 (127.8.208.194:39983)
I20260807 08:42:23.278427 23952 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.194@KRBTEST.COM'} at 127.8.208.194:38727
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
I20260807 08:42:23.292853 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:43987
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:42:23.398993 24318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:23.399215 24318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:23.399276 24318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:23.402967 24318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:23.403033 24318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:23.403105 24318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:42:23.407843 24318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:43987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:23.408757 24318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:23.409612 24318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:42:23.418169 24323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:23.418192 24324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:23.418289 24318 server_base.cc:1034] running on GCE node
W20260807 08:42:23.418493 24326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:23.418869 24318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:23.419443 24318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:23.420634 24318 hybrid_clock.cc:648] HybridClock initialized: now 1786092143420627 us; error 27 us; skew 500 ppm
Aug 07 08:42:23 dist-test-slave-6nmv krb5kdc[23901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092143, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:23.423230 24318 init.cc:377] Logged in from keytab as kudu/127.8.208.195@KRBTEST.COM (short username kudu)
I20260807 08:42:23.423993 24318 webserver.cc:460] Webserver started at http://127.8.208.195:43717/ using document root <none> and password file <none>
I20260807 08:42:23.424566 24318 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:23.424649 24318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:42:23.424844 24318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:42:23.426702 24318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "a0a0fd2e062449acaf7aa542562ae69e"
format_stamp: "Formatted at 2026-08-07 08:42:23 on dist-test-slave-6nmv"
server_key: "4de81390c4c6b911d3e9ccbaa9ae84e9"
server_key_iv: "5570df81d71abdb449e7c47c97064de7"
server_key_version: "encryptionkey@0"
I20260807 08:42:23.427214 24318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "a0a0fd2e062449acaf7aa542562ae69e"
format_stamp: "Formatted at 2026-08-07 08:42:23 on dist-test-slave-6nmv"
server_key: "4de81390c4c6b911d3e9ccbaa9ae84e9"
server_key_iv: "5570df81d71abdb449e7c47c97064de7"
server_key_version: "encryptionkey@0"
I20260807 08:42:23.430574 24318 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 08:42:23.432829 24333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:23.434041 24318 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:42:23.434163 24318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "a0a0fd2e062449acaf7aa542562ae69e"
format_stamp: "Formatted at 2026-08-07 08:42:23 on dist-test-slave-6nmv"
server_key: "4de81390c4c6b911d3e9ccbaa9ae84e9"
server_key_iv: "5570df81d71abdb449e7c47c97064de7"
server_key_version: "encryptionkey@0"
I20260807 08:42:23.434258 24318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:23.452190 24318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:23.455065 24318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:23.455260 24318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:23.455768 24318 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:42:23.456502 24318 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:42:23.456568 24318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:23.456629 24318 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:42:23.456673 24318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:23.465351 24318 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:40293
I20260807 08:42:23.465387 24460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:40293 every 8 connection(s)
I20260807 08:42:23.466199 24318 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:42:23.468223 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 24318
I20260807 08:42:23.468354 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:42:23.468781 9027 external_mini_cluster.cc:1428] Setting key 67c239baeeec933bf9c3e6908384aec3
Aug 07 08:42:23 dist-test-slave-6nmv krb5kdc[23901](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092143, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:42:23.479318 23994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:23.468001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:47357 (local address 127.8.208.254:43987)
0807 08:42:23.468141 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:23.468145 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:23.469206 (+ 1061us) server_negotiation.cc:407] Connection header received
0807 08:42:23.470828 (+ 1622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:23.470831 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:23.470886 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:23.470952 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:23.471983 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.472509 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.473552 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.473759 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.473887 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:23.476084 (+ 2197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:23.476087 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:23.476090 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:23.476112 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:23.477279 (+ 1167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:23.477829 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:23.477835 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:23.477840 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:23.477928 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:23.478258 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:23.478263 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:23.478265 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:23.478451 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:23.478560 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:23.479033 (+ 473us) server_negotiation.cc:299] Negotiation successful
0807 08:42:23.479153 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 08:42:23.479992 24463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:23.468463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.195:47357)
0807 08:42:23.469015 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:23.469067 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:23.470636 (+ 1569us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:23.471107 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:23.471113 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:23.471424 (+ 311us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:23.471842 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:23.471854 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.472631 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.472634 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:23.473437 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:23.473446 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.473918 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.473922 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:23.474093 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:23.474565 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:23.474578 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:23.475924 (+ 1346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:23.477413 (+ 1489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:23.477417 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:23.477429 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:23.477701 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:23.478023 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:23.478027 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:23.478029 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:23.478160 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:23.478559 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:23.478565 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:23.478789 (+ 224us) client_negotiation.cc:769] Sending connection context
0807 08:42:23.478986 (+ 197us) client_negotiation.cc:240] Negotiation successful
0807 08:42:23.479277 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":173,"threads_started":1}
I20260807 08:42:23.480944 24461 heartbeater.cc:347] Connected to a master server at 127.8.208.254:43987
I20260807 08:42:23.481156 24461 heartbeater.cc:464] Registering TS with master...
I20260807 08:42:23.481643 24461 heartbeater.cc:511] Master 127.8.208.254:43987 requested a full tablet report, sending...
I20260807 08:42:23.482689 23952 ts_manager.cc:194] Registered new tserver with Master: a0a0fd2e062449acaf7aa542562ae69e (127.8.208.195:40293)
I20260807 08:42:23.483215 23952 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.195@KRBTEST.COM'} at 127.8.208.195:47357
I20260807 08:42:23.494180 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 08:42:23.502714 23994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:23.495997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45244 (local address 127.8.208.254:43987)
0807 08:42:23.496129 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:23.496133 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:23.496288 (+ 155us) server_negotiation.cc:407] Connection header received
0807 08:42:23.496422 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:23.496425 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:23.496473 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:23.496550 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:23.497197 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.497701 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.498533 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.498757 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.498858 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:23.500000 (+ 1142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:23.500004 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:23.500006 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:23.500034 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:23.501070 (+ 1036us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:23.501487 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:23.501490 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:23.501491 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:23.501554 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:23.501849 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:23.501852 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:23.501853 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:23.502045 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:23.502216 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:23.502446 (+ 230us) server_negotiation.cc:299] Negotiation successful
0807 08:42:23.502565 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 08:42:23.505214 23952 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45244:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 08:42:23.508073 23952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:42:23.520922 24473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:23.515588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:40293 (local address 127.0.0.1:49218)
0807 08:42:23.516173 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:23.516217 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:23.516334 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:23.517019 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:23.517024 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:23.517045 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:42:23.517169 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:23.517176 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.518397 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.518403 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:23.519427 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:23.519436 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.520453 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.520455 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:23.520551 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:23.520585 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 08:42:23.520682 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 08:42:23.520782 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":61,"threads_started":1}
I20260807 08:42:23.520937 24476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:23.515710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49218 (local address 127.8.208.195:40293)
0807 08:42:23.516049 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:23.516058 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:23.516477 (+ 419us) server_negotiation.cc:407] Connection header received
0807 08:42:23.516553 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:23.516557 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:23.516743 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:23.516902 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:42:23.517344 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.518280 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.519586 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.520329 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.520435 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:23.520564 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:23.520719 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 08:42:23.520803 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":144,"threads_started":1}
I20260807 08:42:23.521651 24477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:23.515664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:39983 (local address 127.0.0.1:44114)
0807 08:42:23.516488 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:23.516501 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:23.516569 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:23.517275 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:23.517279 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:23.517298 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:42:23.517395 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:23.517402 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.519052 (+ 1650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.519074 (+ 22us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:23.520134 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:23.520144 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.521218 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.521224 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:23.521330 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:23.521350 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 08:42:23.521454 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 08:42:23.521529 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":771,"thread_start_us":90,"threads_started":1}
I20260807 08:42:23.521713 24478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:23.516331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44114 (local address 127.8.208.194:39983)
0807 08:42:23.516802 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:23.516815 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:23.516837 (+ 22us) server_negotiation.cc:407] Connection header received
0807 08:42:23.516926 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:23.516949 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:23.517126 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:23.517549 (+ 423us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:42:23.517710 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.518907 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.520260 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.521103 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.521198 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:23.521349 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:23.521484 (+ 135us) server_negotiation.cc:299] Negotiation successful
0807 08:42:23.521580 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":121,"threads_started":1}
I20260807 08:42:23.522254 24479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:23.516407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42220 (local address 127.8.208.193:46495)
0807 08:42:23.516796 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:23.516808 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:23.517354 (+ 546us) server_negotiation.cc:407] Connection header received
0807 08:42:23.517446 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:23.517451 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:23.517649 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:23.517800 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:42:23.518089 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.519143 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.520419 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.521182 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.521296 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:23.521467 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:23.522020 (+ 553us) server_negotiation.cc:299] Negotiation successful
0807 08:42:23.522100 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":108,"threads_started":1}
I20260807 08:42:23.522513 24475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:23.516230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:46495 (local address 127.0.0.1:42220)
0807 08:42:23.517164 (+ 934us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:23.517181 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:23.517264 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:23.517798 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:23.517801 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:23.517854 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:42:23.517954 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:23.517961 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.519275 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.519279 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:23.520299 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:23.520310 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.521525 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.521529 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:23.521609 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:23.521630 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 08:42:23.521702 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 08:42:23.521785 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":869,"thread_start_us":78,"threads_started":1}
I20260807 08:42:23.524257 24389 tablet_service.cc:1467] Processing CreateTablet for tablet 732556221ac74593a0e1fe6137aaa856 (DEFAULT_TABLE table=test-table [id=766cbfcd67964a9a925c2bc4585ad9f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:42:23.524525 24240 tablet_service.cc:1467] Processing CreateTablet for tablet 732556221ac74593a0e1fe6137aaa856 (DEFAULT_TABLE table=test-table [id=766cbfcd67964a9a925c2bc4585ad9f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:42:23.525377 24389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 732556221ac74593a0e1fe6137aaa856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:42:23.525496 24240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 732556221ac74593a0e1fe6137aaa856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:42:23.525257 24092 tablet_service.cc:1467] Processing CreateTablet for tablet 732556221ac74593a0e1fe6137aaa856 (DEFAULT_TABLE table=test-table [id=766cbfcd67964a9a925c2bc4585ad9f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:42:23.526170 24092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 732556221ac74593a0e1fe6137aaa856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:42:23.531879 24480 tablet_bootstrap.cc:492] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e: Bootstrap starting.
I20260807 08:42:23.533124 24482 tablet_bootstrap.cc:492] T 732556221ac74593a0e1fe6137aaa856 P c2a31e674dce4db491ac84136d40f921: Bootstrap starting.
I20260807 08:42:23.534104 24481 tablet_bootstrap.cc:492] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3: Bootstrap starting.
I20260807 08:42:23.534449 24480 tablet_bootstrap.cc:654] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e: Neither blocks nor log segments found. Creating new log.
I20260807 08:42:23.535096 24480 log.cc:824] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e: Log is configured to *not* fsync() on all Append() calls
I20260807 08:42:23.535344 24482 tablet_bootstrap.cc:654] T 732556221ac74593a0e1fe6137aaa856 P c2a31e674dce4db491ac84136d40f921: Neither blocks nor log segments found. Creating new log.
I20260807 08:42:23.536063 24481 tablet_bootstrap.cc:654] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3: Neither blocks nor log segments found. Creating new log.
I20260807 08:42:23.536141 24482 log.cc:824] T 732556221ac74593a0e1fe6137aaa856 P c2a31e674dce4db491ac84136d40f921: Log is configured to *not* fsync() on all Append() calls
I20260807 08:42:23.537081 24480 tablet_bootstrap.cc:492] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e: No bootstrap required, opened a new log
I20260807 08:42:23.537207 24481 log.cc:824] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3: Log is configured to *not* fsync() on all Append() calls
I20260807 08:42:23.537283 24480 ts_tablet_manager.cc:1397] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 08:42:23.538379 24482 tablet_bootstrap.cc:492] T 732556221ac74593a0e1fe6137aaa856 P c2a31e674dce4db491ac84136d40f921: No bootstrap required, opened a new log
I20260807 08:42:23.538558 24482 ts_tablet_manager.cc:1397] T 732556221ac74593a0e1fe6137aaa856 P c2a31e674dce4db491ac84136d40f921: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 08:42:23.539177 24481 tablet_bootstrap.cc:492] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3: No bootstrap required, opened a new log
I20260807 08:42:23.539350 24481 ts_tablet_manager.cc:1397] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 08:42:23.540721 24480 raft_consensus.cc:348] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:23.540958 24480 raft_consensus.cc:374] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:42:23.541043 24480 raft_consensus.cc:729] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0a0fd2e062449acaf7aa542562ae69e, State: Initialized, Role: FOLLOWER
I20260807 08:42:23.541424 24480 consensus_queue.cc:260] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:23.542083 24461 heartbeater.cc:503] Master 127.8.208.254:43987 was elected leader, sending a full tablet report...
I20260807 08:42:23.542359 24480 ts_tablet_manager.cc:1428] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260807 08:42:23.542806 24482 raft_consensus.cc:348] T 732556221ac74593a0e1fe6137aaa856 P c2a31e674dce4db491ac84136d40f921 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:23.543088 24482 raft_consensus.cc:374] T 732556221ac74593a0e1fe6137aaa856 P c2a31e674dce4db491ac84136d40f921 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:42:23.542986 24481 raft_consensus.cc:348] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:23.543154 24482 raft_consensus.cc:729] T 732556221ac74593a0e1fe6137aaa856 P c2a31e674dce4db491ac84136d40f921 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2a31e674dce4db491ac84136d40f921, State: Initialized, Role: FOLLOWER
I20260807 08:42:23.543212 24481 raft_consensus.cc:374] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:42:23.543313 24481 raft_consensus.cc:729] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 954136526c744651881234fdba1585a3, State: Initialized, Role: FOLLOWER
I20260807 08:42:23.543553 24482 consensus_queue.cc:260] T 732556221ac74593a0e1fe6137aaa856 P c2a31e674dce4db491ac84136d40f921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:23.543715 24481 consensus_queue.cc:260] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:23.544127 24313 heartbeater.cc:503] Master 127.8.208.254:43987 was elected leader, sending a full tablet report...
I20260807 08:42:23.544389 24482 ts_tablet_manager.cc:1428] T 732556221ac74593a0e1fe6137aaa856 P c2a31e674dce4db491ac84136d40f921: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 08:42:23.544546 24481 ts_tablet_manager.cc:1428] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 08:42:23.544811 24162 heartbeater.cc:503] Master 127.8.208.254:43987 was elected leader, sending a full tablet report...
I20260807 08:42:23.550408 24486 raft_consensus.cc:482] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:42:23.550531 24486 raft_consensus.cc:504] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:23.551415 24486 leader_election.cc:288] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2a31e674dce4db491ac84136d40f921 (127.8.208.194:39983), 954136526c744651881234fdba1585a3 (127.8.208.193:46495)
I20260807 08:42:23.554971 24478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:23.551681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:47899 (local address 127.8.208.194:39983)
0807 08:42:23.551847 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:23.551851 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:23.551863 (+ 12us) server_negotiation.cc:407] Connection header received
0807 08:42:23.552020 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:23.552024 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:23.552071 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:23.552153 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:42:23.552411 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.553000 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.554120 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.554483 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.554597 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:23.554644 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:23.554802 (+ 158us) server_negotiation.cc:299] Negotiation successful
0807 08:42:23.554864 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260807 08:42:23.554971 24463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:23.551589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:39983 (local address 127.8.208.195:47899)
0807 08:42:23.551804 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:23.551819 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:23.551908 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:23.552163 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:23.552166 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:23.552182 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:42:23.552299 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:23.552304 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.553107 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.553110 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:23.554012 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:23.554021 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.554590 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.554593 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:23.554686 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:23.554705 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 08:42:23.554789 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 08:42:23.554855 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140}
I20260807 08:42:23.555100 24479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:23.551716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:59917 (local address 127.8.208.193:46495)
0807 08:42:23.551824 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:23.551829 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:23.552089 (+ 260us) server_negotiation.cc:407] Connection header received
0807 08:42:23.552226 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:23.552228 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:23.552272 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:23.552352 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:42:23.552592 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.553222 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.554257 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.554607 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.554721 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:23.554767 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:23.554947 (+ 180us) server_negotiation.cc:299] Negotiation successful
0807 08:42:23.555005 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 08:42:23.555122 24489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:23.551639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:46495 (local address 127.8.208.195:59917)
0807 08:42:23.552004 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:23.552014 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:23.552127 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:23.552359 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:23.552362 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:23.552376 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:42:23.552494 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:23.552499 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.553322 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.553325 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:23.554132 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:23.554141 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.554717 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.554721 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:23.554831 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:23.554848 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 08:42:23.554932 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 08:42:23.554995 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"mutex_wait_us":1,"thread_start_us":100,"threads_started":1}
I20260807 08:42:23.555610 24264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "732556221ac74593a0e1fe6137aaa856" candidate_uuid: "a0a0fd2e062449acaf7aa542562ae69e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2a31e674dce4db491ac84136d40f921" is_pre_election: true
I20260807 08:42:23.555646 24112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "732556221ac74593a0e1fe6137aaa856" candidate_uuid: "a0a0fd2e062449acaf7aa542562ae69e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "954136526c744651881234fdba1585a3" is_pre_election: true
I20260807 08:42:23.555897 24112 raft_consensus.cc:2454] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0a0fd2e062449acaf7aa542562ae69e in term 0.
I20260807 08:42:23.555887 24264 raft_consensus.cc:2454] T 732556221ac74593a0e1fe6137aaa856 P c2a31e674dce4db491ac84136d40f921 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0a0fd2e062449acaf7aa542562ae69e in term 0.
I20260807 08:42:23.556305 24335 leader_election.cc:302] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 954136526c744651881234fdba1585a3, a0a0fd2e062449acaf7aa542562ae69e, c2a31e674dce4db491ac84136d40f921; no voters:
I20260807 08:42:23.556547 24486 raft_consensus.cc:2781] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:42:23.556631 24486 raft_consensus.cc:482] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:42:23.556689 24486 raft_consensus.cc:3037] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:42:23.557617 24486 raft_consensus.cc:504] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:23.558041 24486 leader_election.cc:288] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e [CANDIDATE]: Term 1 election: Requested vote from peers c2a31e674dce4db491ac84136d40f921 (127.8.208.194:39983), 954136526c744651881234fdba1585a3 (127.8.208.193:46495)
I20260807 08:42:23.558354 24264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "732556221ac74593a0e1fe6137aaa856" candidate_uuid: "a0a0fd2e062449acaf7aa542562ae69e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2a31e674dce4db491ac84136d40f921"
I20260807 08:42:23.558382 24112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "732556221ac74593a0e1fe6137aaa856" candidate_uuid: "a0a0fd2e062449acaf7aa542562ae69e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "954136526c744651881234fdba1585a3"
I20260807 08:42:23.558485 24112 raft_consensus.cc:3037] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:42:23.558485 24264 raft_consensus.cc:3037] T 732556221ac74593a0e1fe6137aaa856 P c2a31e674dce4db491ac84136d40f921 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:42:23.559624 24112 raft_consensus.cc:2454] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0a0fd2e062449acaf7aa542562ae69e in term 1.
I20260807 08:42:23.559624 24264 raft_consensus.cc:2454] T 732556221ac74593a0e1fe6137aaa856 P c2a31e674dce4db491ac84136d40f921 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0a0fd2e062449acaf7aa542562ae69e in term 1.
I20260807 08:42:23.559893 24335 leader_election.cc:302] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 954136526c744651881234fdba1585a3, a0a0fd2e062449acaf7aa542562ae69e; no voters:
I20260807 08:42:23.560111 24486 raft_consensus.cc:2781] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:42:23.560263 24486 raft_consensus.cc:686] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e [term 1 LEADER]: Becoming Leader. State: Replica: a0a0fd2e062449acaf7aa542562ae69e, State: Running, Role: LEADER
I20260807 08:42:23.560529 24486 consensus_queue.cc:237] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:23.563426 23952 catalog_manager.cc:5495] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e reported cstate change: term changed from 0 to 1, leader changed from <none> to a0a0fd2e062449acaf7aa542562ae69e (127.8.208.195). New cstate: current_term: 1 leader_uuid: "a0a0fd2e062449acaf7aa542562ae69e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } health_report { overall_health: UNKNOWN } } }
W20260807 08:42:23.565572 24163 tablet.cc:2369] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 08:42:23.583046 24476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:23.580307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49222 (local address 127.8.208.195:40293)
0807 08:42:23.580420 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:23.580423 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:23.580434 (+ 11us) server_negotiation.cc:407] Connection header received
0807 08:42:23.580534 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:23.580536 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:23.580576 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:23.580648 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:42:23.580859 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.581286 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.582033 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:23.582204 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:23.582271 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:23.582479 (+ 208us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:42:23.582787 (+ 308us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:42:23.582861 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:23.582915 (+ 54us) server_negotiation.cc:299] Negotiation successful
0807 08:42:23.582953 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 08:42:23.587808 24112 raft_consensus.cc:1261] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Refusing update from remote peer a0a0fd2e062449acaf7aa542562ae69e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:42:23.587821 24264 raft_consensus.cc:1261] T 732556221ac74593a0e1fe6137aaa856 P c2a31e674dce4db491ac84136d40f921 [term 1 FOLLOWER]: Refusing update from remote peer a0a0fd2e062449acaf7aa542562ae69e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:42:23.588474 24490 consensus_queue.cc:1035] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:42:23.588639 24486 consensus_queue.cc:1035] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e [LEADER]: Connected to new peer: Peer: permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:42:23.595718 24495 mvcc.cc:205] Tried to move back new op lower bound from 7315833420130267136 to 7315833420026388480. Current Snapshot: MvccSnapshot[applied={T|T < 7315833420130267136}]
I20260807 08:42:23.595757 24494 mvcc.cc:205] Tried to move back new op lower bound from 7315833420130267136 to 7315833420026388480. Current Snapshot: MvccSnapshot[applied={T|T < 7315833420130267136}]
I20260807 08:42:23.602723 23952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45244:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:42:23.602840 23952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45244:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:42:23.604843 23952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e: Sending DeleteTablet for 3 replicas of tablet 732556221ac74593a0e1fe6137aaa856
I20260807 08:42:23.605541 24092 tablet_service.cc:1514] Processing DeleteTablet for tablet 732556221ac74593a0e1fe6137aaa856 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:42:23 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:42220
I20260807 08:42:23.605525 24240 tablet_service.cc:1514] Processing DeleteTablet for tablet 732556221ac74593a0e1fe6137aaa856 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:42:23 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:44114
I20260807 08:42:23.605993 24506 tablet_replica.cc:330] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3: stopping tablet replica
I20260807 08:42:23.605995 24389 tablet_service.cc:1514] Processing DeleteTablet for tablet 732556221ac74593a0e1fe6137aaa856 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:42:23 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:49218
I20260807 08:42:23.606262 24506 raft_consensus.cc:2229] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:42:23.606388 24508 tablet_replica.cc:330] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e: stopping tablet replica
I20260807 08:42:23.606503 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 24020
I20260807 08:42:23.606562 24506 raft_consensus.cc:2258] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:42:23.606699 24508 raft_consensus.cc:2229] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e [term 1 LEADER]: Raft consensus shutting down.
I20260807 08:42:23.607422 24508 raft_consensus.cc:2258] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:42:23.609272 24508 ts_tablet_manager.cc:1905] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:42:23.613034 24508 ts_tablet_manager.cc:1918] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:42:23.613127 24508 log.cc:1196] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/732556221ac74593a0e1fe6137aaa856
I20260807 08:42:23.613445 24508 ts_tablet_manager.cc:1939] T 732556221ac74593a0e1fe6137aaa856 P a0a0fd2e062449acaf7aa542562ae69e: Deleting consensus metadata
I20260807 08:42:23.614004 24507 tablet_replica.cc:330] T 732556221ac74593a0e1fe6137aaa856 P c2a31e674dce4db491ac84136d40f921: stopping tablet replica
I20260807 08:42:23.614318 24507 raft_consensus.cc:2229] T 732556221ac74593a0e1fe6137aaa856 P c2a31e674dce4db491ac84136d40f921 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:42:23.614565 23936 catalog_manager.cc:4841] TS a0a0fd2e062449acaf7aa542562ae69e (127.8.208.195:40293): tablet 732556221ac74593a0e1fe6137aaa856 (table test-table [id=766cbfcd67964a9a925c2bc4585ad9f8]) successfully deleted
I20260807 08:42:23.614658 24507 raft_consensus.cc:2258] T 732556221ac74593a0e1fe6137aaa856 P c2a31e674dce4db491ac84136d40f921 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:42:23.615801 24507 ts_tablet_manager.cc:1905] T 732556221ac74593a0e1fe6137aaa856 P c2a31e674dce4db491ac84136d40f921: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:42:23.618006 24507 ts_tablet_manager.cc:1918] T 732556221ac74593a0e1fe6137aaa856 P c2a31e674dce4db491ac84136d40f921: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:42:23.618119 24507 log.cc:1196] T 732556221ac74593a0e1fe6137aaa856 P c2a31e674dce4db491ac84136d40f921: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/wal/wals/732556221ac74593a0e1fe6137aaa856
I20260807 08:42:23.618453 24507 ts_tablet_manager.cc:1939] T 732556221ac74593a0e1fe6137aaa856 P c2a31e674dce4db491ac84136d40f921: Deleting consensus metadata
I20260807 08:42:23.619390 23937 catalog_manager.cc:4841] TS c2a31e674dce4db491ac84136d40f921 (127.8.208.194:39983): tablet 732556221ac74593a0e1fe6137aaa856 (table test-table [id=766cbfcd67964a9a925c2bc4585ad9f8]) successfully deleted
W20260807 08:42:23.619501 23936 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.208.193:46495 (error 108)
I20260807 08:42:23.619756 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 24168
I20260807 08:42:23.620682 24475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:23.620153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:46495 (local address 127.0.0.1:42226)
0807 08:42:23.620513 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:23.620580 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.193:46495: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":276}
W20260807 08:42:23.620870 23936 catalog_manager.cc:4584] TS 954136526c744651881234fdba1585a3 (127.8.208.193:46495): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 732556221ac74593a0e1fe6137aaa856: Network error: Client connection negotiation failed: client connection to 127.8.208.193:46495: connect: Connection refused (error 111)
I20260807 08:42:23.627588 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 24318
I20260807 08:42:23.635380 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 23916
I20260807 08:42:23.642006 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:43987
--webserver_interface=127.8.208.254
--webserver_port=41363
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:43987
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:42:23.744153 24510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:23.744364 24510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:23.744405 24510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:23.748227 24510 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:42:23.748274 24510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:23.748293 24510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:23.748309 24510 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:42:23.748359 24510 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:42:23.753127 24510 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:43987
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:43987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=41363
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24510
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:23.754115 24510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:23.755033 24510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:42:23.767443 24518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:23.767653 24510 server_base.cc:1034] running on GCE node
W20260807 08:42:23.767531 24517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:23.767824 24520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:23.768402 24510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:23.769433 24510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:23.770619 24510 hybrid_clock.cc:648] HybridClock initialized: now 1786092143770598 us; error 40 us; skew 500 ppm
Aug 07 08:42:23 dist-test-slave-6nmv krb5kdc[23901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092143, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:23.773222 24510 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:42:23.774115 24510 webserver.cc:460] Webserver started at http://127.8.208.254:41363/ using document root <none> and password file <none>
I20260807 08:42:23.774632 24510 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:23.774729 24510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:42:23.778319 24510 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:42:23.780323 24528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:23.781352 24510 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:42:23.781482 24510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "55a34663645a4670abe559251bcfc80e"
format_stamp: "Formatted at 2026-08-07 08:42:22 on dist-test-slave-6nmv"
server_key: "59f8f49b18692e796894a58794b546bd"
server_key_iv: "64a88a063e267f04b4f9a20d8f8c6aa1"
server_key_version: "encryptionkey@0"
I20260807 08:42:23.782064 24510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:23.809000 24510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:23.812000 24510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:23.812207 24510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:23.819335 24510 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:43987
I20260807 08:42:23.819628 24586 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:43987 every 8 connection(s)
I20260807 08:42:23.820370 24510 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:42:23.824518 24587 sys_catalog.cc:263] Verifying existing consensus state
I20260807 08:42:23.826202 24587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e: Bootstrap starting.
I20260807 08:42:23.827710 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 24510
I20260807 08:42:23.828208 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:46495
--local_ip_for_outbound_sockets=127.8.208.193
--tserver_master_addrs=127.8.208.254:43987
--webserver_port=44027
--webserver_interface=127.8.208.193
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 08:42:23.844269 24587 log.cc:824] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e: Log is configured to *not* fsync() on all Append() calls
I20260807 08:42:23.852658 24587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 08:42:23.853034 24587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e: Bootstrap complete.
I20260807 08:42:23.856770 24587 raft_consensus.cc:348] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55a34663645a4670abe559251bcfc80e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43987 } }
I20260807 08:42:23.857128 24587 raft_consensus.cc:729] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a34663645a4670abe559251bcfc80e, State: Initialized, Role: FOLLOWER
I20260807 08:42:23.857599 24587 consensus_queue.cc:260] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55a34663645a4670abe559251bcfc80e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43987 } }
I20260807 08:42:23.857708 24587 raft_consensus.cc:388] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:42:23.857801 24587 raft_consensus.cc:482] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:42:23.857942 24587 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [term 1 FOLLOWER]: Advancing to term 2
I20260807 08:42:23.859802 24587 raft_consensus.cc:504] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55a34663645a4670abe559251bcfc80e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43987 } }
I20260807 08:42:23.860113 24587 leader_election.cc:302] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 55a34663645a4670abe559251bcfc80e; no voters:
I20260807 08:42:23.860417 24587 leader_election.cc:288] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 08:42:23.860502 24593 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [term 2 FOLLOWER]: Leader election won for term 2
I20260807 08:42:23.860682 24593 raft_consensus.cc:686] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [term 2 LEADER]: Becoming Leader. State: Replica: 55a34663645a4670abe559251bcfc80e, State: Running, Role: LEADER
I20260807 08:42:23.860996 24593 consensus_queue.cc:237] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55a34663645a4670abe559251bcfc80e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43987 } }
I20260807 08:42:23.861577 24587 sys_catalog.cc:564] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:42:23.861963 24593 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 55a34663645a4670abe559251bcfc80e. Latest consensus state: current_term: 2 leader_uuid: "55a34663645a4670abe559251bcfc80e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55a34663645a4670abe559251bcfc80e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43987 } } }
I20260807 08:42:23.862164 24593 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [sys.catalog]: This master's current role is: LEADER
I20260807 08:42:23.862360 24594 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "55a34663645a4670abe559251bcfc80e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55a34663645a4670abe559251bcfc80e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43987 } } }
I20260807 08:42:23.862537 24594 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [sys.catalog]: This master's current role is: LEADER
I20260807 08:42:23.862731 24598 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:42:23.867328 24598 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:42:23.868019 24598 catalog_manager.cc:1259] Loaded cluster ID: 41b42360e7da4a81b0810779a3a35e65
I20260807 08:42:23.868084 24598 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:42:23.869443 24598 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260807 08:42:23.874169 24598 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260807 08:42:23.878986 24598 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:42:23.879616 24598 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e: Loaded TSK: 0
I20260807 08:42:23.880661 24598 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 08:42:23.937104 24590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:23.937351 24590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:23.937433 24590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:23.941021 24590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:23.941095 24590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:23.941172 24590 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:42:23.945603 24590 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:46495
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=44027
--tserver_master_addrs=127.8.208.254:43987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:23.946496 24590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:23.947402 24590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 08:42:23.957376 24590 server_base.cc:1034] running on GCE node
W20260807 08:42:23.957300 24618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:23.957297 24619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:23.957593 24621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:23.958019 24590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:23.958644 24590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:23.959860 24590 hybrid_clock.cc:648] HybridClock initialized: now 1786092143959837 us; error 40 us; skew 500 ppm
Aug 07 08:42:23 dist-test-slave-6nmv krb5kdc[23901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092143, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:23.962507 24590 init.cc:377] Logged in from keytab as kudu/127.8.208.193@KRBTEST.COM (short username kudu)
I20260807 08:42:23.963436 24590 webserver.cc:460] Webserver started at http://127.8.208.193:44027/ using document root <none> and password file <none>
I20260807 08:42:23.963972 24590 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:23.964071 24590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:42:23.967648 24590 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:42:23.969718 24628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:23.970872 24590 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:42:23.971002 24590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "954136526c744651881234fdba1585a3"
format_stamp: "Formatted at 2026-08-07 08:42:23 on dist-test-slave-6nmv"
server_key: "334b41b6f46ad46035898bd98616392f"
server_key_iv: "d9f789603e9407e3d0a9e4f8f1d6fee1"
server_key_version: "encryptionkey@0"
I20260807 08:42:23.971474 24590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:23.987042 24590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:23.990134 24590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:23.990316 24590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:23.990859 24590 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:42:23.991966 24635 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 08:42:23.995996 24590 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 08:42:23.996049 24590 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.001s sys 0.000s
I20260807 08:42:23.996090 24590 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 08:42:23.997586 24590 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 08:42:23.997642 24590 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260807 08:42:23.997913 24635 tablet_bootstrap.cc:492] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3: Bootstrap starting.
I20260807 08:42:24.008232 24590 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:46495
I20260807 08:42:24.008316 24753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:46495 every 8 connection(s)
I20260807 08:42:24.009428 24590 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:42:24.015161 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 24590
I20260807 08:42:24.015581 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:39983
--local_ip_for_outbound_sockets=127.8.208.194
--tserver_master_addrs=127.8.208.254:43987
--webserver_port=32819
--webserver_interface=127.8.208.194
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 08:42:24.017346 24635 log.cc:824] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3: Log is configured to *not* fsync() on all Append() calls
Aug 07 08:42:24 dist-test-slave-6nmv krb5kdc[23901](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092143, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:42:24.026391 24757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:24.011276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.193:48219)
0807 08:42:24.012222 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:24.012260 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:24.013007 (+ 747us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:24.014034 (+ 1027us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:24.014040 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:24.014433 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:24.014837 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:24.014849 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.016674 (+ 1825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.016680 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:24.017937 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:24.017951 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.018984 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.018987 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:24.019169 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:24.019800 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:24.019815 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:24.021312 (+ 1497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:24.023417 (+ 2105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:24.023421 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:24.023431 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:24.023698 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:24.024054 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:24.024058 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:24.024059 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:24.024189 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:24.024726 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:24.024732 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:24.024961 (+ 229us) client_negotiation.cc:769] Sending connection context
0807 08:42:24.025142 (+ 181us) client_negotiation.cc:240] Negotiation successful
0807 08:42:24.025464 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":796,"thread_start_us":140,"threads_started":1}
I20260807 08:42:24.026379 24756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:24.011287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:48219 (local address 127.8.208.254:43987)
0807 08:42:24.011693 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:24.011728 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:24.012378 (+ 650us) server_negotiation.cc:407] Connection header received
0807 08:42:24.013381 (+ 1003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:24.013390 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:24.013657 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:24.014005 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:24.015067 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.016504 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.018079 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.018845 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.019028 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:24.021514 (+ 2486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:24.021518 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:24.021546 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:24.021571 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:24.023290 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:24.023834 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:24.023843 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:24.023846 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:24.023960 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:24.024278 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:24.024282 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:24.024284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:24.024610 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:24.024753 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:24.025264 (+ 511us) server_negotiation.cc:299] Negotiation successful
0807 08:42:24.025515 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":126,"threads_started":1}
I20260807 08:42:24.026552 24635 tablet_bootstrap.cc:492] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 08:42:24.027344 24635 tablet_bootstrap.cc:492] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3: Bootstrap complete.
I20260807 08:42:24.028909 24635 ts_tablet_manager.cc:1397] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3: Time spent bootstrapping tablet: real 0.031s user 0.016s sys 0.012s
I20260807 08:42:24.028950 24754 heartbeater.cc:347] Connected to a master server at 127.8.208.254:43987
I20260807 08:42:24.029147 24754 heartbeater.cc:464] Registering TS with master...
I20260807 08:42:24.029528 24754 heartbeater.cc:511] Master 127.8.208.254:43987 requested a full tablet report, sending...
I20260807 08:42:24.031672 24547 ts_manager.cc:194] Registered new tserver with Master: 954136526c744651881234fdba1585a3 (127.8.208.193:46495)
I20260807 08:42:24.031677 24635 raft_consensus.cc:348] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:24.032176 24635 raft_consensus.cc:729] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 954136526c744651881234fdba1585a3, State: Initialized, Role: FOLLOWER
I20260807 08:42:24.032701 24635 consensus_queue.cc:260] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:24.033622 24635 ts_tablet_manager.cc:1428] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260807 08:42:24.035089 24547 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.193@KRBTEST.COM'} at 127.8.208.193:48219
I20260807 08:42:24.037412 24754 heartbeater.cc:503] Master 127.8.208.254:43987 was elected leader, sending a full tablet report...
I20260807 08:42:24.040923 24762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:24.034708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42228 (local address 127.8.208.193:46495)
0807 08:42:24.036242 (+ 1534us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:24.036253 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:24.036271 (+ 18us) server_negotiation.cc:407] Connection header received
0807 08:42:24.036323 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:24.036328 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:24.036689 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:24.036830 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:42:24.037102 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.038086 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.039770 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.040278 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.040358 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:24.040440 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:24.040701 (+ 261us) server_negotiation.cc:299] Negotiation successful
0807 08:42:24.040824 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1459,"thread_start_us":84,"threads_started":1}
I20260807 08:42:24.040966 24761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:24.034610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:46495 (local address 127.0.0.1:42228)
0807 08:42:24.035864 (+ 1254us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:24.035892 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:24.036018 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:24.036848 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:24.036854 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:24.036877 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:42:24.036989 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:24.036995 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.038208 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.038211 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:24.039637 (+ 1426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:24.039651 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.040399 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.040403 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:24.040524 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:24.040561 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 08:42:24.040672 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 08:42:24.040791 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1123,"thread_start_us":108,"threads_started":1}
I20260807 08:42:24.041792 24680 tablet_service.cc:1514] Processing DeleteTablet for tablet 732556221ac74593a0e1fe6137aaa856 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:42:23 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:42228
I20260807 08:42:24.042552 24763 tablet_replica.cc:330] stopping tablet replica
I20260807 08:42:24.042798 24763 raft_consensus.cc:2229] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:42:24.043007 24763 raft_consensus.cc:2258] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:42:24.043848 24763 ts_tablet_manager.cc:1905] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:42:24.047240 24763 ts_tablet_manager.cc:1918] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:42:24.047350 24763 log.cc:1196] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/wal/wals/732556221ac74593a0e1fe6137aaa856
I20260807 08:42:24.047621 24763 ts_tablet_manager.cc:1939] T 732556221ac74593a0e1fe6137aaa856 P 954136526c744651881234fdba1585a3: Deleting consensus metadata
I20260807 08:42:24.049115 24530 catalog_manager.cc:4841] TS 954136526c744651881234fdba1585a3 (127.8.208.193:46495): tablet 732556221ac74593a0e1fe6137aaa856 (table test-table [id=766cbfcd67964a9a925c2bc4585ad9f8]) successfully deleted
W20260807 08:42:24.128113 24758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:24.128340 24758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:24.128379 24758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:24.132252 24758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:24.132303 24758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:24.132357 24758 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:42:24.137198 24758 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:39983
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=32819
--tserver_master_addrs=127.8.208.254:43987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24758
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:24.138075 24758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:24.138972 24758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:42:24.148061 24769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:24.148149 24772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:24.148138 24770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:24.148285 24758 server_base.cc:1034] running on GCE node
I20260807 08:42:24.148680 24758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:24.149287 24758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:24.150498 24758 hybrid_clock.cc:648] HybridClock initialized: now 1786092144150486 us; error 26 us; skew 500 ppm
Aug 07 08:42:24 dist-test-slave-6nmv krb5kdc[23901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092144, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:24.153321 24758 init.cc:377] Logged in from keytab as kudu/127.8.208.194@KRBTEST.COM (short username kudu)
I20260807 08:42:24.154249 24758 webserver.cc:460] Webserver started at http://127.8.208.194:32819/ using document root <none> and password file <none>
I20260807 08:42:24.154811 24758 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:24.154922 24758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:42:24.158726 24758 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260807 08:42:24.160848 24779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:24.162366 24758 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 08:42:24.162537 24758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "c2a31e674dce4db491ac84136d40f921"
format_stamp: "Formatted at 2026-08-07 08:42:23 on dist-test-slave-6nmv"
server_key: "ce9dc868771518f6c1956da320e141dc"
server_key_iv: "cf83a81e6dafb84fa31dc3e3b658879b"
server_key_version: "encryptionkey@0"
I20260807 08:42:24.163205 24758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:24.184504 24758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:24.187228 24758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:24.187400 24758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:24.187970 24758 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:42:24.188757 24758 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:42:24.188829 24758 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:24.188897 24758 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:42:24.188949 24758 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:24.197594 24758 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:39983
I20260807 08:42:24.197620 24903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:39983 every 8 connection(s)
I20260807 08:42:24.198519 24758 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:42:24.203253 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 24758
I20260807 08:42:24.203771 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:40293
--local_ip_for_outbound_sockets=127.8.208.195
--tserver_master_addrs=127.8.208.254:43987
--webserver_port=43717
--webserver_interface=127.8.208.195
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 08:42:24 dist-test-slave-6nmv krb5kdc[23901](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092144, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:42:24.211805 24756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:24.200152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:36783 (local address 127.8.208.254:43987)
0807 08:42:24.200283 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:24.200286 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:24.201016 (+ 730us) server_negotiation.cc:407] Connection header received
0807 08:42:24.202293 (+ 1277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:24.202295 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:24.202339 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:24.202416 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:24.203534 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.204328 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.205433 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.205638 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.205714 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:24.208448 (+ 2734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:24.208451 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:24.208453 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:24.208477 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:24.209906 (+ 1429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:24.210359 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:24.210362 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:24.210364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:24.210450 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:24.210760 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:24.210764 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:24.210765 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:24.210936 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:24.211040 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:24.211468 (+ 428us) server_negotiation.cc:299] Negotiation successful
0807 08:42:24.211586 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 08:42:24.212508 24906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:24.200480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.194:36783)
0807 08:42:24.200859 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:24.200903 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:24.202122 (+ 1219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:24.202559 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:24.202564 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:24.202929 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:24.203330 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:24.203366 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.204458 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.204461 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:24.205295 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:24.205308 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.205779 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.205785 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:24.206014 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:24.206596 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:24.206616 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:24.208259 (+ 1643us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:24.210010 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:24.210016 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:24.210027 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:24.210260 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:24.210537 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:24.210541 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:24.210543 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:24.210670 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:24.211038 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:24.211043 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:24.211252 (+ 209us) client_negotiation.cc:769] Sending connection context
0807 08:42:24.211418 (+ 166us) client_negotiation.cc:240] Negotiation successful
0807 08:42:24.211742 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":105,"threads_started":1}
I20260807 08:42:24.213613 24904 heartbeater.cc:347] Connected to a master server at 127.8.208.254:43987
I20260807 08:42:24.213876 24904 heartbeater.cc:464] Registering TS with master...
I20260807 08:42:24.214483 24904 heartbeater.cc:511] Master 127.8.208.254:43987 requested a full tablet report, sending...
I20260807 08:42:24.215567 24547 ts_manager.cc:194] Registered new tserver with Master: c2a31e674dce4db491ac84136d40f921 (127.8.208.194:39983)
I20260807 08:42:24.216275 24547 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.194@KRBTEST.COM'} at 127.8.208.194:36783
W20260807 08:42:24.311283 24907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:24.311527 24907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:24.311566 24907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:24.315409 24907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:24.315459 24907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:24.315510 24907 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:42:24.320247 24907 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:40293
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=43717
--tserver_master_addrs=127.8.208.254:43987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:24.321112 24907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:24.322001 24907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:42:24.330763 24916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:24.330725 24913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:24.330870 24907 server_base.cc:1034] running on GCE node
W20260807 08:42:24.330725 24914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:24.331454 24907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:24.332145 24907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:24.333353 24907 hybrid_clock.cc:648] HybridClock initialized: now 1786092144333327 us; error 45 us; skew 500 ppm
Aug 07 08:42:24 dist-test-slave-6nmv krb5kdc[23901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092144, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:24.336184 24907 init.cc:377] Logged in from keytab as kudu/127.8.208.195@KRBTEST.COM (short username kudu)
I20260807 08:42:24.337042 24907 webserver.cc:460] Webserver started at http://127.8.208.195:43717/ using document root <none> and password file <none>
I20260807 08:42:24.337591 24907 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:24.337705 24907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:42:24.341296 24907 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:42:24.343173 24923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:24.344250 24907 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 08:42:24.344370 24907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "a0a0fd2e062449acaf7aa542562ae69e"
format_stamp: "Formatted at 2026-08-07 08:42:23 on dist-test-slave-6nmv"
server_key: "4de81390c4c6b911d3e9ccbaa9ae84e9"
server_key_iv: "5570df81d71abdb449e7c47c97064de7"
server_key_version: "encryptionkey@0"
I20260807 08:42:24.344836 24907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:24.371879 24907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:24.375742 24907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:24.376019 24907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:24.376590 24907 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:42:24.377403 24907 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:42:24.377449 24907 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:24.377538 24907 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:42:24.377571 24907 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:24.386281 24907 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:40293
I20260807 08:42:24.386351 25043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:40293 every 8 connection(s)
I20260807 08:42:24.387190 24907 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:42:24.390663 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 24907
Aug 07 08:42:24 dist-test-slave-6nmv krb5kdc[23901](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092144, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:42:24.400782 25048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:24.391325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45256 (local address 127.8.208.254:43987)
0807 08:42:24.391528 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:24.391531 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:24.392546 (+ 1015us) server_negotiation.cc:407] Connection header received
0807 08:42:24.392641 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:24.392644 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:24.392686 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:24.392774 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:24.393406 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.394118 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.394867 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.395177 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.395246 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:24.396894 (+ 1648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:24.396898 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:24.396900 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:24.396939 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:24.399015 (+ 2076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:24.399466 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:24.399469 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:24.399470 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:24.399577 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:24.399901 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:24.399903 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:24.399903 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:24.400111 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:24.400294 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:24.400489 (+ 195us) server_negotiation.cc:299] Negotiation successful
0807 08:42:24.400578 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"spinlock_wait_cycles":1920,"thread_start_us":79,"threads_started":1}
I20260807 08:42:24.401007 24756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:24.388878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:34913 (local address 127.8.208.254:43987)
0807 08:42:24.389008 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:24.389011 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:24.389759 (+ 748us) server_negotiation.cc:407] Connection header received
0807 08:42:24.391032 (+ 1273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:24.391037 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:24.391089 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:24.391154 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:24.392337 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.393001 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.394365 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.394556 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.394658 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:24.396882 (+ 2224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:24.396885 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:24.396888 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:24.396912 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:24.398935 (+ 2023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:24.399535 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:24.399540 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:24.399542 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:24.399605 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:24.399992 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:24.399995 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:24.399997 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:24.400133 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:24.400208 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:24.400753 (+ 545us) server_negotiation.cc:299] Negotiation successful
0807 08:42:24.400844 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 08:42:24.401990 25047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:24.389239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.195:34913)
0807 08:42:24.389620 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:24.389657 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:24.390804 (+ 1147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:24.391356 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:24.391365 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:24.391779 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:24.392216 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:24.392229 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.393107 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.393110 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:24.394258 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:24.394267 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.394693 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.394696 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:24.394915 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:24.395463 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:24.395477 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:24.396733 (+ 1256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:24.399078 (+ 2345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:24.399084 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:24.399097 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:24.399433 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:24.399691 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:24.399693 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:24.399695 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:24.399898 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:24.400225 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:24.400231 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:24.400486 (+ 255us) client_negotiation.cc:769] Sending connection context
0807 08:42:24.400693 (+ 207us) client_negotiation.cc:240] Negotiation successful
0807 08:42:24.401047 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":103,"threads_started":1}
I20260807 08:42:24.402987 25045 heartbeater.cc:347] Connected to a master server at 127.8.208.254:43987
I20260807 08:42:24.403200 25045 heartbeater.cc:464] Registering TS with master...
I20260807 08:42:24.403620 25045 heartbeater.cc:511] Master 127.8.208.254:43987 requested a full tablet report, sending...
I20260807 08:42:24.404501 24547 ts_manager.cc:194] Registered new tserver with Master: a0a0fd2e062449acaf7aa542562ae69e (127.8.208.195:40293)
I20260807 08:42:24.405014 24547 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.195@KRBTEST.COM'} at 127.8.208.195:34913
I20260807 08:42:24.414428 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 08:42:24.418828 25048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:24.415128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45272 (local address 127.8.208.254:43987)
0807 08:42:24.415268 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:24.415273 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:24.415507 (+ 234us) server_negotiation.cc:407] Connection header received
0807 08:42:24.415605 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:24.415608 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:24.415695 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:24.415786 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:42:24.416049 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.416526 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.417362 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.417593 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.417664 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:24.418024 (+ 360us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:42:24.418407 (+ 383us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:42:24.418513 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:24.418587 (+ 74us) server_negotiation.cc:299] Negotiation successful
0807 08:42:24.418641 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 08:42:24.419480 24547 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:45272:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 08:42:24.422757 24547 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:42:24.431082 24680 tablet_service.cc:1467] Processing CreateTablet for tablet 8f6fd5e9e28e42349b1ea44ba117d6a9 (DEFAULT_TABLE table=test-table [id=8ed77b5d3c73402990a696040319f613]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:42:24.431766 24680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f6fd5e9e28e42349b1ea44ba117d6a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:42:24.434868 24635 tablet_bootstrap.cc:492] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3: Bootstrap starting.
I20260807 08:42:24.435220 24761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:24.429730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:39983 (local address 127.0.0.1:44128)
0807 08:42:24.429891 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:24.429920 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:24.430000 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:24.430906 (+ 906us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:24.430911 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:24.430931 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:42:24.431052 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:24.431057 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.432445 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.432448 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:24.433561 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:24.433585 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.434780 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.434785 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:24.434918 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:24.434947 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 08:42:24.435008 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 08:42:24.435087 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60,"mutex_wait_us":1}
I20260807 08:42:24.435408 25056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:24.430119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:40293 (local address 127.0.0.1:49228)
0807 08:42:24.430737 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:24.430748 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:24.430861 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:24.431510 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:24.431512 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:24.431527 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:42:24.431592 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:24.431596 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.433120 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.433124 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:24.433930 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:24.433940 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.434935 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.434938 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:24.435035 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:24.435065 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 08:42:24.435131 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 08:42:24.435205 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":87,"threads_started":1}
I20260807 08:42:24.435572 25057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:24.430317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49228 (local address 127.8.208.195:40293)
0807 08:42:24.430663 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:24.430676 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:24.430845 (+ 169us) server_negotiation.cc:407] Connection header received
0807 08:42:24.431022 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:24.431028 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:24.431217 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:24.431371 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:42:24.431727 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.432969 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.434053 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.434595 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.434700 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:24.434875 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:24.435321 (+ 446us) server_negotiation.cc:299] Negotiation successful
0807 08:42:24.435414 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":176,"threads_started":1}
I20260807 08:42:24.435823 24635 tablet_bootstrap.cc:654] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3: Neither blocks nor log segments found. Creating new log.
I20260807 08:42:24.435935 25055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:24.429971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44128 (local address 127.8.208.194:39983)
0807 08:42:24.430356 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:24.430367 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:24.430390 (+ 23us) server_negotiation.cc:407] Connection header received
0807 08:42:24.430497 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:24.430502 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:24.430711 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:24.430944 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:42:24.431162 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.432263 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.433756 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.434613 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.435430 (+ 817us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:24.435573 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:24.435625 (+ 52us) server_negotiation.cc:299] Negotiation successful
0807 08:42:24.435739 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":124,"threads_started":1}
I20260807 08:42:24.437664 24635 tablet_bootstrap.cc:492] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3: No bootstrap required, opened a new log
I20260807 08:42:24.437768 24635 ts_tablet_manager.cc:1397] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260807 08:42:24.438315 24635 raft_consensus.cc:348] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:24.438447 24635 raft_consensus.cc:374] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:42:24.438491 24635 raft_consensus.cc:729] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 954136526c744651881234fdba1585a3, State: Initialized, Role: FOLLOWER
I20260807 08:42:24.438688 24635 consensus_queue.cc:260] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:24.439083 24635 ts_tablet_manager.cc:1428] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 08:42:24.438760 24973 tablet_service.cc:1467] Processing CreateTablet for tablet 8f6fd5e9e28e42349b1ea44ba117d6a9 (DEFAULT_TABLE table=test-table [id=8ed77b5d3c73402990a696040319f613]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:42:24.439126 24828 tablet_service.cc:1467] Processing CreateTablet for tablet 8f6fd5e9e28e42349b1ea44ba117d6a9 (DEFAULT_TABLE table=test-table [id=8ed77b5d3c73402990a696040319f613]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:42:24.439787 24973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f6fd5e9e28e42349b1ea44ba117d6a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:42:24.440101 24828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f6fd5e9e28e42349b1ea44ba117d6a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:42:24.446599 25059 tablet_bootstrap.cc:492] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P a0a0fd2e062449acaf7aa542562ae69e: Bootstrap starting.
I20260807 08:42:24.446606 25060 tablet_bootstrap.cc:492] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921: Bootstrap starting.
I20260807 08:42:24.449136 25060 tablet_bootstrap.cc:654] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921: Neither blocks nor log segments found. Creating new log.
I20260807 08:42:24.449182 25059 tablet_bootstrap.cc:654] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P a0a0fd2e062449acaf7aa542562ae69e: Neither blocks nor log segments found. Creating new log.
I20260807 08:42:24.449985 25060 log.cc:824] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921: Log is configured to *not* fsync() on all Append() calls
I20260807 08:42:24.449985 25059 log.cc:824] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P a0a0fd2e062449acaf7aa542562ae69e: Log is configured to *not* fsync() on all Append() calls
I20260807 08:42:24.451680 25060 tablet_bootstrap.cc:492] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921: No bootstrap required, opened a new log
I20260807 08:42:24.451704 25059 tablet_bootstrap.cc:492] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P a0a0fd2e062449acaf7aa542562ae69e: No bootstrap required, opened a new log
I20260807 08:42:24.451864 25060 ts_tablet_manager.cc:1397] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s
I20260807 08:42:24.451900 25059 ts_tablet_manager.cc:1397] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P a0a0fd2e062449acaf7aa542562ae69e: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260807 08:42:24.454972 25060 raft_consensus.cc:348] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:24.455168 25060 raft_consensus.cc:374] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:42:24.455010 25059 raft_consensus.cc:348] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P a0a0fd2e062449acaf7aa542562ae69e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:24.455201 25060 raft_consensus.cc:729] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2a31e674dce4db491ac84136d40f921, State: Initialized, Role: FOLLOWER
I20260807 08:42:24.455265 25059 raft_consensus.cc:374] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P a0a0fd2e062449acaf7aa542562ae69e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:42:24.455340 25059 raft_consensus.cc:729] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P a0a0fd2e062449acaf7aa542562ae69e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0a0fd2e062449acaf7aa542562ae69e, State: Initialized, Role: FOLLOWER
I20260807 08:42:24.455684 25060 consensus_queue.cc:260] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:24.455713 25059 consensus_queue.cc:260] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P a0a0fd2e062449acaf7aa542562ae69e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:24.456269 24904 heartbeater.cc:503] Master 127.8.208.254:43987 was elected leader, sending a full tablet report...
I20260807 08:42:24.456338 25045 heartbeater.cc:503] Master 127.8.208.254:43987 was elected leader, sending a full tablet report...
I20260807 08:42:24.456614 25060 ts_tablet_manager.cc:1428] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921: Time spent starting tablet: real 0.005s user 0.003s sys 0.002s
I20260807 08:42:24.456653 25059 ts_tablet_manager.cc:1428] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P a0a0fd2e062449acaf7aa542562ae69e: Time spent starting tablet: real 0.005s user 0.004s sys 0.001s
W20260807 08:42:24.510716 24755 tablet.cc:2369] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 08:42:24.521242 25063 raft_consensus.cc:482] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:42:24.521450 25063 raft_consensus.cc:504] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:24.522547 25063 leader_election.cc:288] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0a0fd2e062449acaf7aa542562ae69e (127.8.208.195:40293), 954136526c744651881234fdba1585a3 (127.8.208.193:46495)
I20260807 08:42:24.526585 24906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:24.522927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:40293 (local address 127.8.208.194:46963)
0807 08:42:24.523070 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:24.523088 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:24.523183 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:24.523629 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:24.523631 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:24.523652 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:42:24.523776 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:24.523786 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.524529 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.524534 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:24.525293 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:24.525302 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.526159 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.526162 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:24.526261 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:24.526285 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 08:42:24.526377 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 08:42:24.526458 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260807 08:42:24.526629 25057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:24.523025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:46963 (local address 127.8.208.195:40293)
0807 08:42:24.523164 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:24.523168 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:24.523182 (+ 14us) server_negotiation.cc:407] Connection header received
0807 08:42:24.523340 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:24.523343 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:24.523392 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:24.523493 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:42:24.523893 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.524384 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.525425 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.526039 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.526181 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:24.526221 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:24.526403 (+ 182us) server_negotiation.cc:299] Negotiation successful
0807 08:42:24.526487 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 08:42:24.526993 24762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:24.523349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:45045 (local address 127.8.208.193:46495)
0807 08:42:24.523514 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:24.523535 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:24.523718 (+ 183us) server_negotiation.cc:407] Connection header received
0807 08:42:24.523809 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:24.523811 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:24.523849 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:24.523941 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:42:24.524217 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.524727 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.525791 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.526390 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.526508 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:24.526586 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:24.526785 (+ 199us) server_negotiation.cc:299] Negotiation successful
0807 08:42:24.526877 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 08:42:24.527338 25065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:24.523221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:46495 (local address 127.8.208.194:45045)
0807 08:42:24.523632 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:24.523644 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:24.523728 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:24.523963 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:24.523967 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:24.523983 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:42:24.524108 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:24.524113 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.524838 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.524842 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:24.525673 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:24.525682 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.526502 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.526505 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:24.526618 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:24.526644 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 08:42:24.527134 (+ 490us) client_negotiation.cc:240] Negotiation successful
0807 08:42:24.527210 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":155,"threads_started":1}
I20260807 08:42:24.527323 24994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f6fd5e9e28e42349b1ea44ba117d6a9" candidate_uuid: "c2a31e674dce4db491ac84136d40f921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0a0fd2e062449acaf7aa542562ae69e" is_pre_election: true
I20260807 08:42:24.527637 24994 raft_consensus.cc:2454] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P a0a0fd2e062449acaf7aa542562ae69e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2a31e674dce4db491ac84136d40f921 in term 0.
I20260807 08:42:24.528050 24705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f6fd5e9e28e42349b1ea44ba117d6a9" candidate_uuid: "c2a31e674dce4db491ac84136d40f921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "954136526c744651881234fdba1585a3" is_pre_election: true
I20260807 08:42:24.528096 24781 leader_election.cc:302] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0a0fd2e062449acaf7aa542562ae69e, c2a31e674dce4db491ac84136d40f921; no voters:
I20260807 08:42:24.528337 24705 raft_consensus.cc:2454] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2a31e674dce4db491ac84136d40f921 in term 0.
I20260807 08:42:24.528344 25063 raft_consensus.cc:2781] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:42:24.528424 25063 raft_consensus.cc:482] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:42:24.528453 25063 raft_consensus.cc:3037] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:42:24.529572 25063 raft_consensus.cc:504] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:24.529959 25063 leader_election.cc:288] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921 [CANDIDATE]: Term 1 election: Requested vote from peers a0a0fd2e062449acaf7aa542562ae69e (127.8.208.195:40293), 954136526c744651881234fdba1585a3 (127.8.208.193:46495)
I20260807 08:42:24.530292 24994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f6fd5e9e28e42349b1ea44ba117d6a9" candidate_uuid: "c2a31e674dce4db491ac84136d40f921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0a0fd2e062449acaf7aa542562ae69e"
I20260807 08:42:24.530341 24705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f6fd5e9e28e42349b1ea44ba117d6a9" candidate_uuid: "c2a31e674dce4db491ac84136d40f921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "954136526c744651881234fdba1585a3"
I20260807 08:42:24.530419 24994 raft_consensus.cc:3037] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P a0a0fd2e062449acaf7aa542562ae69e [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:42:24.530457 24705 raft_consensus.cc:3037] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:42:24.531751 24994 raft_consensus.cc:2454] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P a0a0fd2e062449acaf7aa542562ae69e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2a31e674dce4db491ac84136d40f921 in term 1.
I20260807 08:42:24.531751 24705 raft_consensus.cc:2454] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2a31e674dce4db491ac84136d40f921 in term 1.
I20260807 08:42:24.532028 24781 leader_election.cc:302] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0a0fd2e062449acaf7aa542562ae69e, c2a31e674dce4db491ac84136d40f921; no voters:
I20260807 08:42:24.532204 25063 raft_consensus.cc:2781] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:42:24.532418 25063 raft_consensus.cc:686] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921 [term 1 LEADER]: Becoming Leader. State: Replica: c2a31e674dce4db491ac84136d40f921, State: Running, Role: LEADER
I20260807 08:42:24.532729 25063 consensus_queue.cc:237] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:24.535801 24547 catalog_manager.cc:5495] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2a31e674dce4db491ac84136d40f921 (127.8.208.194). New cstate: current_term: 1 leader_uuid: "c2a31e674dce4db491ac84136d40f921" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } health_report { overall_health: UNKNOWN } } }
I20260807 08:42:24.556566 25055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:24.553709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50908 (local address 127.8.208.194:39983)
0807 08:42:24.553853 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:24.553857 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:24.553879 (+ 22us) server_negotiation.cc:407] Connection header received
0807 08:42:24.553937 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:24.553939 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:24.553982 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:24.554059 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:42:24.554246 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.554717 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.555408 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:24.555619 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:24.555694 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:24.555938 (+ 244us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:42:24.556272 (+ 334us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:42:24.556354 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:24.556417 (+ 63us) server_negotiation.cc:299] Negotiation successful
0807 08:42:24.556459 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 08:42:24.561760 24705 raft_consensus.cc:1261] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Refusing update from remote peer c2a31e674dce4db491ac84136d40f921: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:42:24.561764 24994 raft_consensus.cc:1261] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P a0a0fd2e062449acaf7aa542562ae69e [term 1 FOLLOWER]: Refusing update from remote peer c2a31e674dce4db491ac84136d40f921: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:42:24.562449 25063 consensus_queue.cc:1035] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:42:24.562623 25066 consensus_queue.cc:1035] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:42:24.569079 25069 mvcc.cc:205] Tried to move back new op lower bound from 7315833424118697984 to 7315833424008531968. Current Snapshot: MvccSnapshot[applied={T|T < 7315833424118697984}]
I20260807 08:42:24.569480 25070 mvcc.cc:205] Tried to move back new op lower bound from 7315833424118697984 to 7315833424008531968. Current Snapshot: MvccSnapshot[applied={T|T < 7315833424118697984}]
I20260807 08:42:24.577984 24547 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:45272:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:42:24.578138 24547 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:45272:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:42:24.580421 24547 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e: Sending DeleteTablet for 3 replicas of tablet 8f6fd5e9e28e42349b1ea44ba117d6a9
I20260807 08:42:24.581025 24828 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f6fd5e9e28e42349b1ea44ba117d6a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:42:24 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:44128
I20260807 08:42:24.581189 24973 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f6fd5e9e28e42349b1ea44ba117d6a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:42:24 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:49228
I20260807 08:42:24.581245 24680 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f6fd5e9e28e42349b1ea44ba117d6a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:42:24 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:42228
I20260807 08:42:24.581561 25080 tablet_replica.cc:330] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3: stopping tablet replica
I20260807 08:42:24.581640 25079 tablet_replica.cc:330] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921: stopping tablet replica
I20260807 08:42:24.581727 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 24590
I20260807 08:42:24.581727 25080 raft_consensus.cc:2229] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:42:24.584273 25079 raft_consensus.cc:2229] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921 [term 1 LEADER]: Raft consensus shutting down.
I20260807 08:42:24.584636 25079 raft_consensus.cc:2258] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:42:24.586120 25079 ts_tablet_manager.cc:1905] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:42:24.588364 25079 ts_tablet_manager.cc:1918] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:42:24.588479 25079 log.cc:1196] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/wal/wals/8f6fd5e9e28e42349b1ea44ba117d6a9
I20260807 08:42:24.588826 25079 ts_tablet_manager.cc:1939] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P c2a31e674dce4db491ac84136d40f921: Deleting consensus metadata
I20260807 08:42:24.589766 24531 catalog_manager.cc:4841] TS c2a31e674dce4db491ac84136d40f921 (127.8.208.194:39983): tablet 8f6fd5e9e28e42349b1ea44ba117d6a9 (table test-table [id=8ed77b5d3c73402990a696040319f613]) successfully deleted
I20260807 08:42:24.594087 25081 tablet_replica.cc:330] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P a0a0fd2e062449acaf7aa542562ae69e: stopping tablet replica
W20260807 08:42:24.594111 24530 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.208.193:46495 (error 108)
I20260807 08:42:24.594470 25081 raft_consensus.cc:2229] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P a0a0fd2e062449acaf7aa542562ae69e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:42:24.594828 25081 raft_consensus.cc:2258] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P a0a0fd2e062449acaf7aa542562ae69e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260807 08:42:24.595304 25056 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:42:24.594946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:46495 (local address 127.0.0.1:49248)
0807 08:42:24.595092 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:24.595166 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.193:46495: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":56}
I20260807 08:42:24.595430 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 24758
W20260807 08:42:24.595590 24530 catalog_manager.cc:4584] TS 954136526c744651881234fdba1585a3 (127.8.208.193:46495): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8f6fd5e9e28e42349b1ea44ba117d6a9: Network error: Client connection negotiation failed: client connection to 127.8.208.193:46495: connect: Connection reset by peer (error 104)
I20260807 08:42:24.596774 25081 ts_tablet_manager.cc:1905] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P a0a0fd2e062449acaf7aa542562ae69e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:42:24.599515 25081 ts_tablet_manager.cc:1918] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P a0a0fd2e062449acaf7aa542562ae69e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:42:24.599632 25081 log.cc:1196] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P a0a0fd2e062449acaf7aa542562ae69e: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/8f6fd5e9e28e42349b1ea44ba117d6a9
I20260807 08:42:24.600103 25081 ts_tablet_manager.cc:1939] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P a0a0fd2e062449acaf7aa542562ae69e: Deleting consensus metadata
I20260807 08:42:24.601291 24530 catalog_manager.cc:4841] TS a0a0fd2e062449acaf7aa542562ae69e (127.8.208.195:40293): tablet 8f6fd5e9e28e42349b1ea44ba117d6a9 (table test-table [id=8ed77b5d3c73402990a696040319f613]) successfully deleted
I20260807 08:42:24.604954 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 24907
I20260807 08:42:24.611783 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 24510
I20260807 08:42:24.618754 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:43987
--webserver_interface=127.8.208.254
--webserver_port=41363
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:43987
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:42:24.721410 25084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:24.721668 25084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:24.721761 25084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:24.725539 25084 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:42:24.725617 25084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:24.725656 25084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:24.725711 25084 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:42:24.725746 25084 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:42:24.730646 25084 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:43987
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:43987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=41363
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25084
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:24.731572 25084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:24.732532 25084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:42:24.740504 25090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:24.740598 25084 server_base.cc:1034] running on GCE node
W20260807 08:42:24.740561 25089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:24.740502 25092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:24.741282 25084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:24.742336 25084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:24.743520 25084 hybrid_clock.cc:648] HybridClock initialized: now 1786092144743508 us; error 23 us; skew 500 ppm
Aug 07 08:42:24 dist-test-slave-6nmv krb5kdc[23901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092144, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:24.746101 25084 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:42:24.746937 25084 webserver.cc:460] Webserver started at http://127.8.208.254:41363/ using document root <none> and password file <none>
I20260807 08:42:24.747430 25084 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:24.747515 25084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:42:24.751046 25084 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:42:24.753119 25099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:24.754251 25084 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:42:24.754376 25084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "55a34663645a4670abe559251bcfc80e"
format_stamp: "Formatted at 2026-08-07 08:42:22 on dist-test-slave-6nmv"
server_key: "59f8f49b18692e796894a58794b546bd"
server_key_iv: "64a88a063e267f04b4f9a20d8f8c6aa1"
server_key_version: "encryptionkey@0"
I20260807 08:42:24.754850 25084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:24.766263 25084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:24.769201 25084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:24.769376 25084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:24.776031 25084 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:43987
I20260807 08:42:24.776312 25156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:43987 every 8 connection(s)
I20260807 08:42:24.777001 25084 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:42:24.780954 25157 sys_catalog.cc:263] Verifying existing consensus state
I20260807 08:42:24.782562 25157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e: Bootstrap starting.
I20260807 08:42:24.784998 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 25084
I20260807 08:42:24.785559 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:46495
--local_ip_for_outbound_sockets=127.8.208.193
--tserver_master_addrs=127.8.208.254:43987
--webserver_port=44027
--webserver_interface=127.8.208.193
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 08:42:24.799991 25157 log.cc:824] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e: Log is configured to *not* fsync() on all Append() calls
I20260807 08:42:24.811149 25157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 08:42:24.811517 25157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e: Bootstrap complete.
I20260807 08:42:24.815451 25157 raft_consensus.cc:348] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55a34663645a4670abe559251bcfc80e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43987 } }
I20260807 08:42:24.815820 25157 raft_consensus.cc:729] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a34663645a4670abe559251bcfc80e, State: Initialized, Role: FOLLOWER
I20260807 08:42:24.816341 25157 consensus_queue.cc:260] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55a34663645a4670abe559251bcfc80e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43987 } }
I20260807 08:42:24.816468 25157 raft_consensus.cc:388] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:42:24.816557 25157 raft_consensus.cc:482] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:42:24.816679 25157 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [term 2 FOLLOWER]: Advancing to term 3
I20260807 08:42:24.818570 25157 raft_consensus.cc:504] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55a34663645a4670abe559251bcfc80e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43987 } }
I20260807 08:42:24.818913 25157 leader_election.cc:302] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 55a34663645a4670abe559251bcfc80e; no voters:
I20260807 08:42:24.819231 25157 leader_election.cc:288] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 08:42:24.819319 25161 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [term 3 FOLLOWER]: Leader election won for term 3
I20260807 08:42:24.819502 25161 raft_consensus.cc:686] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [term 3 LEADER]: Becoming Leader. State: Replica: 55a34663645a4670abe559251bcfc80e, State: Running, Role: LEADER
I20260807 08:42:24.819763 25161 consensus_queue.cc:237] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55a34663645a4670abe559251bcfc80e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43987 } }
I20260807 08:42:24.820338 25157 sys_catalog.cc:564] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:42:24.820701 25164 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 55a34663645a4670abe559251bcfc80e. Latest consensus state: current_term: 3 leader_uuid: "55a34663645a4670abe559251bcfc80e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55a34663645a4670abe559251bcfc80e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43987 } } }
I20260807 08:42:24.820827 25164 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [sys.catalog]: This master's current role is: LEADER
I20260807 08:42:24.821154 25162 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "55a34663645a4670abe559251bcfc80e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55a34663645a4670abe559251bcfc80e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 43987 } } }
I20260807 08:42:24.821272 25162 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55a34663645a4670abe559251bcfc80e [sys.catalog]: This master's current role is: LEADER
I20260807 08:42:24.821564 25166 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:42:24.826380 25166 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:42:24.826977 25166 catalog_manager.cc:1259] Loaded cluster ID: 41b42360e7da4a81b0810779a3a35e65
I20260807 08:42:24.827046 25166 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260807 08:42:24.827852 25166 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7ff27936a9ad google::LogMessage::Fail() at ??:0
@ 0x7ff27936d88a google::LogMessage::SendToLog() at ??:0
@ 0x7ff27936a4de google::LogMessage::Flush() at ??:0
@ 0x7ff27936ba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7ff283ca9fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7ff283caad2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7ff283ca7579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7ff283ceb640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7ff27b5bc3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7ff27b5bcc83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7ff27b5be3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7ff27b5ad512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7ff27cbf16db start_thread at ??:0
@ 0x7ff277e6861f clone at ??:0
W20260807 08:42:24.922996 25159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:24.923293 25159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:24.923355 25159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:24.928711 25159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:24.928785 25159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:24.928893 25159 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:42:24.935885 25159 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:46495
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=44027
--tserver_master_addrs=127.8.208.254:43987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:24.937084 25159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:24.938403 25159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:42:24.948627 25204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:24.948627 25207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:24.948711 25205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:24.949043 25159 server_base.cc:1034] running on GCE node
I20260807 08:42:24.949383 25159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:24.950074 25159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:24.951256 25159 hybrid_clock.cc:648] HybridClock initialized: now 1786092144951226 us; error 47 us; skew 500 ppm
Aug 07 08:42:24 dist-test-slave-6nmv krb5kdc[23901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092144, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:24.954089 25159 init.cc:377] Logged in from keytab as kudu/127.8.208.193@KRBTEST.COM (short username kudu)
I20260807 08:42:24.954819 25159 webserver.cc:460] Webserver started at http://127.8.208.193:44027/ using document root <none> and password file <none>
I20260807 08:42:24.955307 25159 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:24.955415 25159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:42:24.959111 25159 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:42:24.961256 25214 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:24.962523 25159 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:42:24.962666 25159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "954136526c744651881234fdba1585a3"
format_stamp: "Formatted at 2026-08-07 08:42:23 on dist-test-slave-6nmv"
server_key: "334b41b6f46ad46035898bd98616392f"
server_key_iv: "d9f789603e9407e3d0a9e4f8f1d6fee1"
server_key_version: "encryptionkey@0"
I20260807 08:42:24.963143 25159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:24.983788 25159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:24.986943 25159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:24.987147 25159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:24.987720 25159 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:42:24.988915 25221 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 08:42:24.994168 25159 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 08:42:24.994233 25159 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260807 08:42:24.994302 25159 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 08:42:24.995973 25159 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 08:42:24.996042 25159 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260807 08:42:24.996315 25221 tablet_bootstrap.cc:492] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3: Bootstrap starting.
I20260807 08:42:25.006693 25159 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:46495
I20260807 08:42:25.007617 25159 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:42:25.008407 25334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:46495 every 8 connection(s)
I20260807 08:42:25.013154 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 25159
I20260807 08:42:25.013583 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:39983
--local_ip_for_outbound_sockets=127.8.208.194
--tserver_master_addrs=127.8.208.254:43987
--webserver_port=32819
--webserver_interface=127.8.208.194
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 08:42:25.018067 25221 log.cc:824] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3: Log is configured to *not* fsync() on all Append() calls
I20260807 08:42:25.026834 25221 tablet_bootstrap.cc:492] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 08:42:25.027284 25221 tablet_bootstrap.cc:492] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3: Bootstrap complete.
I20260807 08:42:25.028785 25221 ts_tablet_manager.cc:1397] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3: Time spent bootstrapping tablet: real 0.033s user 0.022s sys 0.007s
I20260807 08:42:25.031985 25221 raft_consensus.cc:348] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:25.032523 25221 raft_consensus.cc:729] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 954136526c744651881234fdba1585a3, State: Initialized, Role: FOLLOWER
I20260807 08:42:25.033077 25221 consensus_queue.cc:260] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:25.034139 25221 ts_tablet_manager.cc:1428] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3: Time spent starting tablet: real 0.005s user 0.007s sys 0.001s
W20260807 08:42:25.052575 25337 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:42:25.009679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.193:53517)
0807 08:42:25.010203 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:25.010263 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:25.011049 (+ 786us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:25.051747 (+ 40698us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":226,"threads_started":1}
W20260807 08:42:25.053164 25335 heartbeater.cc:644] Failed to heartbeat to 127.8.208.254:43987 (0 consecutive failures): Network error: Failed to ping master at 127.8.208.254:43987: Client connection negotiation failed: client connection to 127.8.208.254:43987: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 08:42:25.053989 25337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:25.053700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.193:56161)
0807 08:42:25.053859 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:25.053928 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260807 08:42:25.054679 25337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:25.054428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.193:55327)
0807 08:42:25.054575 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:25.054626 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260807 08:42:25.054903 25335 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 08:42:25.120065 25338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:25.120265 25338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:25.120301 25338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:25.123847 25338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:25.123891 25338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:25.123944 25338 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:42:25.128399 25338 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:39983
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=32819
--tserver_master_addrs=127.8.208.254:43987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25338
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:25.129276 25338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:25.130201 25338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:42:25.139379 25347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:25.139422 25349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:25.139402 25351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:25.139643 25338 server_base.cc:1034] running on GCE node
I20260807 08:42:25.139997 25338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:25.140568 25338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:25.141769 25338 hybrid_clock.cc:648] HybridClock initialized: now 1786092145141736 us; error 31 us; skew 500 ppm
Aug 07 08:42:25 dist-test-slave-6nmv krb5kdc[23901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092145, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:25.148146 25338 init.cc:377] Logged in from keytab as kudu/127.8.208.194@KRBTEST.COM (short username kudu)
I20260807 08:42:25.148968 25338 webserver.cc:460] Webserver started at http://127.8.208.194:32819/ using document root <none> and password file <none>
I20260807 08:42:25.149551 25338 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:25.149657 25338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:42:25.153303 25338 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:42:25.155375 25358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:25.156484 25338 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 08:42:25.156615 25338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "c2a31e674dce4db491ac84136d40f921"
format_stamp: "Formatted at 2026-08-07 08:42:23 on dist-test-slave-6nmv"
server_key: "ce9dc868771518f6c1956da320e141dc"
server_key_iv: "cf83a81e6dafb84fa31dc3e3b658879b"
server_key_version: "encryptionkey@0"
I20260807 08:42:25.157153 25338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:25.181880 25338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:25.184438 25338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:25.184633 25338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:25.185210 25338 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:42:25.186038 25338 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:42:25.186113 25338 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:25.186175 25338 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:42:25.186213 25338 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:25.195255 25338 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:39983
I20260807 08:42:25.195277 25483 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:39983 every 8 connection(s)
I20260807 08:42:25.196183 25338 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:42:25.199723 25486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:25.198095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.194:47553)
0807 08:42:25.198506 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:25.198608 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":106,"threads_started":1}
W20260807 08:42:25.200151 25484 heartbeater.cc:644] Failed to heartbeat to 127.8.208.254:43987 (0 consecutive failures): Network error: Failed to ping master at 127.8.208.254:43987: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
I20260807 08:42:25.200322 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 25338
I20260807 08:42:25.200678 25486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:25.200491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.194:36723)
0807 08:42:25.200588 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:25.200634 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260807 08:42:25.200685 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:40293
--local_ip_for_outbound_sockets=127.8.208.195
--tserver_master_addrs=127.8.208.254:43987
--webserver_port=43717
--webserver_interface=127.8.208.195
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 08:42:25.201212 25486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:25.201033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.194:54827)
0807 08:42:25.201124 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:25.201163 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260807 08:42:25.201345 25484 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 08:42:25.304670 25487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:25.304943 25487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:25.305020 25487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:25.308959 25487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:25.309034 25487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:25.309116 25487 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:42:25.313987 25487 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:40293
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=43717
--tserver_master_addrs=127.8.208.254:43987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:25.314917 25487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:25.315850 25487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:42:25.324885 25492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:25.324882 25493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:25.324882 25495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:25.325289 25487 server_base.cc:1034] running on GCE node
I20260807 08:42:25.325675 25487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:25.326268 25487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:25.327422 25487 hybrid_clock.cc:648] HybridClock initialized: now 1786092145327407 us; error 28 us; skew 500 ppm
Aug 07 08:42:25 dist-test-slave-6nmv krb5kdc[23901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092145, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:25.330083 25487 init.cc:377] Logged in from keytab as kudu/127.8.208.195@KRBTEST.COM (short username kudu)
I20260807 08:42:25.330862 25487 webserver.cc:460] Webserver started at http://127.8.208.195:43717/ using document root <none> and password file <none>
I20260807 08:42:25.331384 25487 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:25.331444 25487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:42:25.335011 25487 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:42:25.336918 25502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:25.338052 25487 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:42:25.338178 25487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "a0a0fd2e062449acaf7aa542562ae69e"
format_stamp: "Formatted at 2026-08-07 08:42:23 on dist-test-slave-6nmv"
server_key: "4de81390c4c6b911d3e9ccbaa9ae84e9"
server_key_iv: "5570df81d71abdb449e7c47c97064de7"
server_key_version: "encryptionkey@0"
I20260807 08:42:25.338682 25487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:25.355989 25487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:25.358620 25487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:25.358809 25487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:25.359341 25487 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:42:25.360116 25487 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:42:25.360179 25487 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:25.360247 25487 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:42:25.360293 25487 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:25.368430 25487 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:40293
I20260807 08:42:25.368462 25624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:40293 every 8 connection(s)
I20260807 08:42:25.369306 25487 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:42:25.372968 25627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:25.371295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.195:54787)
0807 08:42:25.372263 (+ 968us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:25.372355 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":796,"thread_start_us":649,"threads_started":1}
W20260807 08:42:25.373328 25625 heartbeater.cc:644] Failed to heartbeat to 127.8.208.254:43987 (0 consecutive failures): Network error: Failed to ping master at 127.8.208.254:43987: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
I20260807 08:42:25.373867 25627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:25.373652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.195:51433)
0807 08:42:25.373753 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:25.373796 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260807 08:42:25.374388 25627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:25.374194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.195:44499)
0807 08:42:25.374281 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:25.374321 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 08:42:25.374557 25625 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 08:42:25.377015 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 25487
I20260807 08:42:26.055908 25629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:26.055506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.193:52509)
0807 08:42:26.055737 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:26.055791 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":79,"threads_started":1}
I20260807 08:42:26.202176 25630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:26.201775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.194:43367)
0807 08:42:26.202043 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:26.202090 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":108,"threads_started":1}
I20260807 08:42:26.375341 25631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:26.375005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.195:34489)
0807 08:42:26.375204 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:26.375249 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":62,"threads_started":1}
I20260807 08:42:26.686959 25632 raft_consensus.cc:482] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:42:26.687168 25632 raft_consensus.cc:504] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:26.688231 25632 leader_election.cc:288] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2a31e674dce4db491ac84136d40f921 (127.8.208.194:39983), a0a0fd2e062449acaf7aa542562ae69e (127.8.208.195:40293)
Aug 07 08:42:26 dist-test-slave-6nmv krb5kdc[23901](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092144, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for kudu/127.8.208.194@KRBTEST.COM
Aug 07 08:42:26 dist-test-slave-6nmv krb5kdc[23901](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092144, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for kudu/127.8.208.195@KRBTEST.COM
I20260807 08:42:26.701735 25634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:26.688477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:40293 (local address 127.8.208.193:49351)
0807 08:42:26.688984 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:26.688995 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:26.689066 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:26.690437 (+ 1371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:26.690440 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:26.690847 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:26.691266 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:26.691277 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:26.692492 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:26.692499 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:26.693405 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:26.693414 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:26.694130 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:26.694133 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:26.694299 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:26.695014 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:26.695025 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:26.696837 (+ 1812us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:26.699095 (+ 2258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:26.699100 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:26.699113 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:26.699544 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:26.699934 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:26.699937 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:26.699938 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:26.700126 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:26.700872 (+ 746us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:26.700894 (+ 22us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:26.701078 (+ 184us) client_negotiation.cc:769] Sending connection context
0807 08:42:26.701236 (+ 158us) client_negotiation.cc:240] Negotiation successful
0807 08:42:26.701509 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":426,"mutex_wait_us":114,"spinlock_wait_cycles":6528,"thread_start_us":72,"threads_started":1}
I20260807 08:42:26.701875 25636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:26.688714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:49351 (local address 127.8.208.195:40293)
0807 08:42:26.689110 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:26.689133 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:26.689169 (+ 36us) server_negotiation.cc:407] Connection header received
0807 08:42:26.689875 (+ 706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:26.689884 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:26.690192 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:26.690463 (+ 271us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:26.691409 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:26.692350 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:26.693518 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:26.694013 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:26.694158 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:26.697012 (+ 2854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:26.697016 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:26.697026 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:26.697050 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:26.698973 (+ 1923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:26.699655 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:26.699660 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:26.699665 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:26.699817 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:26.700242 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:26.700245 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:26.700247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:26.700752 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:26.700853 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:26.701390 (+ 537us) server_negotiation.cc:299] Negotiation successful
0807 08:42:26.701676 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":112,"threads_started":1}
I20260807 08:42:26.702224 25635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:26.688561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:40163 (local address 127.8.208.194:39983)
0807 08:42:26.688870 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:26.688917 (+ 47us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:26.688960 (+ 43us) server_negotiation.cc:407] Connection header received
0807 08:42:26.689637 (+ 677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:26.689647 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:26.690075 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:26.690294 (+ 219us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:26.691409 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:26.692351 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:26.693517 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:26.693989 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:26.694134 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:26.696716 (+ 2582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:26.696720 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:26.696730 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:26.696754 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:26.698973 (+ 2219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:26.699654 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:26.699660 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:26.699665 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:26.699817 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:26.700892 (+ 1075us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:26.700895 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:26.700896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:26.701235 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:26.701349 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:26.701726 (+ 377us) server_negotiation.cc:299] Negotiation successful
0807 08:42:26.702038 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":82,"threads_started":1}
I20260807 08:42:26.702694 25633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:26.688406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:39983 (local address 127.8.208.193:40163)
0807 08:42:26.688728 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:26.688742 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:26.688847 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:26.690384 (+ 1537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:26.690389 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:26.690854 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:26.691265 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:26.691277 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:26.692495 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:26.692505 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:26.693403 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:26.693411 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:26.694083 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:26.694088 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:26.694297 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:26.694969 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:26.694984 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:26.696515 (+ 1531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:26.699095 (+ 2580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:26.699100 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:26.699113 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:26.699544 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:26.699925 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:26.699928 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:26.699930 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:26.700126 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:26.701358 (+ 1232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:26.701361 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:26.701455 (+ 94us) client_negotiation.cc:769] Sending connection context
0807 08:42:26.701588 (+ 133us) client_negotiation.cc:240] Negotiation successful
0807 08:42:26.701692 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":85,"spinlock_wait_cycles":33664,"thread_start_us":68,"threads_started":1}
W20260807 08:42:26.704236 25216 leader_election.cc:341] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a0a0fd2e062449acaf7aa542562ae69e (127.8.208.195:40293): Not found: Tablet not found: 8f6fd5e9e28e42349b1ea44ba117d6a9
W20260807 08:42:26.705422 25217 leader_election.cc:341] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c2a31e674dce4db491ac84136d40f921 (127.8.208.194:39983): Not found: Tablet not found: 8f6fd5e9e28e42349b1ea44ba117d6a9
I20260807 08:42:26.705523 25217 leader_election.cc:302] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 954136526c744651881234fdba1585a3; no voters: a0a0fd2e062449acaf7aa542562ae69e, c2a31e674dce4db491ac84136d40f921
I20260807 08:42:26.705796 25632 raft_consensus.cc:2726] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 08:42:27.056945 25633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:27.056643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.193:44635)
0807 08:42:27.056783 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:27.056838 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 08:42:27.203245 25637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:27.202817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.194:35281)
0807 08:42:27.203104 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:27.203162 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":99,"threads_started":1}
I20260807 08:42:27.376420 25638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:27.375999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.195:37631)
0807 08:42:27.376262 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:27.376315 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":86,"threads_started":1}
I20260807 08:42:28.058262 25639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:28.057685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.193:36025)
0807 08:42:28.058078 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:28.058160 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":135,"threads_started":1}
I20260807 08:42:28.204444 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:28.203973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.194:48981)
0807 08:42:28.204303 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:28.204356 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":82,"threads_started":1}
I20260807 08:42:28.377509 25641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:28.377169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.195:33417)
0807 08:42:28.377377 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:28.377423 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":66,"threads_started":1}
I20260807 08:42:28.578187 25642 raft_consensus.cc:482] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:42:28.578320 25642 raft_consensus.cc:504] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:28.578701 25642 leader_election.cc:288] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2a31e674dce4db491ac84136d40f921 (127.8.208.194:39983), a0a0fd2e062449acaf7aa542562ae69e (127.8.208.195:40293)
W20260807 08:42:28.579723 25217 leader_election.cc:341] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c2a31e674dce4db491ac84136d40f921 (127.8.208.194:39983): Not found: Tablet not found: 8f6fd5e9e28e42349b1ea44ba117d6a9
W20260807 08:42:28.579828 25216 leader_election.cc:341] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a0a0fd2e062449acaf7aa542562ae69e (127.8.208.195:40293): Not found: Tablet not found: 8f6fd5e9e28e42349b1ea44ba117d6a9
I20260807 08:42:28.579923 25216 leader_election.cc:302] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 954136526c744651881234fdba1585a3; no voters: a0a0fd2e062449acaf7aa542562ae69e, c2a31e674dce4db491ac84136d40f921
I20260807 08:42:28.580080 25642 raft_consensus.cc:2726] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 08:42:29.059417 25643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:29.058933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.193:46111)
0807 08:42:29.059248 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:29.059300 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":75,"threads_started":1}
I20260807 08:42:29.205518 25644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:29.205132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.194:55685)
0807 08:42:29.205388 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:29.205437 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":79,"threads_started":1}
I20260807 08:42:29.378623 25645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:29.378267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.195:47243)
0807 08:42:29.378493 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:29.378544 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":70,"threads_started":1}
I20260807 08:42:30.060966 25646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:30.060434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.193:51471)
0807 08:42:30.060773 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:30.060844 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":77,"threads_started":1}
I20260807 08:42:30.206656 25647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:30.206230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.194:55005)
0807 08:42:30.206498 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:30.206568 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":91,"threads_started":1}
I20260807 08:42:30.379799 25648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:30.379280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.195:60809)
0807 08:42:30.379664 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:30.379717 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":102,"threads_started":1}
I20260807 08:42:31.062445 25649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:31.062029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.193:43477)
0807 08:42:31.062268 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:31.062332 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":74,"threads_started":1}
I20260807 08:42:31.207783 25650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:31.207373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.194:45457)
0807 08:42:31.207631 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:31.207680 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":91,"threads_started":1}
I20260807 08:42:31.380908 25651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:31.380562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.195:58193)
0807 08:42:31.380779 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:31.380828 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":67,"threads_started":1}
I20260807 08:42:31.423480 25652 raft_consensus.cc:482] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:42:31.423616 25652 raft_consensus.cc:504] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:31.424033 25652 leader_election.cc:288] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2a31e674dce4db491ac84136d40f921 (127.8.208.194:39983), a0a0fd2e062449acaf7aa542562ae69e (127.8.208.195:40293)
W20260807 08:42:31.424857 25217 leader_election.cc:341] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c2a31e674dce4db491ac84136d40f921 (127.8.208.194:39983): Not found: Tablet not found: 8f6fd5e9e28e42349b1ea44ba117d6a9
W20260807 08:42:31.424965 25216 leader_election.cc:341] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a0a0fd2e062449acaf7aa542562ae69e (127.8.208.195:40293): Not found: Tablet not found: 8f6fd5e9e28e42349b1ea44ba117d6a9
I20260807 08:42:31.425067 25216 leader_election.cc:302] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 954136526c744651881234fdba1585a3; no voters: a0a0fd2e062449acaf7aa542562ae69e, c2a31e674dce4db491ac84136d40f921
I20260807 08:42:31.425246 25652 raft_consensus.cc:2726] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 08:42:32.063653 25653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:32.063217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.193:43399)
0807 08:42:32.063494 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:32.063555 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":97,"threads_started":1}
I20260807 08:42:32.208911 25654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:32.208452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.194:45387)
0807 08:42:32.208763 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:32.208817 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":89,"threads_started":1}
I20260807 08:42:32.381965 25655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:32.381525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.195:38507)
0807 08:42:32.381806 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:32.381879 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":65,"threads_started":1}
I20260807 08:42:33.064813 25656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:33.064445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.193:37827)
0807 08:42:33.064677 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:33.064723 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":74,"threads_started":1}
I20260807 08:42:33.210179 25657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:33.209653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.194:57499)
0807 08:42:33.210010 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:33.210071 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":92,"threads_started":1}
I20260807 08:42:33.382963 25658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:33.382645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.195:46257)
0807 08:42:33.382840 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:33.382885 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":56,"threads_started":1}
I20260807 08:42:34.065964 25659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:34.065510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.193:52585)
0807 08:42:34.065778 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:34.065870 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":93,"threads_started":1}
I20260807 08:42:34.211195 25660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:34.210834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.194:50157)
0807 08:42:34.211070 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:34.211118 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":70,"threads_started":1}
I20260807 08:42:34.384136 25661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:34.383728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.195:56615)
0807 08:42:34.383990 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:34.384048 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":71,"threads_started":1}
I20260807 08:42:34.967018 25662 raft_consensus.cc:482] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:42:34.967137 25662 raft_consensus.cc:504] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:34.967607 25662 leader_election.cc:288] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2a31e674dce4db491ac84136d40f921 (127.8.208.194:39983), a0a0fd2e062449acaf7aa542562ae69e (127.8.208.195:40293)
W20260807 08:42:34.968286 25217 leader_election.cc:341] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c2a31e674dce4db491ac84136d40f921 (127.8.208.194:39983): Not found: Tablet not found: 8f6fd5e9e28e42349b1ea44ba117d6a9
W20260807 08:42:34.968395 25216 leader_election.cc:341] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a0a0fd2e062449acaf7aa542562ae69e (127.8.208.195:40293): Not found: Tablet not found: 8f6fd5e9e28e42349b1ea44ba117d6a9
I20260807 08:42:34.968508 25216 leader_election.cc:302] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 954136526c744651881234fdba1585a3; no voters: a0a0fd2e062449acaf7aa542562ae69e, c2a31e674dce4db491ac84136d40f921
I20260807 08:42:34.968734 25662 raft_consensus.cc:2726] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 08:42:35.067224 25664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:35.066777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.193:34297)
0807 08:42:35.067043 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:35.067109 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":100,"threads_started":1}
I20260807 08:42:35.212360 25665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:35.211969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.194:54767)
0807 08:42:35.212212 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:35.212274 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":88,"threads_started":1}
I20260807 08:42:35.385175 25666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:35.384805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.195:46969)
0807 08:42:35.385038 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:35.385087 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":84,"threads_started":1}
I20260807 08:42:36.068380 25667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:36.067930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.193:33917)
0807 08:42:36.068181 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:36.068246 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":68,"threads_started":1}
I20260807 08:42:36.213474 25668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:36.213087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.194:59205)
0807 08:42:36.213314 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:36.213368 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":71,"threads_started":1}
I20260807 08:42:36.386283 25670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:36.385867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.195:52091)
0807 08:42:36.386136 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:36.386194 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":85,"threads_started":1}
I20260807 08:42:37.069466 25671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:37.069084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.193:56399)
0807 08:42:37.069311 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:37.069363 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":76,"threads_started":1}
I20260807 08:42:37.214584 25672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:37.214190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.194:56987)
0807 08:42:37.214442 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:37.214492 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":71,"threads_started":1}
I20260807 08:42:37.387466 25673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:37.387085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.195:43111)
0807 08:42:37.387324 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:37.387373 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":92,"threads_started":1}
I20260807 08:42:38.070665 25674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:38.070245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.193:47307)
0807 08:42:38.070517 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:38.070569 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":95,"threads_started":1}
I20260807 08:42:38.215826 25675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:38.215332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.194:53529)
0807 08:42:38.215626 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:38.215713 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":109,"threads_started":1}
I20260807 08:42:38.388727 25676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:38.388217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.195:41631)
0807 08:42:38.388520 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:38.388580 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":84,"threads_started":1}
I20260807 08:42:39.071877 25677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:39.071441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.193:41603)
0807 08:42:39.071719 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:39.071776 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":82,"threads_started":1}
I20260807 08:42:39.217018 25678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:39.216542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.194:54391)
0807 08:42:39.216875 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:39.216925 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":145,"threads_started":1}
I20260807 08:42:39.389897 25679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:39.389455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.195:55093)
0807 08:42:39.389694 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:39.389745 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":85,"threads_started":1}
I20260807 08:42:40.071787 25680 raft_consensus.cc:482] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:42:40.071924 25680 raft_consensus.cc:504] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2a31e674dce4db491ac84136d40f921" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39983 } } peers { permanent_uuid: "a0a0fd2e062449acaf7aa542562ae69e" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 40293 } } peers { permanent_uuid: "954136526c744651881234fdba1585a3" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46495 } }
I20260807 08:42:40.072510 25680 leader_election.cc:288] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c2a31e674dce4db491ac84136d40f921 (127.8.208.194:39983), a0a0fd2e062449acaf7aa542562ae69e (127.8.208.195:40293)
I20260807 08:42:40.073351 25681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:40.072786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.193:52327)
0807 08:42:40.073175 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:40.073240 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":114,"threads_started":1}
W20260807 08:42:40.073316 25216 leader_election.cc:341] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a0a0fd2e062449acaf7aa542562ae69e (127.8.208.195:40293): Not found: Tablet not found: 8f6fd5e9e28e42349b1ea44ba117d6a9
W20260807 08:42:40.073568 25217 leader_election.cc:341] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c2a31e674dce4db491ac84136d40f921 (127.8.208.194:39983): Not found: Tablet not found: 8f6fd5e9e28e42349b1ea44ba117d6a9
I20260807 08:42:40.073659 25217 leader_election.cc:302] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 954136526c744651881234fdba1585a3; no voters: a0a0fd2e062449acaf7aa542562ae69e, c2a31e674dce4db491ac84136d40f921
I20260807 08:42:40.073859 25680 raft_consensus.cc:2726] T 8f6fd5e9e28e42349b1ea44ba117d6a9 P 954136526c744651881234fdba1585a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 08:42:40.218313 25682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:40.217890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.194:41643)
0807 08:42:40.218170 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:40.218223 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":87,"threads_started":1}
I20260807 08:42:40.384140 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 25159
I20260807 08:42:40.391155 25683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:40.390750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:43987 (local address 127.8.208.195:46871)
0807 08:42:40.391011 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:40.391067 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:43987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":79,"threads_started":1}
I20260807 08:42:40.393854 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 25338
I20260807 08:42:40.400653 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 25487
2026-08-07T08:42:40Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18928 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:42:40 dist-test-slave-6nmv krb5kdc[25686](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:42:40 dist-test-slave-6nmv krb5kdc[25686](info): set up 2 sockets
Aug 07 08:42:40 dist-test-slave-6nmv krb5kdc[25686](info): commencing operation
krb5kdc: starting...
W20260807 08:42:41.465037 9027 mini_kdc.cc:121] Time spent starting KDC: real 1.042s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:42:41 dist-test-slave-6nmv krb5kdc[25686](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092161, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:42:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:42:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:42:41.588313 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:36191
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:41351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:36191
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:42:41.700826 25701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:41.701130 25701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:41.701208 25701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:41.705186 25701 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 08:42:41.705267 25701 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 08:42:41.705297 25701 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 08:42:41.705331 25701 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:42:41.705374 25701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:41.705418 25701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:41.705477 25701 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:42:41.705520 25701 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:42:41.711397 25701 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:41351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:36191
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:36191
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:41.712456 25701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:41.713495 25701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:42:41.722082 25708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:41.722074 25710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:41.722074 25707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:41.722430 25701 server_base.cc:1034] running on GCE node
I20260807 08:42:41.722959 25701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:41.724027 25701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:41.725184 25701 hybrid_clock.cc:648] HybridClock initialized: now 1786092161725160 us; error 40 us; skew 500 ppm
Aug 07 08:42:41 dist-test-slave-6nmv krb5kdc[25686](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092161, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:41.727855 25701 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:42:41.728686 25701 webserver.cc:460] Webserver started at http://127.8.208.254:38563/ using document root <none> and password file <none>
I20260807 08:42:41.729254 25701 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:41.729344 25701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:42:41.729573 25701 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:42:41.731683 25701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "b613e818b8244abf87c22fd1a9302f34"
format_stamp: "Formatted at 2026-08-07 08:42:41 on dist-test-slave-6nmv"
server_key: "f03d00c5c9ceba8eafb0b3a0733199aa"
server_key_iv: "5c2993252cce8ec0db660f880fed2e33"
server_key_version: "encryptionkey@0"
I20260807 08:42:41.732246 25701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "b613e818b8244abf87c22fd1a9302f34"
format_stamp: "Formatted at 2026-08-07 08:42:41 on dist-test-slave-6nmv"
server_key: "f03d00c5c9ceba8eafb0b3a0733199aa"
server_key_iv: "5c2993252cce8ec0db660f880fed2e33"
server_key_version: "encryptionkey@0"
I20260807 08:42:41.735875 25701 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 08:42:41.738293 25718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:41.739482 25701 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:42:41.739619 25701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "b613e818b8244abf87c22fd1a9302f34"
format_stamp: "Formatted at 2026-08-07 08:42:41 on dist-test-slave-6nmv"
server_key: "f03d00c5c9ceba8eafb0b3a0733199aa"
server_key_iv: "5c2993252cce8ec0db660f880fed2e33"
server_key_version: "encryptionkey@0"
I20260807 08:42:41.739724 25701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:41.748842 25701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:41.751863 25701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:41.752058 25701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:41.758298 25701 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:36191
I20260807 08:42:41.758584 25772 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:36191 every 8 connection(s)
I20260807 08:42:41.759171 25701 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:42:41.761653 25773 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:42:41.764158 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 25701
I20260807 08:42:41.764277 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:42:41.764546 9027 external_mini_cluster.cc:1428] Setting key da172aefe3e490a4859a998a591bb380
I20260807 08:42:41.766875 25773 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34: Bootstrap starting.
I20260807 08:42:41.769281 25773 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34: Neither blocks nor log segments found. Creating new log.
I20260807 08:42:41.770121 25773 log.cc:824] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34: Log is configured to *not* fsync() on all Append() calls
I20260807 08:42:41.772091 25773 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34: No bootstrap required, opened a new log
Aug 07 08:42:41 dist-test-slave-6nmv krb5kdc[25686](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092161, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:42:41.775394 25773 raft_consensus.cc:348] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b613e818b8244abf87c22fd1a9302f34" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36191 } }
I20260807 08:42:41.775588 25773 raft_consensus.cc:374] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:42:41.775647 25773 raft_consensus.cc:729] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b613e818b8244abf87c22fd1a9302f34, State: Initialized, Role: FOLLOWER
I20260807 08:42:41.776063 25773 consensus_queue.cc:260] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b613e818b8244abf87c22fd1a9302f34" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36191 } }
I20260807 08:42:41.776178 25773 raft_consensus.cc:388] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:42:41.776265 25773 raft_consensus.cc:482] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:42:41.776382 25773 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:42:41.777467 25773 raft_consensus.cc:504] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b613e818b8244abf87c22fd1a9302f34" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36191 } }
I20260807 08:42:41.777815 25773 leader_election.cc:302] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b613e818b8244abf87c22fd1a9302f34; no voters:
I20260807 08:42:41.778206 25773 leader_election.cc:288] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:42:41.778294 25778 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:42:41.778563 25778 raft_consensus.cc:686] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [term 1 LEADER]: Becoming Leader. State: Replica: b613e818b8244abf87c22fd1a9302f34, State: Running, Role: LEADER
I20260807 08:42:41.778892 25778 consensus_queue.cc:237] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b613e818b8244abf87c22fd1a9302f34" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36191 } }
I20260807 08:42:41.779443 25773 sys_catalog.cc:564] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:42:41.779454 25776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:41.765718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49238 (local address 127.8.208.254:36191)
0807 08:42:41.766138 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:41.766156 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:41.766192 (+ 36us) server_negotiation.cc:407] Connection header received
0807 08:42:41.766931 (+ 739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:41.766952 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:41.767298 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:41.767624 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:41.768208 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:41.769572 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:41.770537 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:41.771068 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:41.771237 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:41.773955 (+ 2718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:41.773960 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:41.773971 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:41.773996 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:41.776360 (+ 2364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:41.776862 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:41.776866 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:41.776869 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:41.776977 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:41.777276 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:41.777278 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:41.777279 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:41.777695 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:41.777920 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:41.778217 (+ 297us) server_negotiation.cc:299] Negotiation successful
0807 08:42:41.778511 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":114,"threads_started":1}
I20260807 08:42:41.780604 25779 sys_catalog.cc:455] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b613e818b8244abf87c22fd1a9302f34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b613e818b8244abf87c22fd1a9302f34" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36191 } } }
I20260807 08:42:41.780735 25779 sys_catalog.cc:458] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [sys.catalog]: This master's current role is: LEADER
I20260807 08:42:41.781100 25780 sys_catalog.cc:455] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b613e818b8244abf87c22fd1a9302f34. Latest consensus state: current_term: 1 leader_uuid: "b613e818b8244abf87c22fd1a9302f34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b613e818b8244abf87c22fd1a9302f34" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36191 } } }
I20260807 08:42:41.781265 25780 sys_catalog.cc:458] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [sys.catalog]: This master's current role is: LEADER
I20260807 08:42:41.781988 25787 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:42:41.785212 25787 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:42:41.790755 25787 catalog_manager.cc:1347] Generated new cluster ID: 14b61493f3f9481ab8451681d621bc6a
I20260807 08:42:41.790848 25787 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:42:41.801684 25787 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:42:41.802598 25787 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:42:41.811467 25787 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34: Generated new TSK 0
I20260807 08:42:41.812166 25787 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.208.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
I20260807 08:42:41.844830 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:36191
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:41351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:42:41.967295 25800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:41.967550 25800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:41.967592 25800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:41.971396 25800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:41.971448 25800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:41.971540 25800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:42:41.976552 25800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:41351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:36191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25800
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:41.977499 25800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:41.978516 25800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:42:41.988289 25808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:41.988323 25806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:41.988423 25800 server_base.cc:1034] running on GCE node
W20260807 08:42:41.988341 25805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:41.988903 25800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:41.989539 25800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:41.990726 25800 hybrid_clock.cc:648] HybridClock initialized: now 1786092161990701 us; error 42 us; skew 500 ppm
Aug 07 08:42:41 dist-test-slave-6nmv krb5kdc[25686](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092161, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:41.993556 25800 init.cc:377] Logged in from keytab as kudu/127.8.208.193@KRBTEST.COM (short username kudu)
I20260807 08:42:41.994479 25800 webserver.cc:460] Webserver started at http://127.8.208.193:34049/ using document root <none> and password file <none>
I20260807 08:42:41.995021 25800 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:41.995112 25800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:42:41.995338 25800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:42:41.997459 25800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "da9e594e7bc949828050f45546d32b0b"
format_stamp: "Formatted at 2026-08-07 08:42:41 on dist-test-slave-6nmv"
server_key: "9d257e5e86a400c6e37068bf1fbba4ee"
server_key_iv: "e511cc60494dcb3368e7759881523b82"
server_key_version: "encryptionkey@0"
I20260807 08:42:41.998072 25800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "da9e594e7bc949828050f45546d32b0b"
format_stamp: "Formatted at 2026-08-07 08:42:41 on dist-test-slave-6nmv"
server_key: "9d257e5e86a400c6e37068bf1fbba4ee"
server_key_iv: "e511cc60494dcb3368e7759881523b82"
server_key_version: "encryptionkey@0"
I20260807 08:42:42.001605 25800 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 08:42:42.004050 25816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:42.005327 25800 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:42:42.005475 25800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "da9e594e7bc949828050f45546d32b0b"
format_stamp: "Formatted at 2026-08-07 08:42:41 on dist-test-slave-6nmv"
server_key: "9d257e5e86a400c6e37068bf1fbba4ee"
server_key_iv: "e511cc60494dcb3368e7759881523b82"
server_key_version: "encryptionkey@0"
I20260807 08:42:42.005585 25800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:42.021891 25800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:42.024504 25800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:42.024688 25800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:42.025272 25800 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:42:42.026150 25800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:42:42.026199 25800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:42.026263 25800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:42:42.026295 25800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:42.035121 25800 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:46071
I20260807 08:42:42.035197 25937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:46071 every 8 connection(s)
I20260807 08:42:42.036082 25800 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:42:42.045143 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 25800
I20260807 08:42:42.045315 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
Aug 07 08:42:42 dist-test-slave-6nmv krb5kdc[25686](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092161, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:42:42.045665 9027 external_mini_cluster.cc:1428] Setting key b70f5474ac8e2aecc95a429535918ec4
I20260807 08:42:42.050166 25776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:42.037852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:48901 (local address 127.8.208.254:36191)
0807 08:42:42.037986 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:42.037990 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:42.038786 (+ 796us) server_negotiation.cc:407] Connection header received
0807 08:42:42.040060 (+ 1274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:42.040063 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:42.040128 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:42.040235 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:42.041351 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.041973 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.043165 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.043401 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.043515 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:42.046283 (+ 2768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:42.046287 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:42.046290 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:42.046318 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:42.047845 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:42.048451 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:42.048454 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:42.048455 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:42.048547 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:42.048967 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:42.048969 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:42.048971 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:42.049155 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:42.049267 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:42.049785 (+ 518us) server_negotiation.cc:299] Negotiation successful
0807 08:42:42.049955 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 08:42:42.050836 25940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:42.038187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.193:48901)
0807 08:42:42.038613 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:42.038653 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:42.039850 (+ 1197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:42.040414 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:42.040420 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:42.040762 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:42.041198 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:42.041210 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.042103 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.042111 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:42.043027 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:42.043038 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.043553 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.043557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:42.043721 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:42.044332 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:42.044347 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:42.046107 (+ 1760us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:42.047961 (+ 1854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:42.047970 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:42.047986 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:42.048345 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:42.048648 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:42.048653 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:42.048658 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:42.048841 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:42.049277 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:42.049287 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:42.049554 (+ 267us) client_negotiation.cc:769] Sending connection context
0807 08:42:42.049705 (+ 151us) client_negotiation.cc:240] Negotiation successful
0807 08:42:42.050002 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":141,"threads_started":1}
I20260807 08:42:42.052042 25938 heartbeater.cc:347] Connected to a master server at 127.8.208.254:36191
I20260807 08:42:42.052290 25938 heartbeater.cc:464] Registering TS with master...
I20260807 08:42:42.052853 25938 heartbeater.cc:511] Master 127.8.208.254:36191 requested a full tablet report, sending...
I20260807 08:42:42.054566 25735 ts_manager.cc:194] Registered new tserver with Master: da9e594e7bc949828050f45546d32b0b (127.8.208.193:46071)
I20260807 08:42:42.056164 25735 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.193@KRBTEST.COM'} at 127.8.208.193:48901
WARNING: no policy specified for kudu/127.8.208.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
I20260807 08:42:42.074240 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:36191
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:41351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:42:42.183684 25943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:42.183970 25943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:42.184051 25943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:42.187981 25943 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:42.188078 25943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:42.188170 25943 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:42:42.193384 25943 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:41351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:36191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25943
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:42.194481 25943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:42.195521 25943 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:42:42.205382 25948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:42.205426 25951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:42.205421 25949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:42.205565 25943 server_base.cc:1034] running on GCE node
I20260807 08:42:42.206096 25943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:42.206696 25943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:42.207862 25943 hybrid_clock.cc:648] HybridClock initialized: now 1786092162207847 us; error 31 us; skew 500 ppm
Aug 07 08:42:42 dist-test-slave-6nmv krb5kdc[25686](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092162, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:42.210784 25943 init.cc:377] Logged in from keytab as kudu/127.8.208.194@KRBTEST.COM (short username kudu)
I20260807 08:42:42.211700 25943 webserver.cc:460] Webserver started at http://127.8.208.194:43665/ using document root <none> and password file <none>
I20260807 08:42:42.212280 25943 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:42.212338 25943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:42:42.212553 25943 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:42:42.214603 25943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "32f49284d7bc404ebc3afa369601d82b"
format_stamp: "Formatted at 2026-08-07 08:42:42 on dist-test-slave-6nmv"
server_key: "d7bd89cf54a994a1139413b68458f889"
server_key_iv: "763d6fec784e09418689bf95d5dc220e"
server_key_version: "encryptionkey@0"
I20260807 08:42:42.215175 25943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "32f49284d7bc404ebc3afa369601d82b"
format_stamp: "Formatted at 2026-08-07 08:42:42 on dist-test-slave-6nmv"
server_key: "d7bd89cf54a994a1139413b68458f889"
server_key_iv: "763d6fec784e09418689bf95d5dc220e"
server_key_version: "encryptionkey@0"
I20260807 08:42:42.218827 25943 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 08:42:42.221164 25960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:42.222463 25943 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:42:42.222605 25943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "32f49284d7bc404ebc3afa369601d82b"
format_stamp: "Formatted at 2026-08-07 08:42:42 on dist-test-slave-6nmv"
server_key: "d7bd89cf54a994a1139413b68458f889"
server_key_iv: "763d6fec784e09418689bf95d5dc220e"
server_key_version: "encryptionkey@0"
I20260807 08:42:42.222716 25943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:42.242488 25943 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:42.245580 25943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:42.245790 25943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:42.246448 25943 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:42:42.247269 25943 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:42:42.247335 25943 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:42.247400 25943 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:42:42.247452 25943 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:42.256337 25943 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:33391
I20260807 08:42:42.256366 26080 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:33391 every 8 connection(s)
I20260807 08:42:42.257302 25943 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:42:42.260425 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 25943
I20260807 08:42:42.260586 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:42:42.260885 9027 external_mini_cluster.cc:1428] Setting key fd97a3e57e83be8b39be399cae72d2a3
Aug 07 08:42:42 dist-test-slave-6nmv krb5kdc[25686](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092162, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.208.195@KRBTEST.COM; defaulting to no policy
I20260807 08:42:42.272490 25776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:42.259243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:42725 (local address 127.8.208.254:36191)
0807 08:42:42.259424 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:42.259428 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:42.260246 (+ 818us) server_negotiation.cc:407] Connection header received
0807 08:42:42.261669 (+ 1423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:42.261673 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:42.261745 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:42.261878 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:42.263035 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.263578 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.265234 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.265463 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.265585 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:42.268457 (+ 2872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:42.268464 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:42.268469 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:42.268507 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:42.270268 (+ 1761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:42.270772 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:42.270776 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:42.270778 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:42.270881 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:42.271250 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:42.271255 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:42.271258 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:42.271544 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:42.271682 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:42.272239 (+ 557us) server_negotiation.cc:299] Negotiation successful
0807 08:42:42.272353 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 08:42:42.273367 26084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:42.259618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.194:42725)
0807 08:42:42.260080 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:42.260123 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:42.261450 (+ 1327us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:42.262053 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:42.262059 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:42.262425 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:42.262897 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:42.262909 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.263710 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.263714 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:42.265073 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:42.265085 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.265625 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.265630 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:42.265799 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:42.266487 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:42.266503 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:42.268270 (+ 1767us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:42.270386 (+ 2116us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:42.270402 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:42.270414 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:42.270672 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:42.270989 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:42.270992 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:42.270995 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:42.271145 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:42.271695 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:42.271699 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:42.271973 (+ 274us) client_negotiation.cc:769] Sending connection context
0807 08:42:42.272146 (+ 173us) client_negotiation.cc:240] Negotiation successful
0807 08:42:42.272404 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":114,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.195@KRBTEST.COM" created.
I20260807 08:42:42.274701 26081 heartbeater.cc:347] Connected to a master server at 127.8.208.254:36191
I20260807 08:42:42.274958 26081 heartbeater.cc:464] Registering TS with master...
I20260807 08:42:42.275408 26081 heartbeater.cc:511] Master 127.8.208.254:36191 requested a full tablet report, sending...
I20260807 08:42:42.276453 25735 ts_manager.cc:194] Registered new tserver with Master: 32f49284d7bc404ebc3afa369601d82b (127.8.208.194:33391)
I20260807 08:42:42.277093 25735 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.194@KRBTEST.COM'} at 127.8.208.194:42725
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
I20260807 08:42:42.292783 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:36191
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:41351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:42:42.406025 26087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:42:42.406242 26087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:42:42.406278 26087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:42:42.409817 26087 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:42:42.409920 26087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:42:42.410041 26087 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:42:42.414718 26087 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:41351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:36191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26087
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:42:42.415580 26087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:42:42.416445 26087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:42:42.425524 26092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:42:42.425638 26093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:42.425565 26087 server_base.cc:1034] running on GCE node
W20260807 08:42:42.425506 26095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:42:42.426155 26087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:42:42.426735 26087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:42:42.427904 26087 hybrid_clock.cc:648] HybridClock initialized: now 1786092162427883 us; error 33 us; skew 500 ppm
Aug 07 08:42:42 dist-test-slave-6nmv krb5kdc[25686](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092162, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:42:42.430496 26087 init.cc:377] Logged in from keytab as kudu/127.8.208.195@KRBTEST.COM (short username kudu)
I20260807 08:42:42.431200 26087 webserver.cc:460] Webserver started at http://127.8.208.195:38055/ using document root <none> and password file <none>
I20260807 08:42:42.431699 26087 fs_manager.cc:359] Metadata directory not provided
I20260807 08:42:42.431756 26087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:42:42.431907 26087 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:42:42.433951 26087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "89fb5afa863d48bea21183245dc6b08a"
format_stamp: "Formatted at 2026-08-07 08:42:42 on dist-test-slave-6nmv"
server_key: "c2c051f01c0c5cfafbb2b965f6d8d56a"
server_key_iv: "b83a90e9015ceedb6b157d2daa141250"
server_key_version: "encryptionkey@0"
I20260807 08:42:42.434559 26087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "89fb5afa863d48bea21183245dc6b08a"
format_stamp: "Formatted at 2026-08-07 08:42:42 on dist-test-slave-6nmv"
server_key: "c2c051f01c0c5cfafbb2b965f6d8d56a"
server_key_iv: "b83a90e9015ceedb6b157d2daa141250"
server_key_version: "encryptionkey@0"
I20260807 08:42:42.438532 26087 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 08:42:42.440801 26104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:42.442085 26087 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:42:42.442219 26087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "89fb5afa863d48bea21183245dc6b08a"
format_stamp: "Formatted at 2026-08-07 08:42:42 on dist-test-slave-6nmv"
server_key: "c2c051f01c0c5cfafbb2b965f6d8d56a"
server_key_iv: "b83a90e9015ceedb6b157d2daa141250"
server_key_version: "encryptionkey@0"
I20260807 08:42:42.442323 26087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:42:42.484071 26087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:42:42.486851 26087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:42:42.487018 26087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:42:42.487551 26087 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:42:42.488314 26087 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:42:42.488360 26087 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:42.488399 26087 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:42:42.488415 26087 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:42:42.498005 26087 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:41079
I20260807 08:42:42.498036 26226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:41079 every 8 connection(s)
I20260807 08:42:42.498872 26087 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:42:42.500236 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 26087
I20260807 08:42:42.500379 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:42:42.500734 9027 external_mini_cluster.cc:1428] Setting key e8ea7bda362676d0d198934fdcf2ff40
Aug 07 08:42:42 dist-test-slave-6nmv krb5kdc[25686](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092162, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:42:42.512188 25776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:42.500713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:42261 (local address 127.8.208.254:36191)
0807 08:42:42.500839 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:42.500843 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:42.501934 (+ 1091us) server_negotiation.cc:407] Connection header received
0807 08:42:42.503373 (+ 1439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:42.503375 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:42.503418 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:42.503491 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:42.504712 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.505241 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.506353 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.506555 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.506628 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:42.508869 (+ 2241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:42.508872 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:42.508874 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:42.508896 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:42.510327 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:42.510823 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:42.510825 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:42.510826 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:42.510894 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:42.511280 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:42.511282 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:42.511283 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:42.511461 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:42.511533 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:42.511981 (+ 448us) server_negotiation.cc:299] Negotiation successful
0807 08:42:42.512075 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 08:42:42.512967 26229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:42.501128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.195:42261)
0807 08:42:42.501559 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:42.501616 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:42.503189 (+ 1573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:42.503725 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:42.503733 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:42.504113 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:42:42.504586 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:42.504600 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.505343 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.505345 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:42.506252 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:42.506261 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.506673 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.506676 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:42.506810 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:42.507286 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:42:42.507301 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:42:42.508734 (+ 1433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:42:42.510458 (+ 1724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:42.510461 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:42.510471 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:42.510731 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:42.511064 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:42:42.511067 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:42:42.511068 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:42:42.511198 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:42:42.511546 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:42:42.511551 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:42:42.511777 (+ 226us) client_negotiation.cc:769] Sending connection context
0807 08:42:42.511923 (+ 146us) client_negotiation.cc:240] Negotiation successful
0807 08:42:42.512142 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":133,"threads_started":1}
I20260807 08:42:42.514186 26227 heartbeater.cc:347] Connected to a master server at 127.8.208.254:36191
I20260807 08:42:42.514412 26227 heartbeater.cc:464] Registering TS with master...
I20260807 08:42:42.514889 26227 heartbeater.cc:511] Master 127.8.208.254:36191 requested a full tablet report, sending...
I20260807 08:42:42.515774 25734 ts_manager.cc:194] Registered new tserver with Master: 89fb5afa863d48bea21183245dc6b08a (127.8.208.195:41079)
I20260807 08:42:42.516287 25734 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.195@KRBTEST.COM'} at 127.8.208.195:42261
I20260807 08:42:42.526342 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 08:42:42.535059 25776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:42.528437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49248 (local address 127.8.208.254:36191)
0807 08:42:42.528559 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:42.528563 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:42.528724 (+ 161us) server_negotiation.cc:407] Connection header received
0807 08:42:42.528818 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:42.528820 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:42.528852 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:42.528914 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:42:42.529601 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.530154 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.530924 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.531124 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.531194 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:42.532483 (+ 1289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:42:42.532485 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:42:42.532487 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:42:42.532504 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:42:42.533670 (+ 1166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:42.534091 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:42.534093 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:42.534094 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:42.534166 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:42:42.534388 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:42:42.534390 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:42:42.534392 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:42:42.534578 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:42:42.534673 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:42.534864 (+ 191us) server_negotiation.cc:299] Negotiation successful
0807 08:42:42.534957 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 08:42:42.537724 25734 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49248:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 08:42:42.540581 25734 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:42:42.554030 26241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:42.548528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55858 (local address 127.8.208.195:41079)
0807 08:42:42.549685 (+ 1157us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:42.549699 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:42.549749 (+ 50us) server_negotiation.cc:407] Connection header received
0807 08:42:42.549854 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:42.549860 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:42.550057 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:42.550210 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:42:42.550505 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.551319 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.552804 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.553326 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.553448 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:42.553584 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:42.553772 (+ 188us) server_negotiation.cc:299] Negotiation successful
0807 08:42:42.553895 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1061,"thread_start_us":135,"threads_started":1}
I20260807 08:42:42.554023 26240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:42.548437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:41079 (local address 127.0.0.1:55858)
0807 08:42:42.549225 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:42.549288 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:42.549416 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:42.550221 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:42.550226 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:42.550248 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:42:42.550395 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:42.550405 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.551467 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.551470 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:42.552670 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:42.552680 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.553458 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.553461 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:42.553571 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:42.553613 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 08:42:42.553744 (+ 131us) client_negotiation.cc:240] Negotiation successful
0807 08:42:42.553886 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":407,"mutex_wait_us":3,"spinlock_wait_cycles":3200,"thread_start_us":63,"threads_started":1}
I20260807 08:42:42.555011 26243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:42.549164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59856 (local address 127.8.208.194:33391)
0807 08:42:42.549995 (+ 831us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:42.550004 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:42.550023 (+ 19us) server_negotiation.cc:407] Connection header received
0807 08:42:42.550081 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:42.550084 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:42.550269 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:42.550555 (+ 286us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:42:42.550675 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.551958 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.553589 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.554382 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.554535 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:42.554643 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:42.554784 (+ 141us) server_negotiation.cc:299] Negotiation successful
0807 08:42:42.554870 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":747,"thread_start_us":149,"threads_started":1}
I20260807 08:42:42.555274 26244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:42.549563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37708 (local address 127.8.208.193:46071)
0807 08:42:42.549913 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:42.549927 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:42.549954 (+ 27us) server_negotiation.cc:407] Connection header received
0807 08:42:42.550020 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:42.550025 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:42.550182 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:42.550306 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:42:42.550822 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.551911 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.553589 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.554397 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.554505 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:42.554635 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:42.555056 (+ 421us) server_negotiation.cc:299] Negotiation successful
0807 08:42:42.555145 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":133,"threads_started":1}
I20260807 08:42:42.555469 26239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:42.548540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:33391 (local address 127.0.0.1:59856)
0807 08:42:42.549625 (+ 1085us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:42.549641 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:42.549729 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:42.550421 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:42.550449 (+ 28us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:42.550471 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:42:42.550581 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:42.550588 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.552091 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.552093 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:42.553446 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:42.553457 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.554548 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.554552 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:42.554636 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:42.554670 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 08:42:42.554744 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 08:42:42.554807 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"mutex_wait_us":120,"thread_start_us":95,"threads_started":1}
I20260807 08:42:42.555622 26242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:42.548821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:46071 (local address 127.0.0.1:37708)
0807 08:42:42.549293 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:42.549305 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:42.549416 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:42.550384 (+ 968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:42.550387 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:42.550404 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:42:42.550706 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:42.550712 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.552066 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.552072 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:42.553446 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:42.553457 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.554714 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.554739 (+ 25us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:42.554828 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:42.554848 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 08:42:42.554914 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 08:42:42.554983 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":401,"mutex_wait_us":115,"spinlock_wait_cycles":6144,"thread_start_us":81,"threads_started":1}
I20260807 08:42:42.556998 26157 tablet_service.cc:1467] Processing CreateTablet for tablet fd71ac3f99cd40cdb9274d5824328294 (DEFAULT_TABLE table=test-table [id=e9c6aa97f0fb4993976d746a79d813b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:42:42.557968 26157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd71ac3f99cd40cdb9274d5824328294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:42:42.558051 26013 tablet_service.cc:1467] Processing CreateTablet for tablet fd71ac3f99cd40cdb9274d5824328294 (DEFAULT_TABLE table=test-table [id=e9c6aa97f0fb4993976d746a79d813b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:42:42.558048 25867 tablet_service.cc:1467] Processing CreateTablet for tablet fd71ac3f99cd40cdb9274d5824328294 (DEFAULT_TABLE table=test-table [id=e9c6aa97f0fb4993976d746a79d813b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:42:42.558997 26013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd71ac3f99cd40cdb9274d5824328294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:42:42.558997 25867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd71ac3f99cd40cdb9274d5824328294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:42:42.564561 26246 tablet_bootstrap.cc:492] T fd71ac3f99cd40cdb9274d5824328294 P 89fb5afa863d48bea21183245dc6b08a: Bootstrap starting.
I20260807 08:42:42.565332 26247 tablet_bootstrap.cc:492] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b: Bootstrap starting.
I20260807 08:42:42.566186 26248 tablet_bootstrap.cc:492] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b: Bootstrap starting.
I20260807 08:42:42.567087 26246 tablet_bootstrap.cc:654] T fd71ac3f99cd40cdb9274d5824328294 P 89fb5afa863d48bea21183245dc6b08a: Neither blocks nor log segments found. Creating new log.
I20260807 08:42:42.567389 26247 tablet_bootstrap.cc:654] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b: Neither blocks nor log segments found. Creating new log.
I20260807 08:42:42.567910 26246 log.cc:824] T fd71ac3f99cd40cdb9274d5824328294 P 89fb5afa863d48bea21183245dc6b08a: Log is configured to *not* fsync() on all Append() calls
I20260807 08:42:42.568018 26248 tablet_bootstrap.cc:654] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b: Neither blocks nor log segments found. Creating new log.
I20260807 08:42:42.568070 26247 log.cc:824] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b: Log is configured to *not* fsync() on all Append() calls
I20260807 08:42:42.568912 26248 log.cc:824] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b: Log is configured to *not* fsync() on all Append() calls
I20260807 08:42:42.569979 26246 tablet_bootstrap.cc:492] T fd71ac3f99cd40cdb9274d5824328294 P 89fb5afa863d48bea21183245dc6b08a: No bootstrap required, opened a new log
I20260807 08:42:42.570046 26247 tablet_bootstrap.cc:492] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b: No bootstrap required, opened a new log
I20260807 08:42:42.570163 26246 ts_tablet_manager.cc:1397] T fd71ac3f99cd40cdb9274d5824328294 P 89fb5afa863d48bea21183245dc6b08a: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 08:42:42.570281 26247 ts_tablet_manager.cc:1397] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260807 08:42:42.570837 26248 tablet_bootstrap.cc:492] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b: No bootstrap required, opened a new log
I20260807 08:42:42.571013 26248 ts_tablet_manager.cc:1397] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 08:42:42.573516 26247 raft_consensus.cc:348] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:42:42.573741 26247 raft_consensus.cc:374] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:42:42.573814 26247 raft_consensus.cc:729] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da9e594e7bc949828050f45546d32b0b, State: Initialized, Role: FOLLOWER
I20260807 08:42:42.573958 26246 raft_consensus.cc:348] T fd71ac3f99cd40cdb9274d5824328294 P 89fb5afa863d48bea21183245dc6b08a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:42:42.574210 26246 raft_consensus.cc:374] T fd71ac3f99cd40cdb9274d5824328294 P 89fb5afa863d48bea21183245dc6b08a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:42:42.574316 26246 raft_consensus.cc:729] T fd71ac3f99cd40cdb9274d5824328294 P 89fb5afa863d48bea21183245dc6b08a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89fb5afa863d48bea21183245dc6b08a, State: Initialized, Role: FOLLOWER
I20260807 08:42:42.574313 26247 consensus_queue.cc:260] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:42:42.574754 26246 consensus_queue.cc:260] T fd71ac3f99cd40cdb9274d5824328294 P 89fb5afa863d48bea21183245dc6b08a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:42:42.574664 26248 raft_consensus.cc:348] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:42:42.574892 26248 raft_consensus.cc:374] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:42:42.574947 25938 heartbeater.cc:503] Master 127.8.208.254:36191 was elected leader, sending a full tablet report...
I20260807 08:42:42.574995 26248 raft_consensus.cc:729] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32f49284d7bc404ebc3afa369601d82b, State: Initialized, Role: FOLLOWER
I20260807 08:42:42.575304 26247 ts_tablet_manager.cc:1428] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260807 08:42:42.575423 26248 consensus_queue.cc:260] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:42:42.575763 26246 ts_tablet_manager.cc:1428] T fd71ac3f99cd40cdb9274d5824328294 P 89fb5afa863d48bea21183245dc6b08a: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 08:42:42.576064 26227 heartbeater.cc:503] Master 127.8.208.254:36191 was elected leader, sending a full tablet report...
I20260807 08:42:42.576434 26248 ts_tablet_manager.cc:1428] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b: Time spent starting tablet: real 0.005s user 0.001s sys 0.004s
I20260807 08:42:42.576774 26081 heartbeater.cc:503] Master 127.8.208.254:36191 was elected leader, sending a full tablet report...
W20260807 08:42:42.749891 26228 tablet.cc:2369] T fd71ac3f99cd40cdb9274d5824328294 P 89fb5afa863d48bea21183245dc6b08a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 08:42:42.758508 26082 tablet.cc:2369] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 08:42:42.762965 26254 raft_consensus.cc:482] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:42:42.763144 26254 raft_consensus.cc:504] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:42:42.764190 26254 leader_election.cc:288] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89fb5afa863d48bea21183245dc6b08a (127.8.208.195:41079), da9e594e7bc949828050f45546d32b0b (127.8.208.193:46071)
I20260807 08:42:42.768337 26241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:42.764827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:49141 (local address 127.8.208.195:41079)
0807 08:42:42.764949 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:42.764953 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:42.764966 (+ 13us) server_negotiation.cc:407] Connection header received
0807 08:42:42.765017 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:42.765019 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:42.765052 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:42.765143 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:42:42.765463 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.766229 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.767459 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.767827 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.767956 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:42.768007 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:42.768168 (+ 161us) server_negotiation.cc:299] Negotiation successful
0807 08:42:42.768239 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 08:42:42.768337 26084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:42.764402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:41079 (local address 127.8.208.194:49141)
0807 08:42:42.764640 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:42.764653 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:42.764732 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:42.765218 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:42.765220 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:42.765234 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:42:42.765330 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:42.765335 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.766338 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.766341 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:42.767358 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:42.767367 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.767944 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.767948 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:42.768040 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:42.768066 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 08:42:42.768149 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 08:42:42.768217 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":37}
I20260807 08:42:42.768594 26244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:42.764579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:39615 (local address 127.8.208.193:46071)
0807 08:42:42.764705 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:42.764709 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:42.764864 (+ 155us) server_negotiation.cc:407] Connection header received
0807 08:42:42.764988 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:42.764990 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:42.765037 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:42.765102 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:42:42.765394 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.765958 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.767419 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.767989 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.768091 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:42.768133 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:42.768409 (+ 276us) server_negotiation.cc:299] Negotiation successful
0807 08:42:42.768486 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 08:42:42.768905 26255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:42.764430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:46071 (local address 127.8.208.194:39615)
0807 08:42:42.764749 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:42.764764 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 08:42:42.764868 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:42:42.765142 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:42:42.765144 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:42:42.765159 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:42:42.765277 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:42.765282 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.766069 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.766074 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:42.767294 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:42:42.767303 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.768188 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.768191 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:42:42.768284 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:42.768304 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 08:42:42.768714 (+ 410us) client_negotiation.cc:240] Negotiation successful
0807 08:42:42.768782 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"mutex_wait_us":44,"thread_start_us":85,"threads_started":1}
I20260807 08:42:42.769022 26179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd71ac3f99cd40cdb9274d5824328294" candidate_uuid: "32f49284d7bc404ebc3afa369601d82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89fb5afa863d48bea21183245dc6b08a" is_pre_election: true
I20260807 08:42:42.769346 26179 raft_consensus.cc:2454] T fd71ac3f99cd40cdb9274d5824328294 P 89fb5afa863d48bea21183245dc6b08a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32f49284d7bc404ebc3afa369601d82b in term 0.
I20260807 08:42:42.769517 25889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd71ac3f99cd40cdb9274d5824328294" candidate_uuid: "32f49284d7bc404ebc3afa369601d82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9e594e7bc949828050f45546d32b0b" is_pre_election: true
I20260807 08:42:42.769784 25889 raft_consensus.cc:2454] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32f49284d7bc404ebc3afa369601d82b in term 0.
I20260807 08:42:42.769891 25962 leader_election.cc:302] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32f49284d7bc404ebc3afa369601d82b, 89fb5afa863d48bea21183245dc6b08a; no voters:
I20260807 08:42:42.770148 26254 raft_consensus.cc:2781] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:42:42.770264 26254 raft_consensus.cc:482] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:42:42.770347 26254 raft_consensus.cc:3037] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:42:42.771413 26254 raft_consensus.cc:504] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:42:42.771781 26254 leader_election.cc:288] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b [CANDIDATE]: Term 1 election: Requested vote from peers 89fb5afa863d48bea21183245dc6b08a (127.8.208.195:41079), da9e594e7bc949828050f45546d32b0b (127.8.208.193:46071)
I20260807 08:42:42.772092 26179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd71ac3f99cd40cdb9274d5824328294" candidate_uuid: "32f49284d7bc404ebc3afa369601d82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89fb5afa863d48bea21183245dc6b08a"
I20260807 08:42:42.772118 25889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd71ac3f99cd40cdb9274d5824328294" candidate_uuid: "32f49284d7bc404ebc3afa369601d82b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9e594e7bc949828050f45546d32b0b"
I20260807 08:42:42.772212 25889 raft_consensus.cc:3037] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:42:42.772212 26179 raft_consensus.cc:3037] T fd71ac3f99cd40cdb9274d5824328294 P 89fb5afa863d48bea21183245dc6b08a [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:42:42.773430 26179 raft_consensus.cc:2454] T fd71ac3f99cd40cdb9274d5824328294 P 89fb5afa863d48bea21183245dc6b08a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32f49284d7bc404ebc3afa369601d82b in term 1.
I20260807 08:42:42.773432 25889 raft_consensus.cc:2454] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32f49284d7bc404ebc3afa369601d82b in term 1.
I20260807 08:42:42.773742 25963 leader_election.cc:302] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 32f49284d7bc404ebc3afa369601d82b, 89fb5afa863d48bea21183245dc6b08a, da9e594e7bc949828050f45546d32b0b; no voters:
I20260807 08:42:42.773975 26254 raft_consensus.cc:2781] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:42:42.774190 26254 raft_consensus.cc:686] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b [term 1 LEADER]: Becoming Leader. State: Replica: 32f49284d7bc404ebc3afa369601d82b, State: Running, Role: LEADER
I20260807 08:42:42.774531 26254 consensus_queue.cc:237] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:42:42.777403 25734 catalog_manager.cc:5495] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b reported cstate change: term changed from 0 to 1, leader changed from <none> to 32f49284d7bc404ebc3afa369601d82b (127.8.208.194). New cstate: current_term: 1 leader_uuid: "32f49284d7bc404ebc3afa369601d82b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } health_report { overall_health: UNKNOWN } } }
W20260807 08:42:42.787417 25939 tablet.cc:2369] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 08:42:42.842975 26243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:42.839659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59868 (local address 127.8.208.194:33391)
0807 08:42:42.839787 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 08:42:42.839791 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:42:42.839806 (+ 15us) server_negotiation.cc:407] Connection header received
0807 08:42:42.839881 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:42:42.839883 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:42:42.839940 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:42:42.840043 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:42:42.840258 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.840786 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.841580 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:42:42.841775 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:42:42.841884 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:42:42.842227 (+ 343us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:42:42.842613 (+ 386us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:42:42.842695 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 08:42:42.842803 (+ 108us) server_negotiation.cc:299] Negotiation successful
0807 08:42:42.842849 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 08:42:42.848503 25889 raft_consensus.cc:1261] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Refusing update from remote peer 32f49284d7bc404ebc3afa369601d82b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:42:42.848502 26179 raft_consensus.cc:1261] T fd71ac3f99cd40cdb9274d5824328294 P 89fb5afa863d48bea21183245dc6b08a [term 1 FOLLOWER]: Refusing update from remote peer 32f49284d7bc404ebc3afa369601d82b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:42:42.849210 26254 consensus_queue.cc:1035] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:42:42.849438 26256 consensus_queue.cc:1035] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b [LEADER]: Connected to new peer: Peer: permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:42:42.859313 26261 mvcc.cc:205] Tried to move back new op lower bound from 7315833499020099584 to 7315833498726690816. Current Snapshot: MvccSnapshot[applied={T|T < 7315833499020099584 or (T in {7315833499020099584})}]
I20260807 08:42:42.866614 25735 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49248:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:42:42.866750 25735 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49248:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:42:42.869228 25735 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34: Sending DeleteTablet for 3 replicas of tablet fd71ac3f99cd40cdb9274d5824328294
I20260807 08:42:42.870076 26157 tablet_service.cc:1514] Processing DeleteTablet for tablet fd71ac3f99cd40cdb9274d5824328294 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:42:42 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:55858
I20260807 08:42:42.870110 25867 tablet_service.cc:1514] Processing DeleteTablet for tablet fd71ac3f99cd40cdb9274d5824328294 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:42:42 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:37708
I20260807 08:42:42.870198 26013 tablet_service.cc:1514] Processing DeleteTablet for tablet fd71ac3f99cd40cdb9274d5824328294 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:42:42 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:59856
I20260807 08:42:42.870713 26271 tablet_replica.cc:330] T fd71ac3f99cd40cdb9274d5824328294 P 89fb5afa863d48bea21183245dc6b08a: stopping tablet replica
I20260807 08:42:42.870788 26273 tablet_replica.cc:330] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b: stopping tablet replica
I20260807 08:42:42.870911 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 25800
I20260807 08:42:42.871034 26271 raft_consensus.cc:2229] T fd71ac3f99cd40cdb9274d5824328294 P 89fb5afa863d48bea21183245dc6b08a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:42:42.871317 26271 raft_consensus.cc:2258] T fd71ac3f99cd40cdb9274d5824328294 P 89fb5afa863d48bea21183245dc6b08a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:42:42.872753 26273 raft_consensus.cc:2229] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b [term 1 LEADER]: Raft consensus shutting down.
I20260807 08:42:42.873155 26273 raft_consensus.cc:2258] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:42:42.873219 26271 ts_tablet_manager.cc:1905] T fd71ac3f99cd40cdb9274d5824328294 P 89fb5afa863d48bea21183245dc6b08a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:42:42.874598 26273 ts_tablet_manager.cc:1905] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:42:42.876116 26271 ts_tablet_manager.cc:1918] T fd71ac3f99cd40cdb9274d5824328294 P 89fb5afa863d48bea21183245dc6b08a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:42:42.876206 26271 log.cc:1196] T fd71ac3f99cd40cdb9274d5824328294 P 89fb5afa863d48bea21183245dc6b08a: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/fd71ac3f99cd40cdb9274d5824328294
I20260807 08:42:42.876559 26271 ts_tablet_manager.cc:1939] T fd71ac3f99cd40cdb9274d5824328294 P 89fb5afa863d48bea21183245dc6b08a: Deleting consensus metadata
I20260807 08:42:42.877416 26273 ts_tablet_manager.cc:1918] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:42:42.877529 26273 log.cc:1196] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/wal/wals/fd71ac3f99cd40cdb9274d5824328294
I20260807 08:42:42.877868 26273 ts_tablet_manager.cc:1939] T fd71ac3f99cd40cdb9274d5824328294 P 32f49284d7bc404ebc3afa369601d82b: Deleting consensus metadata
I20260807 08:42:42.877866 25720 catalog_manager.cc:4841] TS 89fb5afa863d48bea21183245dc6b08a (127.8.208.195:41079): tablet fd71ac3f99cd40cdb9274d5824328294 (table test-table [id=e9c6aa97f0fb4993976d746a79d813b5]) successfully deleted
I20260807 08:42:42.878811 25722 catalog_manager.cc:4841] TS 32f49284d7bc404ebc3afa369601d82b (127.8.208.194:33391): tablet fd71ac3f99cd40cdb9274d5824328294 (table test-table [id=e9c6aa97f0fb4993976d746a79d813b5]) successfully deleted
W20260807 08:42:42.884325 25721 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.208.193:46071 (error 108)
I20260807 08:42:42.884336 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 25943
I20260807 08:42:42.886806 26239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:42:42.886297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:46071 (local address 127.0.0.1:37720)
0807 08:42:42.886610 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0807 08:42:42.886698 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.193:46071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208}
W20260807 08:42:42.886996 25721 catalog_manager.cc:4584] TS da9e594e7bc949828050f45546d32b0b (127.8.208.193:46071): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fd71ac3f99cd40cdb9274d5824328294: Network error: Client connection negotiation failed: client connection to 127.8.208.193:46071: connect: Connection refused (error 111)
I20260807 08:42:42.891475 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 26087
I20260807 08:42:42.899739 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 25701
I20260807 08:43:02.909432 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:36191
--webserver_interface=127.8.208.254
--webserver_port=38563
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:41351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:36191
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:43:03.016259 26275 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:03.016490 26275 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:03.016585 26275 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:03.020328 26275 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 08:43:03.020376 26275 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 08:43:03.020392 26275 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 08:43:03.020406 26275 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:43:03.020422 26275 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:03.020473 26275 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:03.020511 26275 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:43:03.020530 26275 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:43:03.025528 26275 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:41351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:36191
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:36191
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=38563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26275
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:03.026554 26275 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:03.027642 26275 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:03.041618 26281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:03.041638 26282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:03.041635 26285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:03.041687 26275 server_base.cc:1034] running on GCE node
I20260807 08:43:03.042599 26275 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:03.043743 26275 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:03.044927 26275 hybrid_clock.cc:648] HybridClock initialized: now 1786092183044887 us; error 55 us; skew 500 ppm
Aug 07 08:43:03 dist-test-slave-6nmv krb5kdc[25686](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092183, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:03.047772 26275 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:43:03.048696 26275 webserver.cc:460] Webserver started at http://127.8.208.254:38563/ using document root <none> and password file <none>
I20260807 08:43:03.049280 26275 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:03.049394 26275 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:03.053229 26275 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:43:03.055436 26292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:03.056633 26275 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 08:43:03.056793 26275 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "b613e818b8244abf87c22fd1a9302f34"
format_stamp: "Formatted at 2026-08-07 08:42:41 on dist-test-slave-6nmv"
server_key: "f03d00c5c9ceba8eafb0b3a0733199aa"
server_key_iv: "5c2993252cce8ec0db660f880fed2e33"
server_key_version: "encryptionkey@0"
I20260807 08:43:03.057412 26275 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:03.085062 26275 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:03.088284 26275 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:03.088493 26275 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:03.095690 26275 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:36191
I20260807 08:43:03.096060 26348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:36191 every 8 connection(s)
I20260807 08:43:03.096797 26275 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:43:03.100872 26349 sys_catalog.cc:263] Verifying existing consensus state
I20260807 08:43:03.102545 26349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34: Bootstrap starting.
I20260807 08:43:03.106447 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 26275
I20260807 08:43:03.106879 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:46071
--local_ip_for_outbound_sockets=127.8.208.193
--tserver_master_addrs=127.8.208.254:36191
--webserver_port=34049
--webserver_interface=127.8.208.193
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:41351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 08:43:03.118934 26349 log.cc:824] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:03.127830 26349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 08:43:03.128240 26349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34: Bootstrap complete.
I20260807 08:43:03.132342 26349 raft_consensus.cc:348] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b613e818b8244abf87c22fd1a9302f34" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36191 } }
I20260807 08:43:03.132761 26349 raft_consensus.cc:729] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b613e818b8244abf87c22fd1a9302f34, State: Initialized, Role: FOLLOWER
I20260807 08:43:03.133283 26349 consensus_queue.cc:260] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b613e818b8244abf87c22fd1a9302f34" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36191 } }
I20260807 08:43:03.133430 26349 raft_consensus.cc:388] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:43:03.133522 26349 raft_consensus.cc:482] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:43:03.133630 26349 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [term 1 FOLLOWER]: Advancing to term 2
I20260807 08:43:03.135550 26349 raft_consensus.cc:504] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b613e818b8244abf87c22fd1a9302f34" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36191 } }
I20260807 08:43:03.135882 26349 leader_election.cc:302] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b613e818b8244abf87c22fd1a9302f34; no voters:
I20260807 08:43:03.136183 26349 leader_election.cc:288] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 08:43:03.136317 26353 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 08:43:03.136600 26353 raft_consensus.cc:686] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [term 2 LEADER]: Becoming Leader. State: Replica: b613e818b8244abf87c22fd1a9302f34, State: Running, Role: LEADER
I20260807 08:43:03.136981 26353 consensus_queue.cc:237] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b613e818b8244abf87c22fd1a9302f34" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36191 } }
I20260807 08:43:03.137332 26349 sys_catalog.cc:564] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:43:03.138353 26355 sys_catalog.cc:455] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b613e818b8244abf87c22fd1a9302f34. Latest consensus state: current_term: 2 leader_uuid: "b613e818b8244abf87c22fd1a9302f34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b613e818b8244abf87c22fd1a9302f34" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36191 } } }
I20260807 08:43:03.138466 26355 sys_catalog.cc:458] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:03.139118 26354 sys_catalog.cc:455] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b613e818b8244abf87c22fd1a9302f34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b613e818b8244abf87c22fd1a9302f34" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36191 } } }
I20260807 08:43:03.139197 26354 sys_catalog.cc:458] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:03.139490 26362 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:43:03.144389 26362 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:43:03.145015 26362 catalog_manager.cc:1259] Loaded cluster ID: 14b61493f3f9481ab8451681d621bc6a
I20260807 08:43:03.145076 26362 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:43:03.147908 26362 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:43:03.148583 26362 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34: Loaded TSK: 0
I20260807 08:43:03.166072 26362 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34: Generated new TSK 1
I20260807 08:43:03.166318 26362 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 08:43:03.223644 26351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:03.223861 26351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:03.223910 26351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:03.227895 26351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:03.227946 26351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:03.228030 26351 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:43:03.232920 26351 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:41351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:46071
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=34049
--tserver_master_addrs=127.8.208.254:36191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26351
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:03.233863 26351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:03.234797 26351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:03.243868 26377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:03.243878 26380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:03.243866 26378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:03.244462 26351 server_base.cc:1034] running on GCE node
I20260807 08:43:03.244827 26351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:03.245411 26351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:03.246590 26351 hybrid_clock.cc:648] HybridClock initialized: now 1786092183246555 us; error 52 us; skew 500 ppm
Aug 07 08:43:03 dist-test-slave-6nmv krb5kdc[25686](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092183, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:03.249442 26351 init.cc:377] Logged in from keytab as kudu/127.8.208.193@KRBTEST.COM (short username kudu)
I20260807 08:43:03.250466 26351 webserver.cc:460] Webserver started at http://127.8.208.193:34049/ using document root <none> and password file <none>
I20260807 08:43:03.251104 26351 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:03.251212 26351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:03.256121 26351 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 08:43:03.258515 26388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:03.259883 26351 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:43:03.260010 26351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "da9e594e7bc949828050f45546d32b0b"
format_stamp: "Formatted at 2026-08-07 08:42:41 on dist-test-slave-6nmv"
server_key: "9d257e5e86a400c6e37068bf1fbba4ee"
server_key_iv: "e511cc60494dcb3368e7759881523b82"
server_key_version: "encryptionkey@0"
I20260807 08:43:03.260600 26351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:03.275705 26351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:03.278735 26351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:03.278899 26351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:03.279533 26351 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:43:03.280644 26395 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 08:43:03.284415 26351 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 08:43:03.284480 26351 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260807 08:43:03.284536 26351 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 08:43:03.286369 26351 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 08:43:03.286434 26351 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.001s
I20260807 08:43:03.286705 26395 tablet_bootstrap.cc:492] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b: Bootstrap starting.
I20260807 08:43:03.295818 26351 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:46071
I20260807 08:43:03.295861 26508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:46071 every 8 connection(s)
I20260807 08:43:03.296617 26351 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:43:03.303658 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 26351
I20260807 08:43:03.304208 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:33391
--local_ip_for_outbound_sockets=127.8.208.194
--tserver_master_addrs=127.8.208.254:36191
--webserver_port=43665
--webserver_interface=127.8.208.194
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:41351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 08:43:03.306183 26395 log.cc:824] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b: Log is configured to *not* fsync() on all Append() calls
Aug 07 08:43:03 dist-test-slave-6nmv krb5kdc[25686](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092183, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:43:03.312948 26512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:03.298590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:37545 (local address 127.8.208.254:36191)
0807 08:43:03.299030 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:03.299047 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:03.299152 (+ 105us) server_negotiation.cc:407] Connection header received
0807 08:43:03.300498 (+ 1346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:03.300507 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:03.300761 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:03.301017 (+ 256us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:03.302548 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.303450 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.304802 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.305250 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.305427 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:03.308119 (+ 2692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:03.308124 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:03.308135 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:03.308161 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:03.309869 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:03.310376 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:03.310383 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:03.310388 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:03.310534 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:03.310860 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:03.310864 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:03.310866 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:03.311195 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:03.311355 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:03.311873 (+ 518us) server_negotiation.cc:299] Negotiation successful
0807 08:43:03.312132 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":118,"threads_started":1}
I20260807 08:43:03.312960 26511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:03.298478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.193:37545)
0807 08:43:03.299008 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:03.299059 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:03.300151 (+ 1092us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:03.301187 (+ 1036us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:03.301195 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:03.301647 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:43:03.302341 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:03.302365 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.303622 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.303625 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:03.304683 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:03.304693 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.305404 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.305408 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:03.305593 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:03.306211 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:43:03.306229 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:43:03.307944 (+ 1715us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:43:03.309990 (+ 2046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:03.309996 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:03.310007 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:03.310260 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:03.310630 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:03.310634 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:03.310636 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:03.310767 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:03.311328 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:43:03.311334 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:43:03.311571 (+ 237us) client_negotiation.cc:769] Sending connection context
0807 08:43:03.311761 (+ 190us) client_negotiation.cc:240] Negotiation successful
0807 08:43:03.312085 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":154,"threads_started":1}
I20260807 08:43:03.315212 26395 tablet_bootstrap.cc:492] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 08:43:03.315505 26509 heartbeater.cc:347] Connected to a master server at 127.8.208.254:36191
I20260807 08:43:03.315665 26395 tablet_bootstrap.cc:492] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b: Bootstrap complete.
I20260807 08:43:03.315737 26509 heartbeater.cc:464] Registering TS with master...
I20260807 08:43:03.316183 26509 heartbeater.cc:511] Master 127.8.208.254:36191 requested a full tablet report, sending...
I20260807 08:43:03.317188 26395 ts_tablet_manager.cc:1397] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b: Time spent bootstrapping tablet: real 0.031s user 0.019s sys 0.008s
I20260807 08:43:03.318382 26310 ts_manager.cc:194] Registered new tserver with Master: da9e594e7bc949828050f45546d32b0b (127.8.208.193:46071)
I20260807 08:43:03.320050 26395 raft_consensus.cc:348] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:43:03.320528 26395 raft_consensus.cc:729] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: da9e594e7bc949828050f45546d32b0b, State: Initialized, Role: FOLLOWER
I20260807 08:43:03.320976 26395 consensus_queue.cc:260] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:43:03.321552 26310 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.193@KRBTEST.COM'} at 127.8.208.193:37545
I20260807 08:43:03.321970 26395 ts_tablet_manager.cc:1428] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b: Time spent starting tablet: real 0.005s user 0.003s sys 0.005s
I20260807 08:43:03.323978 26509 heartbeater.cc:503] Master 127.8.208.254:36191 was elected leader, sending a full tablet report...
Aug 07 08:43:03 dist-test-slave-6nmv krb5kdc[25686](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092183, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for kudu/127.8.208.193@KRBTEST.COM
I20260807 08:43:03.332746 26515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:03.321022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:46071 (local address 127.0.0.1:38416)
0807 08:43:03.321975 (+ 953us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:03.322016 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:03.322199 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:03.323382 (+ 1183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:03.323388 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:03.323803 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:43:03.323929 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:03.323936 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.325196 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.325199 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:03.326221 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:03.326232 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.326828 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.326832 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:03.326937 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:03.327573 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:43:03.327589 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:43:03.329145 (+ 1556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:43:03.331180 (+ 2035us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:03.331191 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:03.331195 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:03.331425 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:03.331742 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:03.331744 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:03.331746 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:03.331824 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:03.332281 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:43:03.332285 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:43:03.332377 (+ 92us) client_negotiation.cc:769] Sending connection context
0807 08:43:03.332485 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 08:43:03.332621 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":776,"thread_start_us":105,"threads_started":1}
I20260807 08:43:03.332878 26517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:03.321710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38416 (local address 127.8.208.193:46071)
0807 08:43:03.322622 (+ 912us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:03.322633 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:03.322653 (+ 20us) server_negotiation.cc:407] Connection header received
0807 08:43:03.322708 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:03.322713 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:03.323225 (+ 512us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:03.323355 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:03.324055 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.325063 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.326329 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.326724 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.326805 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:03.329281 (+ 2476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:03.329291 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:03.329304 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:03.329330 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:03.331072 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:03.331531 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:03.331537 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:03.331538 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:03.331643 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:03.331912 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:03.331915 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:03.331917 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:03.332171 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:03.332297 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:03.332584 (+ 287us) server_negotiation.cc:299] Negotiation successful
0807 08:43:03.332721 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":832,"thread_start_us":118,"threads_started":1}
I20260807 08:43:03.333860 26439 tablet_service.cc:1514] Processing DeleteTablet for tablet fd71ac3f99cd40cdb9274d5824328294 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:42:42 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:38416
I20260807 08:43:03.334632 26518 tablet_replica.cc:330] stopping tablet replica
I20260807 08:43:03.334893 26518 raft_consensus.cc:2229] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:43:03.335109 26518 raft_consensus.cc:2258] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:43:03.335973 26518 ts_tablet_manager.cc:1905] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:43:03.339813 26518 ts_tablet_manager.cc:1918] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:43:03.339915 26518 log.cc:1196] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/wal/wals/fd71ac3f99cd40cdb9274d5824328294
I20260807 08:43:03.340207 26518 ts_tablet_manager.cc:1939] T fd71ac3f99cd40cdb9274d5824328294 P da9e594e7bc949828050f45546d32b0b: Deleting consensus metadata
I20260807 08:43:03.341746 26295 catalog_manager.cc:4841] TS da9e594e7bc949828050f45546d32b0b (127.8.208.193:46071): tablet fd71ac3f99cd40cdb9274d5824328294 (table test-table [id=e9c6aa97f0fb4993976d746a79d813b5]) successfully deleted
W20260807 08:43:03.419832 26513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:03.420082 26513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:03.420154 26513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:03.423928 26513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:03.423996 26513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:03.424084 26513 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:43:03.428895 26513 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:41351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:33391
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=43665
--tserver_master_addrs=127.8.208.254:36191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26513
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:03.429724 26513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:03.430667 26513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:03.439374 26524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:03.439384 26523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:03.439384 26526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:03.439726 26513 server_base.cc:1034] running on GCE node
I20260807 08:43:03.440141 26513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:03.440688 26513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:03.441867 26513 hybrid_clock.cc:648] HybridClock initialized: now 1786092183441842 us; error 34 us; skew 500 ppm
Aug 07 08:43:03 dist-test-slave-6nmv krb5kdc[25686](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092183, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:03.444567 26513 init.cc:377] Logged in from keytab as kudu/127.8.208.194@KRBTEST.COM (short username kudu)
I20260807 08:43:03.445289 26513 webserver.cc:460] Webserver started at http://127.8.208.194:43665/ using document root <none> and password file <none>
I20260807 08:43:03.445746 26513 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:03.445861 26513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:03.449241 26513 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260807 08:43:03.451211 26533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:03.452347 26513 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 08:43:03.452484 26513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "32f49284d7bc404ebc3afa369601d82b"
format_stamp: "Formatted at 2026-08-07 08:42:42 on dist-test-slave-6nmv"
server_key: "d7bd89cf54a994a1139413b68458f889"
server_key_iv: "763d6fec784e09418689bf95d5dc220e"
server_key_version: "encryptionkey@0"
I20260807 08:43:03.452972 26513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:03.472430 26513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:03.475468 26513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:03.475672 26513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:03.476226 26513 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:43:03.476971 26513 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:43:03.477037 26513 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:03.477130 26513 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:43:03.477178 26513 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:03.485345 26513 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:33391
I20260807 08:43:03.485422 26656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:33391 every 8 connection(s)
I20260807 08:43:03.486351 26513 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:43:03.492944 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 26513
I20260807 08:43:03.493448 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:41079
--local_ip_for_outbound_sockets=127.8.208.195
--tserver_master_addrs=127.8.208.254:36191
--webserver_port=38055
--webserver_interface=127.8.208.195
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:41351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 08:43:03 dist-test-slave-6nmv krb5kdc[25686](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092183, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:43:03.498951 26512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:03.487992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:33617 (local address 127.8.208.254:36191)
0807 08:43:03.488163 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:03.488168 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:03.489089 (+ 921us) server_negotiation.cc:407] Connection header received
0807 08:43:03.489860 (+ 771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:03.489862 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:03.489912 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:03.489982 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:03.490952 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.491477 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.492531 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.492745 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.492817 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:03.495444 (+ 2627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:03.495447 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:03.495449 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:03.495471 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:03.496945 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:03.497444 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:03.497452 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:03.497453 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:03.497528 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:03.497913 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:03.497917 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:03.497918 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:03.498118 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:03.498226 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:03.498671 (+ 445us) server_negotiation.cc:299] Negotiation successful
0807 08:43:03.498793 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 08:43:03.499648 26659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:03.488342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.194:33617)
0807 08:43:03.488952 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:03.488988 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:03.489677 (+ 689us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:03.490106 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:03.490112 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:03.490417 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:43:03.490833 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:03.490844 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.491578 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.491581 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:03.492412 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:03.492420 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.492883 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.492887 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:03.493086 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:03.493613 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:43:03.493639 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:43:03.495277 (+ 1638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:43:03.497074 (+ 1797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:03.497079 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:03.497091 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:03.497334 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:03.497634 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:03.497649 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:03.497651 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:03.497798 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:03.498226 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:43:03.498232 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:43:03.498457 (+ 225us) client_negotiation.cc:769] Sending connection context
0807 08:43:03.498619 (+ 162us) client_negotiation.cc:240] Negotiation successful
0807 08:43:03.498891 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":125,"threads_started":1}
I20260807 08:43:03.500886 26657 heartbeater.cc:347] Connected to a master server at 127.8.208.254:36191
I20260807 08:43:03.501101 26657 heartbeater.cc:464] Registering TS with master...
I20260807 08:43:03.501559 26657 heartbeater.cc:511] Master 127.8.208.254:36191 requested a full tablet report, sending...
I20260807 08:43:03.502647 26310 ts_manager.cc:194] Registered new tserver with Master: 32f49284d7bc404ebc3afa369601d82b (127.8.208.194:33391)
I20260807 08:43:03.503181 26310 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.194@KRBTEST.COM'} at 127.8.208.194:33617
W20260807 08:43:03.599972 26660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:03.600292 26660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:03.600356 26660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:03.604192 26660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:03.604269 26660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:03.604358 26660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:43:03.609030 26660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:41351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:41079
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=38055
--tserver_master_addrs=127.8.208.254:36191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:03.609998 26660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:03.610826 26660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:03.619657 26668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:03.619719 26660 server_base.cc:1034] running on GCE node
W20260807 08:43:03.619729 26665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:03.619657 26666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:03.620254 26660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:03.620839 26660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:03.621994 26660 hybrid_clock.cc:648] HybridClock initialized: now 1786092183621969 us; error 37 us; skew 500 ppm
Aug 07 08:43:03 dist-test-slave-6nmv krb5kdc[25686](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092183, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:03.624732 26660 init.cc:377] Logged in from keytab as kudu/127.8.208.195@KRBTEST.COM (short username kudu)
I20260807 08:43:03.625504 26660 webserver.cc:460] Webserver started at http://127.8.208.195:38055/ using document root <none> and password file <none>
I20260807 08:43:03.626107 26660 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:03.626207 26660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:03.630116 26660 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 08:43:03.632217 26675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:03.633469 26660 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:43:03.633564 26660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "89fb5afa863d48bea21183245dc6b08a"
format_stamp: "Formatted at 2026-08-07 08:42:42 on dist-test-slave-6nmv"
server_key: "c2c051f01c0c5cfafbb2b965f6d8d56a"
server_key_iv: "b83a90e9015ceedb6b157d2daa141250"
server_key_version: "encryptionkey@0"
I20260807 08:43:03.634176 26660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:03.646752 26660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:03.650071 26660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:03.650251 26660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:03.650761 26660 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:43:03.651554 26660 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:43:03.651614 26660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:03.651654 26660 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:43:03.651710 26660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:03.660812 26660 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:41079
I20260807 08:43:03.660843 26796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:41079 every 8 connection(s)
I20260807 08:43:03.661803 26660 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:43:03.670214 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 26660
Aug 07 08:43:03 dist-test-slave-6nmv krb5kdc[25686](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092183, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:43:03.675508 26512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:03.663601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:35971 (local address 127.8.208.254:36191)
0807 08:43:03.663737 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:03.663740 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:03.664574 (+ 834us) server_negotiation.cc:407] Connection header received
0807 08:43:03.665989 (+ 1415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:03.665991 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:03.666036 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:03.666115 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:03.667203 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.667697 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.668781 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.668991 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.669108 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:03.671710 (+ 2602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:03.671714 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:03.671717 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:03.671747 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:03.673181 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:03.673701 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:03.673705 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:03.673707 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:03.673797 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:03.674173 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:03.674177 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:03.674178 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:03.674447 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:03.674532 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:03.675127 (+ 595us) server_negotiation.cc:299] Negotiation successful
0807 08:43:03.675290 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":17,"server-negotiator.queue_time_us":56}
I20260807 08:43:03.676369 26800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:03.663969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.195:35971)
0807 08:43:03.664399 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:03.664439 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:03.665757 (+ 1318us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:03.666264 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:03.666270 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:03.666615 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:43:03.667069 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:03.667083 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.667802 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.667805 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:03.668674 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:03.668682 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.669149 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.669152 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:03.669289 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:03.669844 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:43:03.669872 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:43:03.671512 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:43:03.673296 (+ 1784us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:03.673303 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:03.673321 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:03.673600 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:03.673928 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:03.673930 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:03.673932 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:03.674080 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:03.674556 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:43:03.674562 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:43:03.674881 (+ 319us) client_negotiation.cc:769] Sending connection context
0807 08:43:03.675077 (+ 196us) client_negotiation.cc:240] Negotiation successful
0807 08:43:03.675375 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":98,"threads_started":1}
I20260807 08:43:03.677556 26797 heartbeater.cc:347] Connected to a master server at 127.8.208.254:36191
I20260807 08:43:03.677798 26797 heartbeater.cc:464] Registering TS with master...
I20260807 08:43:03.678468 26797 heartbeater.cc:511] Master 127.8.208.254:36191 requested a full tablet report, sending...
I20260807 08:43:03.679292 26801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:03.670942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38138 (local address 127.8.208.254:36191)
0807 08:43:03.671180 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:03.671185 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:03.671415 (+ 230us) server_negotiation.cc:407] Connection header received
0807 08:43:03.671512 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:03.671515 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:03.671562 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:03.671673 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:03.672646 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.673188 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.674299 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.674633 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.674741 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:03.676085 (+ 1344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:03.676088 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:03.676090 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:03.676114 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:03.677669 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:03.678146 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:03.678149 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:03.678151 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:03.678236 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:03.678463 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:03.678466 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:03.678468 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:03.678664 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:03.678864 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:03.678994 (+ 130us) server_negotiation.cc:299] Negotiation successful
0807 08:43:03.679101 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":17,"server-negotiator.queue_time_us":176,"thread_start_us":84,"threads_started":1}
I20260807 08:43:03.679592 26310 ts_manager.cc:194] Registered new tserver with Master: 89fb5afa863d48bea21183245dc6b08a (127.8.208.195:41079)
I20260807 08:43:03.680261 26310 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.195@KRBTEST.COM'} at 127.8.208.195:35971
I20260807 08:43:03.680976 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 08:43:03.684840 26801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:03.681579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38148 (local address 127.8.208.254:36191)
0807 08:43:03.681694 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:03.681698 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:03.681908 (+ 210us) server_negotiation.cc:407] Connection header received
0807 08:43:03.682070 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:03.682073 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:03.682164 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:03.682267 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:43:03.682502 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.682966 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.683776 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.683999 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.684103 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:03.684381 (+ 278us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:43:03.684494 (+ 113us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0807 08:43:03.684734 (+ 240us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38148: token expired
Metrics: {"server-negotiator.queue_time_us":49}
W20260807 08:43:03.684921 26801 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38148: token expired
W20260807 08:43:03.685205 26232 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.8.208.254:36191)
I20260807 08:43:03.691480 26801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:03.685530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38164 (local address 127.8.208.254:36191)
0807 08:43:03.685614 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:03.685618 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:03.685640 (+ 22us) server_negotiation.cc:407] Connection header received
0807 08:43:03.685721 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:03.685723 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:03.685751 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:03.685902 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:03.686411 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.686852 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.687534 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.687709 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.687772 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:03.688879 (+ 1107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:03.688881 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:03.688883 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:03.688901 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:03.690270 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:03.690617 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:03.690619 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:03.690620 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:03.690685 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:03.690894 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:03.690895 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:03.690896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:03.691031 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:03.691123 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:03.691309 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 08:43:03.691389 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 08:43:03.693606 26309 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38164:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 08:43:03.696658 26309 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:43:03.703938 26439 tablet_service.cc:1467] Processing CreateTablet for tablet 6188d7a79b6f490eb2aebe0c955540b8 (DEFAULT_TABLE table=test-table [id=4b552be2e7854d89aaabf098a3fa37b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:43:03.704607 26439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6188d7a79b6f490eb2aebe0c955540b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:03.707682 26395 tablet_bootstrap.cc:492] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b: Bootstrap starting.
I20260807 08:43:03.708105 26808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:03.703337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:33391 (local address 127.0.0.1:54642)
0807 08:43:03.703754 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:03.703769 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:03.703852 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:03.704575 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:03.704578 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:03.704596 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:03.704669 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:03.704675 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.705887 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.705890 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:03.706871 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:03.706878 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.707684 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.707687 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:03.707805 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:03.707829 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 08:43:03.707881 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 08:43:03.707966 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":116,"threads_started":1}
I20260807 08:43:03.708115 26515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:03.702918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:41079 (local address 127.0.0.1:57088)
0807 08:43:03.703045 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:03.703063 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:03.703138 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:03.704080 (+ 942us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:03.704083 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:03.704125 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:03.704222 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:03.704229 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.705460 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.705466 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:03.706563 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:03.706573 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.707636 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.707640 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:03.707769 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:03.707820 (+ 51us) client_negotiation.cc:769] Sending connection context
0807 08:43:03.707871 (+ 51us) client_negotiation.cc:240] Negotiation successful
0807 08:43:03.707942 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":1}
I20260807 08:43:03.708629 26395 tablet_bootstrap.cc:654] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:03.708822 26809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:03.703741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54642 (local address 127.8.208.194:33391)
0807 08:43:03.704117 (+ 376us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:03.704129 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:03.704151 (+ 22us) server_negotiation.cc:407] Connection header received
0807 08:43:03.704223 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:03.704228 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:03.704413 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:03.704571 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:03.704767 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.705735 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.706989 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.707519 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.708370 (+ 851us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:03.708512 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:03.708566 (+ 54us) server_negotiation.cc:299] Negotiation successful
0807 08:43:03.708672 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":141,"threads_started":1}
I20260807 08:43:03.708846 26807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:03.703148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57088 (local address 127.8.208.195:41079)
0807 08:43:03.703533 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:03.703547 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:03.703584 (+ 37us) server_negotiation.cc:407] Connection header received
0807 08:43:03.703678 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:03.703684 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:03.703901 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:03.704366 (+ 465us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:03.704529 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.705341 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.706670 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.707495 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.708216 (+ 721us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:03.708367 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:03.708423 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 08:43:03.708531 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":153,"threads_started":1}
I20260807 08:43:03.711673 26726 tablet_service.cc:1467] Processing CreateTablet for tablet 6188d7a79b6f490eb2aebe0c955540b8 (DEFAULT_TABLE table=test-table [id=4b552be2e7854d89aaabf098a3fa37b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:43:03.711673 26584 tablet_service.cc:1467] Processing CreateTablet for tablet 6188d7a79b6f490eb2aebe0c955540b8 (DEFAULT_TABLE table=test-table [id=4b552be2e7854d89aaabf098a3fa37b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:43:03.712759 26726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6188d7a79b6f490eb2aebe0c955540b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:03.712754 26584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6188d7a79b6f490eb2aebe0c955540b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:03.713014 26395 tablet_bootstrap.cc:492] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b: No bootstrap required, opened a new log
I20260807 08:43:03.713136 26395 ts_tablet_manager.cc:1397] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260807 08:43:03.713521 26395 raft_consensus.cc:348] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:43:03.713650 26395 raft_consensus.cc:374] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:03.713698 26395 raft_consensus.cc:729] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da9e594e7bc949828050f45546d32b0b, State: Initialized, Role: FOLLOWER
I20260807 08:43:03.713846 26395 consensus_queue.cc:260] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:43:03.714143 26395 ts_tablet_manager.cc:1428] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 08:43:03.720444 26811 tablet_bootstrap.cc:492] T 6188d7a79b6f490eb2aebe0c955540b8 P 32f49284d7bc404ebc3afa369601d82b: Bootstrap starting.
I20260807 08:43:03.720919 26812 tablet_bootstrap.cc:492] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a: Bootstrap starting.
I20260807 08:43:03.723444 26812 tablet_bootstrap.cc:654] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:03.723471 26811 tablet_bootstrap.cc:654] T 6188d7a79b6f490eb2aebe0c955540b8 P 32f49284d7bc404ebc3afa369601d82b: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:03.724310 26811 log.cc:824] T 6188d7a79b6f490eb2aebe0c955540b8 P 32f49284d7bc404ebc3afa369601d82b: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:03.724309 26812 log.cc:824] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:03.726081 26811 tablet_bootstrap.cc:492] T 6188d7a79b6f490eb2aebe0c955540b8 P 32f49284d7bc404ebc3afa369601d82b: No bootstrap required, opened a new log
I20260807 08:43:03.726091 26812 tablet_bootstrap.cc:492] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a: No bootstrap required, opened a new log
I20260807 08:43:03.726269 26811 ts_tablet_manager.cc:1397] T 6188d7a79b6f490eb2aebe0c955540b8 P 32f49284d7bc404ebc3afa369601d82b: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 08:43:03.726279 26812 ts_tablet_manager.cc:1397] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260807 08:43:03.729167 26812 raft_consensus.cc:348] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:43:03.729187 26811 raft_consensus.cc:348] T 6188d7a79b6f490eb2aebe0c955540b8 P 32f49284d7bc404ebc3afa369601d82b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:43:03.729354 26812 raft_consensus.cc:374] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:03.729383 26811 raft_consensus.cc:374] T 6188d7a79b6f490eb2aebe0c955540b8 P 32f49284d7bc404ebc3afa369601d82b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:03.729416 26812 raft_consensus.cc:729] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89fb5afa863d48bea21183245dc6b08a, State: Initialized, Role: FOLLOWER
I20260807 08:43:03.729471 26811 raft_consensus.cc:729] T 6188d7a79b6f490eb2aebe0c955540b8 P 32f49284d7bc404ebc3afa369601d82b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32f49284d7bc404ebc3afa369601d82b, State: Initialized, Role: FOLLOWER
I20260807 08:43:03.729874 26812 consensus_queue.cc:260] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:43:03.729911 26811 consensus_queue.cc:260] T 6188d7a79b6f490eb2aebe0c955540b8 P 32f49284d7bc404ebc3afa369601d82b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:43:03.730417 26797 heartbeater.cc:503] Master 127.8.208.254:36191 was elected leader, sending a full tablet report...
I20260807 08:43:03.730463 26657 heartbeater.cc:503] Master 127.8.208.254:36191 was elected leader, sending a full tablet report...
I20260807 08:43:03.730759 26812 ts_tablet_manager.cc:1428] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260807 08:43:03.730758 26811 ts_tablet_manager.cc:1428] T 6188d7a79b6f490eb2aebe0c955540b8 P 32f49284d7bc404ebc3afa369601d82b: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
W20260807 08:43:03.737228 26658 tablet.cc:2369] T 6188d7a79b6f490eb2aebe0c955540b8 P 32f49284d7bc404ebc3afa369601d82b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 08:43:03.797734 26510 tablet.cc:2369] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 08:43:03.814392 26815 raft_consensus.cc:482] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:43:03.814589 26815 raft_consensus.cc:504] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:43:03.815634 26815 leader_election.cc:288] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32f49284d7bc404ebc3afa369601d82b (127.8.208.194:33391), da9e594e7bc949828050f45546d32b0b (127.8.208.193:46071)
I20260807 08:43:03.819846 26800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:03.815934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:46071 (local address 127.8.208.195:50807)
0807 08:43:03.816119 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:03.816134 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:03.816255 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:03.816636 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:03.816639 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:03.816658 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:03.816769 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:03.816775 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.817680 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.817683 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:03.818613 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:03.818622 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.819403 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.819407 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:03.819521 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:03.819558 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 08:43:03.819632 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 08:43:03.819714 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"mutex_wait_us":1}
I20260807 08:43:03.819876 26517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:03.816040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:50807 (local address 127.8.208.193:46071)
0807 08:43:03.816175 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:03.816181 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:03.816197 (+ 16us) server_negotiation.cc:407] Connection header received
0807 08:43:03.816411 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:03.816415 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:03.816485 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:03.816592 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:03.816894 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.817573 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.818751 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.819287 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.819379 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:03.819486 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:03.819658 (+ 172us) server_negotiation.cc:299] Negotiation successful
0807 08:43:03.819742 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 08:43:03.820070 26817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:03.815943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:33391 (local address 127.8.208.195:38395)
0807 08:43:03.816773 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:03.816783 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:03.816899 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:03.817127 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:03.817130 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:03.817148 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:03.817260 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:03.817266 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.818079 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.818081 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:03.818923 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:03.818934 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.819644 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.819647 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:03.819754 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:03.819775 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 08:43:03.819847 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 08:43:03.819913 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":771,"mutex_wait_us":283,"spinlock_wait_cycles":342912,"thread_start_us":323,"threads_started":1}
I20260807 08:43:03.820134 26809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:03.816075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:38395 (local address 127.8.208.194:33391)
0807 08:43:03.816230 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:03.816235 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:03.816905 (+ 670us) server_negotiation.cc:407] Connection header received
0807 08:43:03.816969 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:03.816971 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:03.817012 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:03.817090 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:03.817362 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.817972 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.819048 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.819507 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.819630 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:03.819673 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:03.819888 (+ 215us) server_negotiation.cc:299] Negotiation successful
0807 08:43:03.819971 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 08:43:03.820400 26462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6188d7a79b6f490eb2aebe0c955540b8" candidate_uuid: "89fb5afa863d48bea21183245dc6b08a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9e594e7bc949828050f45546d32b0b" is_pre_election: true
I20260807 08:43:03.820740 26462 raft_consensus.cc:2454] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89fb5afa863d48bea21183245dc6b08a in term 0.
I20260807 08:43:03.820785 26607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6188d7a79b6f490eb2aebe0c955540b8" candidate_uuid: "89fb5afa863d48bea21183245dc6b08a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32f49284d7bc404ebc3afa369601d82b" is_pre_election: true
I20260807 08:43:03.821034 26607 raft_consensus.cc:2454] T 6188d7a79b6f490eb2aebe0c955540b8 P 32f49284d7bc404ebc3afa369601d82b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89fb5afa863d48bea21183245dc6b08a in term 0.
I20260807 08:43:03.821257 26678 leader_election.cc:302] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89fb5afa863d48bea21183245dc6b08a, da9e594e7bc949828050f45546d32b0b; no voters:
I20260807 08:43:03.821547 26815 raft_consensus.cc:2781] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:43:03.821632 26815 raft_consensus.cc:482] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:43:03.821663 26815 raft_consensus.cc:3037] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:03.822762 26815 raft_consensus.cc:504] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:43:03.823146 26815 leader_election.cc:288] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a [CANDIDATE]: Term 1 election: Requested vote from peers 32f49284d7bc404ebc3afa369601d82b (127.8.208.194:33391), da9e594e7bc949828050f45546d32b0b (127.8.208.193:46071)
I20260807 08:43:03.823448 26462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6188d7a79b6f490eb2aebe0c955540b8" candidate_uuid: "89fb5afa863d48bea21183245dc6b08a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da9e594e7bc949828050f45546d32b0b"
I20260807 08:43:03.823441 26607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6188d7a79b6f490eb2aebe0c955540b8" candidate_uuid: "89fb5afa863d48bea21183245dc6b08a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32f49284d7bc404ebc3afa369601d82b"
I20260807 08:43:03.823566 26462 raft_consensus.cc:3037] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:03.823567 26607 raft_consensus.cc:3037] T 6188d7a79b6f490eb2aebe0c955540b8 P 32f49284d7bc404ebc3afa369601d82b [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:03.824810 26607 raft_consensus.cc:2454] T 6188d7a79b6f490eb2aebe0c955540b8 P 32f49284d7bc404ebc3afa369601d82b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89fb5afa863d48bea21183245dc6b08a in term 1.
I20260807 08:43:03.824810 26462 raft_consensus.cc:2454] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89fb5afa863d48bea21183245dc6b08a in term 1.
I20260807 08:43:03.825088 26678 leader_election.cc:302] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89fb5afa863d48bea21183245dc6b08a, da9e594e7bc949828050f45546d32b0b; no voters:
I20260807 08:43:03.825275 26815 raft_consensus.cc:2781] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:43:03.825495 26815 raft_consensus.cc:686] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a [term 1 LEADER]: Becoming Leader. State: Replica: 89fb5afa863d48bea21183245dc6b08a, State: Running, Role: LEADER
I20260807 08:43:03.825839 26815 consensus_queue.cc:237] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:43:03.828886 26309 catalog_manager.cc:5495] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a reported cstate change: term changed from 0 to 1, leader changed from <none> to 89fb5afa863d48bea21183245dc6b08a (127.8.208.195). New cstate: current_term: 1 leader_uuid: "89fb5afa863d48bea21183245dc6b08a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } health_report { overall_health: UNKNOWN } } }
I20260807 08:43:03.860436 26807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:03.857404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57092 (local address 127.8.208.195:41079)
0807 08:43:03.857538 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:03.857541 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:03.857556 (+ 15us) server_negotiation.cc:407] Connection header received
0807 08:43:03.857624 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:03.857626 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:03.857677 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:03.857771 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:43:03.858020 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.858494 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.859175 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:03.859381 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:03.859458 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:03.859683 (+ 225us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:43:03.860052 (+ 369us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:43:03.860145 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:03.860192 (+ 47us) server_negotiation.cc:299] Negotiation successful
0807 08:43:03.860249 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 08:43:03.866588 26607 raft_consensus.cc:1261] T 6188d7a79b6f490eb2aebe0c955540b8 P 32f49284d7bc404ebc3afa369601d82b [term 1 FOLLOWER]: Refusing update from remote peer 89fb5afa863d48bea21183245dc6b08a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:43:03.866603 26462 raft_consensus.cc:1261] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Refusing update from remote peer 89fb5afa863d48bea21183245dc6b08a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:43:03.867290 26815 consensus_queue.cc:1035] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a [LEADER]: Connected to new peer: Peer: permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:43:03.867484 26818 consensus_queue.cc:1035] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a [LEADER]: Connected to new peer: Peer: permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:43:03.872278 26821 mvcc.cc:205] Tried to move back new op lower bound from 7315833585109540864 to 7315833584953131008. Current Snapshot: MvccSnapshot[applied={T|T < 7315833585109540864}]
I20260807 08:43:03.880576 26309 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38164:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:43:03.880733 26309 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38164:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:43:03.883085 26309 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34: Sending DeleteTablet for 3 replicas of tablet 6188d7a79b6f490eb2aebe0c955540b8
I20260807 08:43:03.883700 26439 tablet_service.cc:1514] Processing DeleteTablet for tablet 6188d7a79b6f490eb2aebe0c955540b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:43:03 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:38416
I20260807 08:43:03.883684 26726 tablet_service.cc:1514] Processing DeleteTablet for tablet 6188d7a79b6f490eb2aebe0c955540b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:43:03 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:57088
I20260807 08:43:03.883750 26584 tablet_service.cc:1514] Processing DeleteTablet for tablet 6188d7a79b6f490eb2aebe0c955540b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:43:03 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:54642
I20260807 08:43:03.884243 26831 tablet_replica.cc:330] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b: stopping tablet replica
I20260807 08:43:03.884433 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 26351
I20260807 08:43:03.884423 26831 raft_consensus.cc:2229] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:43:03.884570 26831 raft_consensus.cc:2258] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:43:03.889721 26832 tablet_replica.cc:330] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a: stopping tablet replica
I20260807 08:43:03.890100 26832 raft_consensus.cc:2229] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a [term 1 LEADER]: Raft consensus shutting down.
I20260807 08:43:03.890442 26832 raft_consensus.cc:2258] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:43:03.890941 26833 tablet_replica.cc:330] T 6188d7a79b6f490eb2aebe0c955540b8 P 32f49284d7bc404ebc3afa369601d82b: stopping tablet replica
I20260807 08:43:03.891326 26833 raft_consensus.cc:2229] T 6188d7a79b6f490eb2aebe0c955540b8 P 32f49284d7bc404ebc3afa369601d82b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:43:03.891719 26833 raft_consensus.cc:2258] T 6188d7a79b6f490eb2aebe0c955540b8 P 32f49284d7bc404ebc3afa369601d82b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:43:03.893637 26833 ts_tablet_manager.cc:1905] T 6188d7a79b6f490eb2aebe0c955540b8 P 32f49284d7bc404ebc3afa369601d82b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:43:03.894380 26832 ts_tablet_manager.cc:1905] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:43:03.896483 26833 ts_tablet_manager.cc:1918] T 6188d7a79b6f490eb2aebe0c955540b8 P 32f49284d7bc404ebc3afa369601d82b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:43:03.896569 26833 log.cc:1196] T 6188d7a79b6f490eb2aebe0c955540b8 P 32f49284d7bc404ebc3afa369601d82b: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/wal/wals/6188d7a79b6f490eb2aebe0c955540b8
I20260807 08:43:03.896953 26833 ts_tablet_manager.cc:1939] T 6188d7a79b6f490eb2aebe0c955540b8 P 32f49284d7bc404ebc3afa369601d82b: Deleting consensus metadata
I20260807 08:43:03.897212 26832 ts_tablet_manager.cc:1918] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:43:03.897286 26832 log.cc:1196] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/6188d7a79b6f490eb2aebe0c955540b8
I20260807 08:43:03.897637 26832 ts_tablet_manager.cc:1939] T 6188d7a79b6f490eb2aebe0c955540b8 P 89fb5afa863d48bea21183245dc6b08a: Deleting consensus metadata
I20260807 08:43:03.898181 26296 catalog_manager.cc:4841] TS 32f49284d7bc404ebc3afa369601d82b (127.8.208.194:33391): tablet 6188d7a79b6f490eb2aebe0c955540b8 (table test-table [id=4b552be2e7854d89aaabf098a3fa37b7]) successfully deleted
I20260807 08:43:03.898813 26294 catalog_manager.cc:4841] TS 89fb5afa863d48bea21183245dc6b08a (127.8.208.195:41079): tablet 6188d7a79b6f490eb2aebe0c955540b8 (table test-table [id=4b552be2e7854d89aaabf098a3fa37b7]) successfully deleted
W20260807 08:43:03.899547 26295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.208.193:46071 (error 108)
I20260807 08:43:03.899784 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 26513
I20260807 08:43:03.901023 26515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:03.900751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:46071 (local address 127.0.0.1:38418)
0807 08:43:03.900883 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:03.900954 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.193:46071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 08:43:03.901247 26295 catalog_manager.cc:4584] TS da9e594e7bc949828050f45546d32b0b (127.8.208.193:46071): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6188d7a79b6f490eb2aebe0c955540b8: Network error: Client connection negotiation failed: client connection to 127.8.208.193:46071: connect: Connection refused (error 111)
I20260807 08:43:03.907724 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 26660
I20260807 08:43:03.914268 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 26275
I20260807 08:43:23.921748 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:36191
--webserver_interface=127.8.208.254
--webserver_port=38563
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:41351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:36191
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:43:24.021924 26835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:24.022161 26835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:24.022198 26835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:24.026047 26835 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 08:43:24.026096 26835 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 08:43:24.026113 26835 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 08:43:24.026125 26835 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:43:24.026142 26835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:24.026198 26835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:24.026227 26835 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:43:24.026265 26835 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:43:24.031050 26835 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:41351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:36191
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:36191
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=38563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:24.032003 26835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:24.032913 26835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:24.041000 26841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:24.041008 26840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:24.041072 26843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:24.041261 26835 server_base.cc:1034] running on GCE node
I20260807 08:43:24.041749 26835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:24.042809 26835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:24.043967 26835 hybrid_clock.cc:648] HybridClock initialized: now 1786092204043943 us; error 37 us; skew 500 ppm
Aug 07 08:43:24 dist-test-slave-6nmv krb5kdc[25686](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092204, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:24.046676 26835 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:43:24.047511 26835 webserver.cc:460] Webserver started at http://127.8.208.254:38563/ using document root <none> and password file <none>
I20260807 08:43:24.048014 26835 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:24.048070 26835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:24.051441 26835 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260807 08:43:24.053946 26850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:24.055011 26835 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 08:43:24.055138 26835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "b613e818b8244abf87c22fd1a9302f34"
format_stamp: "Formatted at 2026-08-07 08:42:41 on dist-test-slave-6nmv"
server_key: "f03d00c5c9ceba8eafb0b3a0733199aa"
server_key_iv: "5c2993252cce8ec0db660f880fed2e33"
server_key_version: "encryptionkey@0"
I20260807 08:43:24.055647 26835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:24.079589 26835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:24.082134 26835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:24.082334 26835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:24.088708 26835 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:36191
I20260807 08:43:24.088958 26905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:36191 every 8 connection(s)
I20260807 08:43:24.089629 26835 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:43:24.093564 26906 sys_catalog.cc:263] Verifying existing consensus state
I20260807 08:43:24.095105 26906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34: Bootstrap starting.
I20260807 08:43:24.098273 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 26835
I20260807 08:43:24.098726 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:46071
--local_ip_for_outbound_sockets=127.8.208.193
--tserver_master_addrs=127.8.208.254:36191
--webserver_port=34049
--webserver_interface=127.8.208.193
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:41351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 08:43:24.112016 26906 log.cc:824] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:24.122257 26906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 08:43:24.122606 26906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34: Bootstrap complete.
I20260807 08:43:24.126575 26906 raft_consensus.cc:348] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b613e818b8244abf87c22fd1a9302f34" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36191 } }
I20260807 08:43:24.126917 26906 raft_consensus.cc:729] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b613e818b8244abf87c22fd1a9302f34, State: Initialized, Role: FOLLOWER
I20260807 08:43:24.127431 26906 consensus_queue.cc:260] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b613e818b8244abf87c22fd1a9302f34" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36191 } }
I20260807 08:43:24.127589 26906 raft_consensus.cc:388] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:43:24.127712 26906 raft_consensus.cc:482] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:43:24.127818 26906 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [term 2 FOLLOWER]: Advancing to term 3
I20260807 08:43:24.129598 26906 raft_consensus.cc:504] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b613e818b8244abf87c22fd1a9302f34" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36191 } }
I20260807 08:43:24.129959 26906 leader_election.cc:302] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b613e818b8244abf87c22fd1a9302f34; no voters:
I20260807 08:43:24.130302 26906 leader_election.cc:288] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 08:43:24.130383 26910 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 08:43:24.130599 26910 raft_consensus.cc:686] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [term 3 LEADER]: Becoming Leader. State: Replica: b613e818b8244abf87c22fd1a9302f34, State: Running, Role: LEADER
I20260807 08:43:24.130931 26910 consensus_queue.cc:237] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b613e818b8244abf87c22fd1a9302f34" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36191 } }
I20260807 08:43:24.131498 26906 sys_catalog.cc:564] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:43:24.131865 26910 sys_catalog.cc:455] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b613e818b8244abf87c22fd1a9302f34. Latest consensus state: current_term: 3 leader_uuid: "b613e818b8244abf87c22fd1a9302f34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b613e818b8244abf87c22fd1a9302f34" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36191 } } }
I20260807 08:43:24.131979 26910 sys_catalog.cc:458] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:24.132354 26914 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:43:24.132375 26911 sys_catalog.cc:455] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "b613e818b8244abf87c22fd1a9302f34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b613e818b8244abf87c22fd1a9302f34" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 36191 } } }
I20260807 08:43:24.132596 26911 sys_catalog.cc:458] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34 [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:24.137135 26914 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:43:24.137712 26914 catalog_manager.cc:1259] Loaded cluster ID: 14b61493f3f9481ab8451681d621bc6a
I20260807 08:43:24.137769 26914 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:43:24.139886 26914 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:43:24.140540 26914 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34: Loaded TSK: 0
I20260807 08:43:24.140614 26914 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b613e818b8244abf87c22fd1a9302f34: Loaded TSK: 1
F20260807 08:43:24.141249 26914 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f485ee129ad google::LogMessage::Fail() at ??:0
@ 0x7f485ee1588a google::LogMessage::SendToLog() at ??:0
@ 0x7f485ee124de google::LogMessage::Flush() at ??:0
@ 0x7f485ee13a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f4861ad618d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f4861acef0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f48697777bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f486975199c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f4869752178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f4869793df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f48697b282b std::function<>::operator()() at ??:0
@ 0x7f4869751b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f4869752f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f486974f579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f4869793640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f48610643d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f4861064c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f48610663f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f4861055512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f48626996db start_thread at ??:0
@ 0x7f485d91061f clone at ??:0
W20260807 08:43:24.226079 26908 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:24.226249 26908 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:24.226281 26908 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:24.230188 26908 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:24.230253 26908 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:24.230356 26908 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:43:24.235251 26908 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:41351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:46071
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=34049
--tserver_master_addrs=127.8.208.254:36191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26908
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:24.236162 26908 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:24.237038 26908 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:24.245774 26959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:24.245811 26960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:24.246043 26962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:24.246217 26908 server_base.cc:1034] running on GCE node
I20260807 08:43:24.246686 26908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:24.247241 26908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:24.248420 26908 hybrid_clock.cc:648] HybridClock initialized: now 1786092204248399 us; error 37 us; skew 500 ppm
Aug 07 08:43:24 dist-test-slave-6nmv krb5kdc[25686](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092204, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:24.251222 26908 init.cc:377] Logged in from keytab as kudu/127.8.208.193@KRBTEST.COM (short username kudu)
I20260807 08:43:24.252236 26908 webserver.cc:460] Webserver started at http://127.8.208.193:34049/ using document root <none> and password file <none>
I20260807 08:43:24.252894 26908 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:24.252985 26908 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:24.257870 26908 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 08:43:24.260382 26969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:24.261919 26908 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 08:43:24.262048 26908 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "da9e594e7bc949828050f45546d32b0b"
format_stamp: "Formatted at 2026-08-07 08:42:41 on dist-test-slave-6nmv"
server_key: "9d257e5e86a400c6e37068bf1fbba4ee"
server_key_iv: "e511cc60494dcb3368e7759881523b82"
server_key_version: "encryptionkey@0"
I20260807 08:43:24.262701 26908 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:24.286649 26908 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:24.290119 26908 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:24.290297 26908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:24.290951 26908 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:43:24.292163 26976 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 08:43:24.296033 26908 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 08:43:24.296098 26908 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.001s sys 0.000s
I20260807 08:43:24.296155 26908 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 08:43:24.298197 26908 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 08:43:24.298249 26908 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20260807 08:43:24.298508 26976 tablet_bootstrap.cc:492] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b: Bootstrap starting.
I20260807 08:43:24.308250 26908 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:46071
I20260807 08:43:24.308394 27095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:46071 every 8 connection(s)
I20260807 08:43:24.309331 26908 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:43:24.315544 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 26908
I20260807 08:43:24.315997 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:33391
--local_ip_for_outbound_sockets=127.8.208.194
--tserver_master_addrs=127.8.208.254:36191
--webserver_port=43665
--webserver_interface=127.8.208.194
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:41351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 08:43:24.316995 26976 log.cc:824] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:24.325946 26976 tablet_bootstrap.cc:492] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 08:43:24.326359 26976 tablet_bootstrap.cc:492] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b: Bootstrap complete.
I20260807 08:43:24.327896 26976 ts_tablet_manager.cc:1397] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b: Time spent bootstrapping tablet: real 0.030s user 0.014s sys 0.014s
I20260807 08:43:24.330796 26976 raft_consensus.cc:348] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:43:24.331284 26976 raft_consensus.cc:729] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: da9e594e7bc949828050f45546d32b0b, State: Initialized, Role: FOLLOWER
I20260807 08:43:24.331800 26976 consensus_queue.cc:260] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:43:24.332737 26976 ts_tablet_manager.cc:1428] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260807 08:43:24.370057 27098 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:43:24.311276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.193:42527)
0807 08:43:24.311811 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:24.311862 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:24.312994 (+ 1132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:24.369376 (+ 56382us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":130,"threads_started":1}
W20260807 08:43:24.370486 27096 heartbeater.cc:644] Failed to heartbeat to 127.8.208.254:36191 (0 consecutive failures): Network error: Failed to ping master at 127.8.208.254:36191: Client connection negotiation failed: client connection to 127.8.208.254:36191: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 08:43:24.371177 27098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:24.370953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.193:58689)
0807 08:43:24.371075 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:24.371130 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260807 08:43:24.371840 27098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:24.371621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.193:41569)
0807 08:43:24.371738 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:24.371799 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260807 08:43:24.372040 27096 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 08:43:24.424692 27100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:24.424924 27100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:24.425005 27100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:24.428709 27100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:24.428772 27100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:24.428846 27100 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:43:24.433590 27100 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:41351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:33391
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=43665
--tserver_master_addrs=127.8.208.254:36191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:24.434500 27100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:24.435353 27100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:24.443925 27110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:24.443931 27107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:24.443931 27108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:24.444072 27100 server_base.cc:1034] running on GCE node
I20260807 08:43:24.444603 27100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:24.445129 27100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:24.446286 27100 hybrid_clock.cc:648] HybridClock initialized: now 1786092204446275 us; error 22 us; skew 500 ppm
Aug 07 08:43:24 dist-test-slave-6nmv krb5kdc[25686](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092204, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:24.448812 27100 init.cc:377] Logged in from keytab as kudu/127.8.208.194@KRBTEST.COM (short username kudu)
I20260807 08:43:24.449509 27100 webserver.cc:460] Webserver started at http://127.8.208.194:43665/ using document root <none> and password file <none>
I20260807 08:43:24.450026 27100 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:24.450088 27100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:24.453431 27100 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:43:24.455364 27118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:24.456367 27100 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 08:43:24.456482 27100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "32f49284d7bc404ebc3afa369601d82b"
format_stamp: "Formatted at 2026-08-07 08:42:42 on dist-test-slave-6nmv"
server_key: "d7bd89cf54a994a1139413b68458f889"
server_key_iv: "763d6fec784e09418689bf95d5dc220e"
server_key_version: "encryptionkey@0"
I20260807 08:43:24.456967 27100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:24.475602 27100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:24.478756 27100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:24.478942 27100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:24.479460 27100 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:43:24.480213 27100 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:43:24.480312 27100 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:24.480382 27100 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:43:24.480425 27100 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:24.489403 27100 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:33391
I20260807 08:43:24.489426 27237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:33391 every 8 connection(s)
I20260807 08:43:24.490278 27100 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:43:24.493300 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 27100
I20260807 08:43:24.493780 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:41079
--local_ip_for_outbound_sockets=127.8.208.195
--tserver_master_addrs=127.8.208.254:36191
--webserver_port=38055
--webserver_interface=127.8.208.195
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:41351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 08:43:24.494052 27241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:24.492126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.194:40049)
0807 08:43:24.492956 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:24.493101 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":661,"thread_start_us":529,"threads_started":1}
W20260807 08:43:24.494467 27238 heartbeater.cc:644] Failed to heartbeat to 127.8.208.254:36191 (0 consecutive failures): Network error: Failed to ping master at 127.8.208.254:36191: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
I20260807 08:43:24.495072 27241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:24.494791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.194:44757)
0807 08:43:24.494929 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:24.494993 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260807 08:43:24.495798 27241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:24.495541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.194:56451)
0807 08:43:24.495673 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:24.495734 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 08:43:24.495975 27238 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 08:43:24.593994 27243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:24.594202 27243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:24.594242 27243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:24.598286 27243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:24.598333 27243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:24.598387 27243 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:43:24.607398 27243 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:41351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:41079
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=38055
--tserver_master_addrs=127.8.208.254:36191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27243
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:24.608760 27243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:24.610090 27243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:24.619046 27249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:24.619041 27251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:24.619041 27248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:24.619251 27243 server_base.cc:1034] running on GCE node
I20260807 08:43:24.619779 27243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:24.620373 27243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:24.621551 27243 hybrid_clock.cc:648] HybridClock initialized: now 1786092204621545 us; error 36 us; skew 500 ppm
Aug 07 08:43:24 dist-test-slave-6nmv krb5kdc[25686](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092204, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:24.624408 27243 init.cc:377] Logged in from keytab as kudu/127.8.208.195@KRBTEST.COM (short username kudu)
I20260807 08:43:24.625195 27243 webserver.cc:460] Webserver started at http://127.8.208.195:38055/ using document root <none> and password file <none>
I20260807 08:43:24.625689 27243 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:24.625771 27243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:24.629238 27243 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:43:24.631122 27259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:24.632266 27243 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 08:43:24.632400 27243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "89fb5afa863d48bea21183245dc6b08a"
format_stamp: "Formatted at 2026-08-07 08:42:42 on dist-test-slave-6nmv"
server_key: "c2c051f01c0c5cfafbb2b965f6d8d56a"
server_key_iv: "b83a90e9015ceedb6b157d2daa141250"
server_key_version: "encryptionkey@0"
I20260807 08:43:24.632899 27243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:24.642040 27243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:24.644699 27243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:24.644876 27243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:24.645414 27243 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:43:24.646273 27243 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:43:24.646322 27243 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:24.646399 27243 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:43:24.646436 27243 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:24.654606 27243 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:41079
I20260807 08:43:24.654698 27377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:41079 every 8 connection(s)
I20260807 08:43:24.655503 27243 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:43:24.658905 27380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:24.657329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.195:41327)
0807 08:43:24.657778 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:24.658299 (+ 521us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":118,"threads_started":1}
W20260807 08:43:24.659469 27378 heartbeater.cc:644] Failed to heartbeat to 127.8.208.254:36191 (0 consecutive failures): Network error: Failed to ping master at 127.8.208.254:36191: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
I20260807 08:43:24.660094 27380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:24.659859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.195:51341)
0807 08:43:24.659974 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:24.660034 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 08:43:24.660468 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 27243
I20260807 08:43:24.661285 27380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:24.661081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.195:37647)
0807 08:43:24.661177 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:24.661215 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 08:43:24.661455 27378 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 08:43:25.372937 27382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:25.372546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.193:43517)
0807 08:43:25.372780 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:25.372839 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":71,"threads_started":1}
I20260807 08:43:25.496800 27383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:25.496430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.194:44855)
0807 08:43:25.496661 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:25.496711 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":62,"threads_started":1}
I20260807 08:43:25.622602 27384 raft_consensus.cc:482] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:43:25.622822 27384 raft_consensus.cc:504] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:43:25.624080 27384 leader_election.cc:288] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89fb5afa863d48bea21183245dc6b08a (127.8.208.195:41079), 32f49284d7bc404ebc3afa369601d82b (127.8.208.194:33391)
Aug 07 08:43:25 dist-test-slave-6nmv krb5kdc[25686](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092204, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for kudu/127.8.208.194@KRBTEST.COM
Aug 07 08:43:25 dist-test-slave-6nmv krb5kdc[25686](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092204, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for kudu/127.8.208.195@KRBTEST.COM
I20260807 08:43:25.642503 27387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:25.624533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:51759 (local address 127.8.208.194:33391)
0807 08:43:25.624969 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:25.624987 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:25.625018 (+ 31us) server_negotiation.cc:407] Connection header received
0807 08:43:25.625643 (+ 625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:25.625648 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:25.626057 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:25.626364 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:25.627597 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:25.628719 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:25.629827 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:25.630285 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:25.630462 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:25.637233 (+ 6771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:25.637238 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:25.637249 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:25.637275 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:25.639317 (+ 2042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:25.639995 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:25.639999 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:25.640003 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:25.640153 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:25.640600 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:25.640603 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:25.640605 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:25.641081 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:25.641205 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:25.642046 (+ 841us) server_negotiation.cc:299] Negotiation successful
0807 08:43:25.642321 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":103,"threads_started":1}
I20260807 08:43:25.642503 27386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:25.624451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:46553 (local address 127.8.208.195:41079)
0807 08:43:25.624889 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:25.624901 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:25.624933 (+ 32us) server_negotiation.cc:407] Connection header received
0807 08:43:25.625543 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:25.625548 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:25.625963 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:25.626292 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:25.627588 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:25.628664 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:25.629787 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:25.630284 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:25.630452 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:25.637565 (+ 7113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:25.637572 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:25.637588 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:25.637622 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:25.639608 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:25.640154 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:25.640160 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:25.640164 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:25.640295 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:25.640600 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:25.640603 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:25.640605 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:25.641095 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:25.641205 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:25.642046 (+ 841us) server_negotiation.cc:299] Negotiation successful
0807 08:43:25.642321 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":77,"threads_started":1}
I20260807 08:43:25.642516 27385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:25.624300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:33391 (local address 127.8.208.193:51759)
0807 08:43:25.624645 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:25.624663 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:25.624769 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:25.626379 (+ 1610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:25.626383 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:25.626923 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:43:25.627402 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:25.627417 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:25.628875 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:25.628881 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:25.629665 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:25.629675 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:25.630418 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:25.630421 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:25.630608 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:25.635083 (+ 4475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:43:25.635144 (+ 61us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:43:25.636995 (+ 1851us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:43:25.639449 (+ 2454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:25.639453 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:25.639464 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:25.639883 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:25.640258 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:25.640260 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:25.640261 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:25.640463 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:25.641229 (+ 766us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:43:25.641236 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:43:25.641659 (+ 423us) client_negotiation.cc:769] Sending connection context
0807 08:43:25.642120 (+ 461us) client_negotiation.cc:240] Negotiation successful
0807 08:43:25.642326 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"mutex_wait_us":360,"spinlock_wait_cycles":73472,"thread_start_us":77,"threads_started":1}
I20260807 08:43:25.642519 27382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:25.624287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:41079 (local address 127.8.208.193:46553)
0807 08:43:25.624628 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:25.624643 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:25.624742 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:25.626332 (+ 1590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:25.626338 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:25.626914 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:43:25.627403 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:25.627416 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:25.628802 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:25.628805 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:25.629661 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:25.629670 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:25.630408 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:25.630411 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:25.630601 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:25.635107 (+ 4506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:43:25.635125 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:43:25.637370 (+ 2245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:43:25.639721 (+ 2351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:25.639725 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:25.639727 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:25.640052 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:25.640407 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:25.640410 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:25.640412 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:25.640498 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:25.641229 (+ 731us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:43:25.641236 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:43:25.641659 (+ 423us) client_negotiation.cc:769] Sending connection context
0807 08:43:25.641923 (+ 264us) client_negotiation.cc:240] Negotiation successful
0807 08:43:25.642264 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":88,"spinlock_wait_cycles":94464}
W20260807 08:43:25.645260 26973 leader_election.cc:341] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 32f49284d7bc404ebc3afa369601d82b (127.8.208.194:33391): Not found: Tablet not found: 6188d7a79b6f490eb2aebe0c955540b8
W20260807 08:43:25.646174 26971 leader_election.cc:341] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 89fb5afa863d48bea21183245dc6b08a (127.8.208.195:41079): Not found: Tablet not found: 6188d7a79b6f490eb2aebe0c955540b8
I20260807 08:43:25.646271 26971 leader_election.cc:302] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da9e594e7bc949828050f45546d32b0b; no voters: 32f49284d7bc404ebc3afa369601d82b, 89fb5afa863d48bea21183245dc6b08a
I20260807 08:43:25.646499 27384 raft_consensus.cc:2726] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 08:43:25.662392 27388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:25.662038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.195:47815)
0807 08:43:25.662239 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:25.662285 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":71,"threads_started":1}
I20260807 08:43:26.374176 27389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:26.373727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.193:49089)
0807 08:43:26.374026 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:26.374080 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":133,"threads_started":1}
I20260807 08:43:26.497887 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:26.497492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.194:38455)
0807 08:43:26.497708 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:26.497754 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":66,"threads_started":1}
I20260807 08:43:26.663559 27391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:26.663027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.195:47817)
0807 08:43:26.663365 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:26.663433 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":113,"threads_started":1}
I20260807 08:43:27.375509 27392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:27.375042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.193:51981)
0807 08:43:27.375339 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:27.375406 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":103,"threads_started":1}
I20260807 08:43:27.412209 27393 raft_consensus.cc:482] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:43:27.412338 27393 raft_consensus.cc:504] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:43:27.412811 27393 leader_election.cc:288] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89fb5afa863d48bea21183245dc6b08a (127.8.208.195:41079), 32f49284d7bc404ebc3afa369601d82b (127.8.208.194:33391)
W20260807 08:43:27.413631 26973 leader_election.cc:341] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 32f49284d7bc404ebc3afa369601d82b (127.8.208.194:33391): Not found: Tablet not found: 6188d7a79b6f490eb2aebe0c955540b8
W20260807 08:43:27.413724 26971 leader_election.cc:341] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 89fb5afa863d48bea21183245dc6b08a (127.8.208.195:41079): Not found: Tablet not found: 6188d7a79b6f490eb2aebe0c955540b8
I20260807 08:43:27.413887 26971 leader_election.cc:302] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da9e594e7bc949828050f45546d32b0b; no voters: 32f49284d7bc404ebc3afa369601d82b, 89fb5afa863d48bea21183245dc6b08a
I20260807 08:43:27.414063 27393 raft_consensus.cc:2726] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 08:43:27.498946 27394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:27.498556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.194:45753)
0807 08:43:27.498820 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:27.498869 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":68,"threads_started":1}
I20260807 08:43:27.664726 27395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:27.664351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.195:59553)
0807 08:43:27.664594 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:27.664642 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":71,"threads_started":1}
I20260807 08:43:28.376735 27396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:28.376339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.193:52089)
0807 08:43:28.376598 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:28.376647 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":86,"threads_started":1}
I20260807 08:43:28.499936 27397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:28.499564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.194:48051)
0807 08:43:28.499799 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:28.499852 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":66,"threads_started":1}
I20260807 08:43:28.665944 27398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:28.665534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.195:50135)
0807 08:43:28.665766 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:28.665866 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":104,"threads_started":1}
I20260807 08:43:29.378242 27399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:29.377761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.193:37455)
0807 08:43:29.378090 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:29.378152 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":77,"threads_started":1}
I20260807 08:43:29.501026 27400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:29.500654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.194:35115)
0807 08:43:29.500881 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:29.500948 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":66,"threads_started":1}
I20260807 08:43:29.666975 27402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:29.666587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.195:37339)
0807 08:43:29.666839 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:29.666888 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":104,"threads_started":1}
I20260807 08:43:30.379297 27403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:30.378916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.193:54399)
0807 08:43:30.379157 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:30.379208 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":71,"threads_started":1}
I20260807 08:43:30.502188 27404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:30.501788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.194:46591)
0807 08:43:30.502062 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:30.502111 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":75,"threads_started":1}
I20260807 08:43:30.668051 27405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:30.667682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.195:45967)
0807 08:43:30.667915 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:30.667966 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":69,"threads_started":1}
I20260807 08:43:30.721931 27406 raft_consensus.cc:482] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:43:30.722054 27406 raft_consensus.cc:504] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:43:30.722597 27406 leader_election.cc:288] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89fb5afa863d48bea21183245dc6b08a (127.8.208.195:41079), 32f49284d7bc404ebc3afa369601d82b (127.8.208.194:33391)
W20260807 08:43:30.723371 26973 leader_election.cc:341] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 32f49284d7bc404ebc3afa369601d82b (127.8.208.194:33391): Not found: Tablet not found: 6188d7a79b6f490eb2aebe0c955540b8
W20260807 08:43:30.723485 26971 leader_election.cc:341] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 89fb5afa863d48bea21183245dc6b08a (127.8.208.195:41079): Not found: Tablet not found: 6188d7a79b6f490eb2aebe0c955540b8
I20260807 08:43:30.723544 26971 leader_election.cc:302] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da9e594e7bc949828050f45546d32b0b; no voters: 32f49284d7bc404ebc3afa369601d82b, 89fb5afa863d48bea21183245dc6b08a
I20260807 08:43:30.723696 27406 raft_consensus.cc:2726] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 08:43:31.380373 27407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:31.379953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.193:43883)
0807 08:43:31.380219 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:31.380275 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":72,"threads_started":1}
I20260807 08:43:31.503273 27408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:31.502854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.194:37607)
0807 08:43:31.503138 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:31.503188 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":82,"threads_started":1}
I20260807 08:43:31.669188 27409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:31.668758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.195:53923)
0807 08:43:31.669045 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:31.669097 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":82,"threads_started":1}
I20260807 08:43:32.381974 27410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:32.381225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.193:41687)
0807 08:43:32.381660 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:32.381755 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":119,"threads_started":1}
I20260807 08:43:32.504383 27411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:32.504009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.194:40219)
0807 08:43:32.504242 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:32.504294 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":74,"threads_started":1}
I20260807 08:43:32.670315 27412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:32.669942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.195:54357)
0807 08:43:32.670183 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:32.670232 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":75,"threads_started":1}
I20260807 08:43:33.383077 27413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:33.382691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.193:47985)
0807 08:43:33.382933 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:33.382985 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":69,"threads_started":1}
I20260807 08:43:33.505532 27414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:33.505111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.194:45841)
0807 08:43:33.505406 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:33.505455 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":92,"threads_started":1}
I20260807 08:43:33.671391 27415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:33.670996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.195:46755)
0807 08:43:33.671243 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:33.671306 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":80,"threads_started":1}
I20260807 08:43:34.384502 27416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:34.384094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.193:58183)
0807 08:43:34.384347 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:34.384402 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":92,"threads_started":1}
I20260807 08:43:34.506652 27417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:34.506245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.194:43207)
0807 08:43:34.506498 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:34.506555 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":73,"threads_started":1}
I20260807 08:43:34.672494 27418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:34.672128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.195:44383)
0807 08:43:34.672355 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:34.672406 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":79,"threads_started":1}
I20260807 08:43:34.865517 27419 raft_consensus.cc:482] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:43:34.865650 27419 raft_consensus.cc:504] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:43:34.866057 27419 leader_election.cc:288] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89fb5afa863d48bea21183245dc6b08a (127.8.208.195:41079), 32f49284d7bc404ebc3afa369601d82b (127.8.208.194:33391)
W20260807 08:43:34.866915 26973 leader_election.cc:341] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 32f49284d7bc404ebc3afa369601d82b (127.8.208.194:33391): Not found: Tablet not found: 6188d7a79b6f490eb2aebe0c955540b8
W20260807 08:43:34.867030 26971 leader_election.cc:341] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 89fb5afa863d48bea21183245dc6b08a (127.8.208.195:41079): Not found: Tablet not found: 6188d7a79b6f490eb2aebe0c955540b8
I20260807 08:43:34.867103 26971 leader_election.cc:302] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da9e594e7bc949828050f45546d32b0b; no voters: 32f49284d7bc404ebc3afa369601d82b, 89fb5afa863d48bea21183245dc6b08a
I20260807 08:43:34.867259 27419 raft_consensus.cc:2726] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 08:43:35.385615 27420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:35.385201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.193:43685)
0807 08:43:35.385472 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:35.385523 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":74,"threads_started":1}
I20260807 08:43:35.507841 27421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:35.507422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.194:51897)
0807 08:43:35.507707 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:35.507756 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":111,"threads_started":1}
I20260807 08:43:35.673542 27422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:35.673142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.195:55335)
0807 08:43:35.673411 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:35.673459 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":82,"threads_started":1}
I20260807 08:43:36.386747 27423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:36.386361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.193:40685)
0807 08:43:36.386600 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:36.386656 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":84,"threads_started":1}
I20260807 08:43:36.508934 27425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:36.508434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.194:34867)
0807 08:43:36.508735 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:36.508803 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":82,"threads_started":1}
I20260807 08:43:36.674602 27426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:36.674199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.195:49349)
0807 08:43:36.674437 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:36.674514 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":76,"threads_started":1}
I20260807 08:43:37.387887 27427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:37.387405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.193:39721)
0807 08:43:37.387746 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:37.387798 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":84,"threads_started":1}
I20260807 08:43:37.393486 27428 raft_consensus.cc:482] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:43:37.393615 27428 raft_consensus.cc:504] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89fb5afa863d48bea21183245dc6b08a" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 41079 } } peers { permanent_uuid: "32f49284d7bc404ebc3afa369601d82b" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 33391 } } peers { permanent_uuid: "da9e594e7bc949828050f45546d32b0b" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 46071 } }
I20260807 08:43:37.394093 27428 leader_election.cc:288] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89fb5afa863d48bea21183245dc6b08a (127.8.208.195:41079), 32f49284d7bc404ebc3afa369601d82b (127.8.208.194:33391)
W20260807 08:43:37.394833 26973 leader_election.cc:341] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 32f49284d7bc404ebc3afa369601d82b (127.8.208.194:33391): Not found: Tablet not found: 6188d7a79b6f490eb2aebe0c955540b8
W20260807 08:43:37.394944 26971 leader_election.cc:341] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 89fb5afa863d48bea21183245dc6b08a (127.8.208.195:41079): Not found: Tablet not found: 6188d7a79b6f490eb2aebe0c955540b8
I20260807 08:43:37.395005 26971 leader_election.cc:302] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da9e594e7bc949828050f45546d32b0b; no voters: 32f49284d7bc404ebc3afa369601d82b, 89fb5afa863d48bea21183245dc6b08a
I20260807 08:43:37.395134 27428 raft_consensus.cc:2726] T 6188d7a79b6f490eb2aebe0c955540b8 P da9e594e7bc949828050f45546d32b0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 08:43:37.510102 27429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:37.509705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.194:36985)
0807 08:43:37.509960 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:37.510008 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":72,"threads_started":1}
I20260807 08:43:37.675669 27430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:37.675255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.195:54835)
0807 08:43:37.675500 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:37.675554 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":78,"threads_started":1}
I20260807 08:43:38.389053 27431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:38.388626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.193:58437)
0807 08:43:38.388907 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:38.388960 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":78,"threads_started":1}
I20260807 08:43:38.511042 27432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:38.510706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.194:42465)
0807 08:43:38.510916 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:38.510963 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":64,"threads_started":1}
I20260807 08:43:38.676743 27433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:38.676355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.195:45987)
0807 08:43:38.676611 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:38.676661 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":102,"threads_started":1}
I20260807 08:43:39.390419 27434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:39.390042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.193:42729)
0807 08:43:39.390278 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:39.390330 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":72,"threads_started":1}
I20260807 08:43:39.512133 27435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:39.511749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:36191 (local address 127.8.208.194:53767)
0807 08:43:39.511998 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:39.512045 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.254:36191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":83,"threads_started":1}
I20260807 08:43:39.661906 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 26908
I20260807 08:43:39.670122 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 27100
I20260807 08:43:39.676985 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 27243
2026-08-07T08:43:39Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59277 ms)
[----------] 30 tests from SecurityITest (232403 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:43:39 dist-test-slave-6nmv krb5kdc[27438](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:43:39 dist-test-slave-6nmv krb5kdc[27438](info): set up 2 sockets
Aug 07 08:43:39 dist-test-slave-6nmv krb5kdc[27438](info): commencing operation
krb5kdc: starting...
W20260807 08:43:40.729012 9027 mini_kdc.cc:121] Time spent starting KDC: real 1.028s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:43:40 dist-test-slave-6nmv krb5kdc[27438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092220, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:43:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:43:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:43:40.842748 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:38101
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:37195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:38101
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:43:40.945789 27451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:40.946076 27451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:40.946113 27451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:40.950021 27451 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:43:40.950065 27451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:40.950084 27451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:40.950100 27451 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:43:40.950127 27451 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:43:40.954891 27451 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:37195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:38101
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:38101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27451
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:40.955696 27451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:40.956521 27451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:40.963866 27457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:40.963877 27456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:40.963886 27459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:40.964085 27451 server_base.cc:1034] running on GCE node
I20260807 08:43:40.964633 27451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:40.965603 27451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:40.966751 27451 hybrid_clock.cc:648] HybridClock initialized: now 1786092220966749 us; error 71 us; skew 500 ppm
Aug 07 08:43:40 dist-test-slave-6nmv krb5kdc[27438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092220, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:40.969250 27451 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:43:40.970083 27451 webserver.cc:460] Webserver started at http://127.8.208.254:36449/ using document root <none> and password file <none>
I20260807 08:43:40.970538 27451 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:40.970595 27451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:40.970736 27451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:40.972502 27451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "a6a5bcc604964a87bf2eed25d90c1cfa"
format_stamp: "Formatted at 2026-08-07 08:43:40 on dist-test-slave-6nmv"
server_key: "bc35e36d0f5ad2b26e05cd36d9066352"
server_key_iv: "1dfb747736d6e96cf233aeac1d0db12e"
server_key_version: "encryptionkey@0"
I20260807 08:43:40.972991 27451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "a6a5bcc604964a87bf2eed25d90c1cfa"
format_stamp: "Formatted at 2026-08-07 08:43:40 on dist-test-slave-6nmv"
server_key: "bc35e36d0f5ad2b26e05cd36d9066352"
server_key_iv: "1dfb747736d6e96cf233aeac1d0db12e"
server_key_version: "encryptionkey@0"
I20260807 08:43:40.976465 27451 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 08:43:40.978508 27466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:40.979532 27451 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:43:40.979660 27451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "a6a5bcc604964a87bf2eed25d90c1cfa"
format_stamp: "Formatted at 2026-08-07 08:43:40 on dist-test-slave-6nmv"
server_key: "bc35e36d0f5ad2b26e05cd36d9066352"
server_key_iv: "1dfb747736d6e96cf233aeac1d0db12e"
server_key_version: "encryptionkey@0"
I20260807 08:43:40.979749 27451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:40.989094 27451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:40.991458 27451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:40.991667 27451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:40.997957 27451 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:38101
I20260807 08:43:40.997978 27522 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:38101 every 8 connection(s)
I20260807 08:43:40.998718 27451 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:43:41.001014 27523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:41.005548 27523 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6a5bcc604964a87bf2eed25d90c1cfa: Bootstrap starting.
I20260807 08:43:41.007638 27523 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a6a5bcc604964a87bf2eed25d90c1cfa: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:41.007848 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 27451
I20260807 08:43:41.007965 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:43:41.008213 9027 external_mini_cluster.cc:1428] Setting key 961fc9472570f898442fe71cf32c4978
I20260807 08:43:41.008324 27523 log.cc:824] T 00000000000000000000000000000000 P a6a5bcc604964a87bf2eed25d90c1cfa: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:41.010051 27523 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6a5bcc604964a87bf2eed25d90c1cfa: No bootstrap required, opened a new log
I20260807 08:43:41.013741 27523 raft_consensus.cc:348] T 00000000000000000000000000000000 P a6a5bcc604964a87bf2eed25d90c1cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6a5bcc604964a87bf2eed25d90c1cfa" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 38101 } }
I20260807 08:43:41.013976 27523 raft_consensus.cc:374] T 00000000000000000000000000000000 P a6a5bcc604964a87bf2eed25d90c1cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:41.014078 27523 raft_consensus.cc:729] T 00000000000000000000000000000000 P a6a5bcc604964a87bf2eed25d90c1cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a5bcc604964a87bf2eed25d90c1cfa, State: Initialized, Role: FOLLOWER
I20260807 08:43:41.014495 27523 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6a5bcc604964a87bf2eed25d90c1cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6a5bcc604964a87bf2eed25d90c1cfa" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 38101 } }
I20260807 08:43:41.014667 27523 raft_consensus.cc:388] T 00000000000000000000000000000000 P a6a5bcc604964a87bf2eed25d90c1cfa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:43:41.014750 27523 raft_consensus.cc:482] T 00000000000000000000000000000000 P a6a5bcc604964a87bf2eed25d90c1cfa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:43:41.014846 27523 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a6a5bcc604964a87bf2eed25d90c1cfa [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:41.015923 27523 raft_consensus.cc:504] T 00000000000000000000000000000000 P a6a5bcc604964a87bf2eed25d90c1cfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6a5bcc604964a87bf2eed25d90c1cfa" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 38101 } }
Aug 07 08:43:41 dist-test-slave-6nmv krb5kdc[27438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092220, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:43:41.016264 27523 leader_election.cc:302] T 00000000000000000000000000000000 P a6a5bcc604964a87bf2eed25d90c1cfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a6a5bcc604964a87bf2eed25d90c1cfa; no voters:
I20260807 08:43:41.016530 27523 leader_election.cc:288] T 00000000000000000000000000000000 P a6a5bcc604964a87bf2eed25d90c1cfa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:43:41.016592 27528 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a6a5bcc604964a87bf2eed25d90c1cfa [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:43:41.016765 27528 raft_consensus.cc:686] T 00000000000000000000000000000000 P a6a5bcc604964a87bf2eed25d90c1cfa [term 1 LEADER]: Becoming Leader. State: Replica: a6a5bcc604964a87bf2eed25d90c1cfa, State: Running, Role: LEADER
I20260807 08:43:41.017055 27528 consensus_queue.cc:237] T 00000000000000000000000000000000 P a6a5bcc604964a87bf2eed25d90c1cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6a5bcc604964a87bf2eed25d90c1cfa" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 38101 } }
I20260807 08:43:41.017584 27523 sys_catalog.cc:564] T 00000000000000000000000000000000 P a6a5bcc604964a87bf2eed25d90c1cfa [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:43:41.018486 27529 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6a5bcc604964a87bf2eed25d90c1cfa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a6a5bcc604964a87bf2eed25d90c1cfa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6a5bcc604964a87bf2eed25d90c1cfa" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 38101 } } }
I20260807 08:43:41.018596 27529 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6a5bcc604964a87bf2eed25d90c1cfa [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:41.018970 27530 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6a5bcc604964a87bf2eed25d90c1cfa [sys.catalog]: SysCatalogTable state changed. Reason: New leader a6a5bcc604964a87bf2eed25d90c1cfa. Latest consensus state: current_term: 1 leader_uuid: "a6a5bcc604964a87bf2eed25d90c1cfa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6a5bcc604964a87bf2eed25d90c1cfa" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 38101 } } }
I20260807 08:43:41.019124 27530 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6a5bcc604964a87bf2eed25d90c1cfa [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:41.020035 27538 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:43:41.021684 27527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:41.009168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42832 (local address 127.8.208.254:38101)
0807 08:43:41.009489 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:41.009502 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:41.009531 (+ 29us) server_negotiation.cc:407] Connection header received
0807 08:43:41.010092 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:41.010132 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:41.010399 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:41.010620 (+ 221us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:41.011369 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.012257 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.013421 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.013870 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.014016 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:41.016771 (+ 2755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:41.016777 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:41.016792 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:41.016817 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:41.018670 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:41.019152 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:41.019158 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:41.019165 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:41.019290 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:41.019607 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:41.019609 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:41.019611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:41.020003 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:41.020169 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:41.020582 (+ 413us) server_negotiation.cc:299] Negotiation successful
0807 08:43:41.020872 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":102,"threads_started":1}
I20260807 08:43:41.022352 27538 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:43:41.027920 27538 catalog_manager.cc:1347] Generated new cluster ID: 7146c54d00d3481c96e171c5463b1a46
I20260807 08:43:41.027981 27538 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:43:41.048035 27538 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:43:41.048987 27538 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:43:41.056990 27538 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a6a5bcc604964a87bf2eed25d90c1cfa: Generated new TSK 0
I20260807 08:43:41.057528 27538 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.208.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
I20260807 08:43:41.090968 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:38101
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:37195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:43:41.226651 27551 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:41.226864 27551 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:41.226902 27551 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:41.230602 27551 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:41.230645 27551 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:41.230697 27551 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:43:41.235615 27551 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:37195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:38101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27551
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:41.236469 27551 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:41.237344 27551 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:41.246104 27556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:41.246129 27557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:41.246104 27559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:41.246344 27551 server_base.cc:1034] running on GCE node
I20260807 08:43:41.246773 27551 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:41.247344 27551 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:41.248518 27551 hybrid_clock.cc:648] HybridClock initialized: now 1786092221248496 us; error 39 us; skew 500 ppm
Aug 07 08:43:41 dist-test-slave-6nmv krb5kdc[27438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092221, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:41.251134 27551 init.cc:377] Logged in from keytab as kudu/127.8.208.193@KRBTEST.COM (short username kudu)
I20260807 08:43:41.251912 27551 webserver.cc:460] Webserver started at http://127.8.208.193:36163/ using document root <none> and password file <none>
I20260807 08:43:41.252413 27551 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:41.252497 27551 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:41.252720 27551 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:41.254581 27551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "8366e9f2e8a04b55b6cc4acbb4f3efb2"
format_stamp: "Formatted at 2026-08-07 08:43:41 on dist-test-slave-6nmv"
server_key: "17168d7705195394c72b329fcb9c0385"
server_key_iv: "f94f05ca4b537be4544c079c57b30e58"
server_key_version: "encryptionkey@0"
I20260807 08:43:41.255139 27551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "8366e9f2e8a04b55b6cc4acbb4f3efb2"
format_stamp: "Formatted at 2026-08-07 08:43:41 on dist-test-slave-6nmv"
server_key: "17168d7705195394c72b329fcb9c0385"
server_key_iv: "f94f05ca4b537be4544c079c57b30e58"
server_key_version: "encryptionkey@0"
I20260807 08:43:41.258477 27551 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 08:43:41.260556 27566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:41.261595 27551 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:43:41.261713 27551 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "8366e9f2e8a04b55b6cc4acbb4f3efb2"
format_stamp: "Formatted at 2026-08-07 08:43:41 on dist-test-slave-6nmv"
server_key: "17168d7705195394c72b329fcb9c0385"
server_key_iv: "f94f05ca4b537be4544c079c57b30e58"
server_key_version: "encryptionkey@0"
I20260807 08:43:41.261806 27551 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:41.283049 27551 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:41.285776 27551 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:41.285933 27551 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:41.286383 27551 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:43:41.287093 27551 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:43:41.287139 27551 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:41.287185 27551 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:43:41.287204 27551 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:41.295774 27551 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:45635
I20260807 08:43:41.295814 27683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:45635 every 8 connection(s)
I20260807 08:43:41.296527 27551 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:43:41.299093 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 27551
I20260807 08:43:41.299326 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
I20260807 08:43:41.299690 9027 external_mini_cluster.cc:1428] Setting key 3d3ca75d2f3379beed0118b5e1b629af
Aug 07 08:43:41 dist-test-slave-6nmv krb5kdc[27438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092221, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.208.194@KRBTEST.COM; defaulting to no policy
I20260807 08:43:41.309968 27527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:41.298207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:51141 (local address 127.8.208.254:38101)
0807 08:43:41.298332 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:41.298336 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:41.299100 (+ 764us) server_negotiation.cc:407] Connection header received
0807 08:43:41.300198 (+ 1098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:41.300201 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:41.300272 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:41.300361 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:41.301683 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.302292 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.303398 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.303670 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.303782 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:41.306164 (+ 2382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:41.306168 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:41.306171 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:41.306202 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:41.307711 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:41.308355 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:41.308358 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:41.308360 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:41.308445 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:41.308831 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:41.308833 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:41.308834 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:41.309000 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:41.309070 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:41.309666 (+ 596us) server_negotiation.cc:299] Negotiation successful
0807 08:43:41.309765 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 08:43:41.310738 27686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:41.298527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:38101 (local address 127.8.208.193:51141)
0807 08:43:41.298952 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:41.298990 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:41.299917 (+ 927us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:41.300562 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:41.300569 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:41.301023 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:43:41.301530 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:41.301543 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.302441 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.302444 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:41.303264 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:41.303273 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.303818 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.303822 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:41.303998 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:41.304554 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:43:41.304569 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:43:41.306002 (+ 1433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:43:41.307835 (+ 1833us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:41.307844 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:41.307858 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:41.308251 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:41.308546 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:41.308549 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:41.308551 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:41.308732 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:41.309104 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:43:41.309112 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:43:41.309421 (+ 309us) client_negotiation.cc:769] Sending connection context
0807 08:43:41.309619 (+ 198us) client_negotiation.cc:240] Negotiation successful
0807 08:43:41.309979 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":109,"threads_started":1}
I20260807 08:43:41.311924 27684 heartbeater.cc:347] Connected to a master server at 127.8.208.254:38101
I20260807 08:43:41.312119 27684 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.194@KRBTEST.COM" created.
I20260807 08:43:41.312548 27684 heartbeater.cc:511] Master 127.8.208.254:38101 requested a full tablet report, sending...
I20260807 08:43:41.313983 27484 ts_manager.cc:194] Registered new tserver with Master: 8366e9f2e8a04b55b6cc4acbb4f3efb2 (127.8.208.193:45635)
I20260807 08:43:41.315538 27484 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.193@KRBTEST.COM'} at 127.8.208.193:51141
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
I20260807 08:43:41.326821 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:38101
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:37195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:43:41.429291 27689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:41.429502 27689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:41.429538 27689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:41.433355 27689 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:41.433400 27689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:41.433446 27689 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:43:41.437999 27689 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:37195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:38101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27689
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:41.438751 27689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:41.439560 27689 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:41.448450 27694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:41.448449 27695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:41.448467 27697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:41.448874 27689 server_base.cc:1034] running on GCE node
I20260807 08:43:41.449270 27689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:41.449875 27689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:41.451051 27689 hybrid_clock.cc:648] HybridClock initialized: now 1786092221451043 us; error 25 us; skew 500 ppm
Aug 07 08:43:41 dist-test-slave-6nmv krb5kdc[27438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092221, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:41.453795 27689 init.cc:377] Logged in from keytab as kudu/127.8.208.194@KRBTEST.COM (short username kudu)
I20260807 08:43:41.454602 27689 webserver.cc:460] Webserver started at http://127.8.208.194:41189/ using document root <none> and password file <none>
I20260807 08:43:41.455122 27689 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:41.455206 27689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:41.455417 27689 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:41.457396 27689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "729f0e54c95a49cc9f621ae566913d1f"
format_stamp: "Formatted at 2026-08-07 08:43:41 on dist-test-slave-6nmv"
server_key: "878f03c0905d1c22eddbb3737093b118"
server_key_iv: "334eb5ceb7a847443b1cfc2f45f50931"
server_key_version: "encryptionkey@0"
I20260807 08:43:41.458045 27689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "729f0e54c95a49cc9f621ae566913d1f"
format_stamp: "Formatted at 2026-08-07 08:43:41 on dist-test-slave-6nmv"
server_key: "878f03c0905d1c22eddbb3737093b118"
server_key_iv: "334eb5ceb7a847443b1cfc2f45f50931"
server_key_version: "encryptionkey@0"
I20260807 08:43:41.461596 27689 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 08:43:41.463757 27704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:41.465001 27689 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:43:41.465150 27689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "729f0e54c95a49cc9f621ae566913d1f"
format_stamp: "Formatted at 2026-08-07 08:43:41 on dist-test-slave-6nmv"
server_key: "878f03c0905d1c22eddbb3737093b118"
server_key_iv: "334eb5ceb7a847443b1cfc2f45f50931"
server_key_version: "encryptionkey@0"
I20260807 08:43:41.465270 27689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:41.486915 27689 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:41.490214 27689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:41.490440 27689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:41.491032 27689 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:43:41.491950 27689 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:43:41.492019 27689 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:41.492090 27689 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:43:41.492139 27689 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:41.501195 27689 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:32853
I20260807 08:43:41.501232 27823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:32853 every 8 connection(s)
I20260807 08:43:41.502146 27689 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
Aug 07 08:43:41 dist-test-slave-6nmv krb5kdc[27438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092221, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:43:41.512246 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 27689
I20260807 08:43:41.512426 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:43:41.512815 9027 external_mini_cluster.cc:1428] Setting key ada529eaba773608c7f199595ab99b32
I20260807 08:43:41.514840 27527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:41.503833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:46993 (local address 127.8.208.254:38101)
0807 08:43:41.503958 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:41.503962 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:41.504738 (+ 776us) server_negotiation.cc:407] Connection header received
0807 08:43:41.505599 (+ 861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:41.505603 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:41.505664 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:41.505767 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:41.506853 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.507373 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.508443 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.508667 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.508775 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:41.511023 (+ 2248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:41.511027 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:41.511029 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:41.511050 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:41.512546 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:41.513207 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:41.513209 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:41.513210 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:41.513307 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:41.513728 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:41.513730 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:41.513732 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:41.513959 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:41.514056 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:41.514627 (+ 571us) server_negotiation.cc:299] Negotiation successful
0807 08:43:41.514724 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 08:43:41.515976 27826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:41.504160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:38101 (local address 127.8.208.194:46993)
0807 08:43:41.504602 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:41.504641 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:41.505398 (+ 757us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:41.505958 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:41.505965 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:41.506287 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:43:41.506716 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:41.506728 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.507494 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.507502 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:41.508322 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:41.508330 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.508810 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.508814 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:41.508968 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:41.509483 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:43:41.509498 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:43:41.510864 (+ 1366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:43:41.512677 (+ 1813us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:41.512684 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:41.512697 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:41.513102 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:41.513425 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:41.513428 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:41.513429 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:41.513625 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:41.514055 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:43:41.514060 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:43:41.514348 (+ 288us) client_negotiation.cc:769] Sending connection context
0807 08:43:41.514583 (+ 235us) client_negotiation.cc:240] Negotiation successful
0807 08:43:41.514961 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":126,"threads_started":1}
I20260807 08:43:41.517082 27824 heartbeater.cc:347] Connected to a master server at 127.8.208.254:38101
I20260807 08:43:41.517321 27824 heartbeater.cc:464] Registering TS with master...
I20260807 08:43:41.517890 27824 heartbeater.cc:511] Master 127.8.208.254:38101 requested a full tablet report, sending...
I20260807 08:43:41.518905 27484 ts_manager.cc:194] Registered new tserver with Master: 729f0e54c95a49cc9f621ae566913d1f (127.8.208.194:32853)
I20260807 08:43:41.519804 27484 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.194@KRBTEST.COM'} at 127.8.208.194:46993
WARNING: no policy specified for kudu/127.8.208.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
I20260807 08:43:41.540671 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:38101
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:37195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:43:41.643615 27829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:41.643882 27829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:41.643967 27829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:41.648104 27829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:41.648183 27829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:41.648267 27829 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:43:41.653169 27829 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:37195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:38101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27829
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:41.654117 27829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:41.655100 27829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:41.664124 27835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:41.664098 27834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:41.664191 27829 server_base.cc:1034] running on GCE node
W20260807 08:43:41.664121 27837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:41.664774 27829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:41.665366 27829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:41.666535 27829 hybrid_clock.cc:648] HybridClock initialized: now 1786092221666509 us; error 42 us; skew 500 ppm
Aug 07 08:43:41 dist-test-slave-6nmv krb5kdc[27438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092221, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:41.669271 27829 init.cc:377] Logged in from keytab as kudu/127.8.208.195@KRBTEST.COM (short username kudu)
I20260807 08:43:41.670126 27829 webserver.cc:460] Webserver started at http://127.8.208.195:36141/ using document root <none> and password file <none>
I20260807 08:43:41.670614 27829 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:41.670691 27829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:41.670895 27829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:41.672797 27829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "56730cd37bee425a8531d86b45bfe3b8"
format_stamp: "Formatted at 2026-08-07 08:43:41 on dist-test-slave-6nmv"
server_key: "d6f5c83b1cf7f9bb9ede1414f3175613"
server_key_iv: "8eb170981b0b2ef2e38f9d313e0703f9"
server_key_version: "encryptionkey@0"
I20260807 08:43:41.673326 27829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "56730cd37bee425a8531d86b45bfe3b8"
format_stamp: "Formatted at 2026-08-07 08:43:41 on dist-test-slave-6nmv"
server_key: "d6f5c83b1cf7f9bb9ede1414f3175613"
server_key_iv: "8eb170981b0b2ef2e38f9d313e0703f9"
server_key_version: "encryptionkey@0"
I20260807 08:43:41.676824 27829 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260807 08:43:41.678987 27844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:41.680011 27829 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 08:43:41.680124 27829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "56730cd37bee425a8531d86b45bfe3b8"
format_stamp: "Formatted at 2026-08-07 08:43:41 on dist-test-slave-6nmv"
server_key: "d6f5c83b1cf7f9bb9ede1414f3175613"
server_key_iv: "8eb170981b0b2ef2e38f9d313e0703f9"
server_key_version: "encryptionkey@0"
I20260807 08:43:41.680235 27829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:41.701212 27829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:41.703706 27829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:41.703882 27829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:41.704389 27829 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:43:41.705135 27829 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:43:41.705201 27829 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:41.705264 27829 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:43:41.705312 27829 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:41.713779 27829 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:44953
I20260807 08:43:41.713824 27963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:44953 every 8 connection(s)
I20260807 08:43:41.714509 27829 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:43:41.715822 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 27829
I20260807 08:43:41.716008 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:43:41.716452 9027 external_mini_cluster.cc:1428] Setting key fcdfe21136ddd391b4f43e3ed93d7c39
Aug 07 08:43:41 dist-test-slave-6nmv krb5kdc[27438](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092221, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:43:41.727191 27527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:41.716310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:42873 (local address 127.8.208.254:38101)
0807 08:43:41.716482 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:41.716487 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:41.717700 (+ 1213us) server_negotiation.cc:407] Connection header received
0807 08:43:41.718815 (+ 1115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:41.718818 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:41.718892 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:41.718956 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:41.720083 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.720547 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.721635 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.721867 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.721942 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:41.724119 (+ 2177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:41.724123 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:41.724126 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:41.724156 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:41.725323 (+ 1167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:41.725834 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:41.725840 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:41.725845 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:41.725927 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:41.726279 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:41.726282 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:41.726284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:41.726443 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:41.726541 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:41.726941 (+ 400us) server_negotiation.cc:299] Negotiation successful
0807 08:43:41.727046 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 08:43:41.727783 27966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:41.716691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:38101 (local address 127.8.208.195:42873)
0807 08:43:41.717528 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:41.717587 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:41.718567 (+ 980us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:41.719094 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:41.719100 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:41.719444 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:43:41.719964 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:41.719978 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.720675 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.720678 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:41.721521 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:41.721530 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.721985 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.721987 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:41.722107 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:41.722607 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:43:41.722620 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:43:41.723967 (+ 1347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:43:41.725437 (+ 1470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:41.725442 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:41.725454 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:41.725707 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:41.726020 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:41.726024 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:41.726026 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:41.726177 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:41.726540 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:43:41.726546 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:43:41.726747 (+ 201us) client_negotiation.cc:769] Sending connection context
0807 08:43:41.726902 (+ 155us) client_negotiation.cc:240] Negotiation successful
0807 08:43:41.727164 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":136,"threads_started":1}
I20260807 08:43:41.728772 27964 heartbeater.cc:347] Connected to a master server at 127.8.208.254:38101
I20260807 08:43:41.728978 27964 heartbeater.cc:464] Registering TS with master...
I20260807 08:43:41.729435 27964 heartbeater.cc:511] Master 127.8.208.254:38101 requested a full tablet report, sending...
I20260807 08:43:41.730427 27484 ts_manager.cc:194] Registered new tserver with Master: 56730cd37bee425a8531d86b45bfe3b8 (127.8.208.195:44953)
I20260807 08:43:41.730908 27484 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.195@KRBTEST.COM'} at 127.8.208.195:42873
I20260807 08:43:41.741582 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 08:43:41.750080 27527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:41.743443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42844 (local address 127.8.208.254:38101)
0807 08:43:41.743557 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:41.743561 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:41.743773 (+ 212us) server_negotiation.cc:407] Connection header received
0807 08:43:41.743887 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:41.743890 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:41.743930 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:41.744004 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:41.744610 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.745087 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.745929 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.746162 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.746253 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:41.747417 (+ 1164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:41.747420 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:41.747422 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:41.747444 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:41.748578 (+ 1134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:41.748968 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:41.748971 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:41.748973 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:41.749060 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:41.749300 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:41.749303 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:41.749305 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:41.749493 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:41.749618 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:41.749844 (+ 226us) server_negotiation.cc:299] Negotiation successful
0807 08:43:41.749942 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 08:43:41.752405 27484 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42844:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 08:43:41.755164 27484 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:43:41.767900 27975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:41.762565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:45635 (local address 127.0.0.1:52994)
0807 08:43:41.763029 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:41.763071 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:41.763198 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:41.763749 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:41.763754 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:41.763774 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:41.763882 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:41.763887 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.765197 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.765200 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:41.766298 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:41.766308 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.767431 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.767434 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:41.767538 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:41.767570 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 08:43:41.767683 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 08:43:41.767790 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":77,"threads_started":1}
I20260807 08:43:41.768035 27977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:41.762720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52994 (local address 127.8.208.193:45635)
0807 08:43:41.763232 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:41.763248 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:41.763276 (+ 28us) server_negotiation.cc:407] Connection header received
0807 08:43:41.763347 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:41.763354 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:41.763548 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:41.763696 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:41.764008 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.765031 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.766428 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.767156 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.767229 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:41.767330 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:41.767740 (+ 410us) server_negotiation.cc:299] Negotiation successful
0807 08:43:41.767828 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":101,"threads_started":1}
I20260807 08:43:41.768342 27976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:41.762741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:44953 (local address 127.0.0.1:54040)
0807 08:43:41.763531 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:41.763544 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:41.763631 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:41.764322 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:41.764325 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:41.764341 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:41.764420 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:41.764425 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.765885 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.765888 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:41.766917 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:41.766927 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.767980 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.767983 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:41.768068 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:41.768097 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 08:43:41.768168 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 08:43:41.768233 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":725,"thread_start_us":87,"threads_started":1}
I20260807 08:43:41.768689 27978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:41.763168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54040 (local address 127.8.208.195:44953)
0807 08:43:41.763793 (+ 625us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:41.763803 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:41.763822 (+ 19us) server_negotiation.cc:407] Connection header received
0807 08:43:41.763881 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:41.763885 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:41.764046 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:41.764186 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:41.764536 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.765730 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.767050 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.767733 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.767818 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:41.767924 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:41.768502 (+ 578us) server_negotiation.cc:299] Negotiation successful
0807 08:43:41.768581 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":107,"threads_started":1}
I20260807 08:43:41.770797 27615 tablet_service.cc:1467] Processing CreateTablet for tablet a8cc07ae8ddb41b99fbee67af7679030 (DEFAULT_TABLE table=test-table [id=9b60800f9183498fae15514ba050e262]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:43:41.770927 27894 tablet_service.cc:1467] Processing CreateTablet for tablet a8cc07ae8ddb41b99fbee67af7679030 (DEFAULT_TABLE table=test-table [id=9b60800f9183498fae15514ba050e262]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:43:41.771708 27615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8cc07ae8ddb41b99fbee67af7679030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:41.771718 27894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8cc07ae8ddb41b99fbee67af7679030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:41.777338 27982 tablet_bootstrap.cc:492] T a8cc07ae8ddb41b99fbee67af7679030 P 56730cd37bee425a8531d86b45bfe3b8: Bootstrap starting.
I20260807 08:43:41.777331 27981 tablet_bootstrap.cc:492] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2: Bootstrap starting.
I20260807 08:43:41.778376 27979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:41.763183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:32853 (local address 127.0.0.1:50100)
0807 08:43:41.764102 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:41.764115 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:41.764196 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:41.764716 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:41.764718 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:41.764735 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:41.764813 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:41.764818 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.766324 (+ 1506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.766327 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:41.767321 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:41.767331 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.777919 (+ 10588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.777923 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:41.778011 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:41.778035 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 08:43:41.778160 (+ 125us) client_negotiation.cc:240] Negotiation successful
0807 08:43:41.778240 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":868,"thread_start_us":99,"threads_started":1}
I20260807 08:43:41.778448 27980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:41.763543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50100 (local address 127.8.208.194:32853)
0807 08:43:41.763969 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:41.763981 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:41.764292 (+ 311us) server_negotiation.cc:407] Connection header received
0807 08:43:41.764404 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:41.764408 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:41.764588 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:41.764727 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:41.764918 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.766061 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.767440 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:41.768223 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:41.768325 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:41.768456 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:41.778203 (+ 9747us) server_negotiation.cc:299] Negotiation successful
0807 08:43:41.778313 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":121,"threads_started":1}
I20260807 08:43:41.779924 27981 tablet_bootstrap.cc:654] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:41.780005 27982 tablet_bootstrap.cc:654] T a8cc07ae8ddb41b99fbee67af7679030 P 56730cd37bee425a8531d86b45bfe3b8: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:41.780920 27981 log.cc:824] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:41.781186 27982 log.cc:824] T a8cc07ae8ddb41b99fbee67af7679030 P 56730cd37bee425a8531d86b45bfe3b8: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:41.781412 27754 tablet_service.cc:1467] Processing CreateTablet for tablet a8cc07ae8ddb41b99fbee67af7679030 (DEFAULT_TABLE table=test-table [id=9b60800f9183498fae15514ba050e262]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:43:41.782600 27754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8cc07ae8ddb41b99fbee67af7679030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:41.782773 27981 tablet_bootstrap.cc:492] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2: No bootstrap required, opened a new log
I20260807 08:43:41.782974 27981 ts_tablet_manager.cc:1397] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 08:43:41.783185 27982 tablet_bootstrap.cc:492] T a8cc07ae8ddb41b99fbee67af7679030 P 56730cd37bee425a8531d86b45bfe3b8: No bootstrap required, opened a new log
I20260807 08:43:41.783365 27982 ts_tablet_manager.cc:1397] T a8cc07ae8ddb41b99fbee67af7679030 P 56730cd37bee425a8531d86b45bfe3b8: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 08:43:41.786041 27981 raft_consensus.cc:348] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8366e9f2e8a04b55b6cc4acbb4f3efb2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45635 } } peers { permanent_uuid: "56730cd37bee425a8531d86b45bfe3b8" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 44953 } } peers { permanent_uuid: "729f0e54c95a49cc9f621ae566913d1f" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 32853 } }
I20260807 08:43:41.786217 27981 raft_consensus.cc:374] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:41.786257 27981 raft_consensus.cc:729] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8366e9f2e8a04b55b6cc4acbb4f3efb2, State: Initialized, Role: FOLLOWER
I20260807 08:43:41.786634 27981 consensus_queue.cc:260] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8366e9f2e8a04b55b6cc4acbb4f3efb2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45635 } } peers { permanent_uuid: "56730cd37bee425a8531d86b45bfe3b8" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 44953 } } peers { permanent_uuid: "729f0e54c95a49cc9f621ae566913d1f" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 32853 } }
I20260807 08:43:41.787206 27684 heartbeater.cc:503] Master 127.8.208.254:38101 was elected leader, sending a full tablet report...
I20260807 08:43:41.787022 27982 raft_consensus.cc:348] T a8cc07ae8ddb41b99fbee67af7679030 P 56730cd37bee425a8531d86b45bfe3b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8366e9f2e8a04b55b6cc4acbb4f3efb2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45635 } } peers { permanent_uuid: "56730cd37bee425a8531d86b45bfe3b8" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 44953 } } peers { permanent_uuid: "729f0e54c95a49cc9f621ae566913d1f" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 32853 } }
I20260807 08:43:41.787276 27982 raft_consensus.cc:374] T a8cc07ae8ddb41b99fbee67af7679030 P 56730cd37bee425a8531d86b45bfe3b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:41.787345 27982 raft_consensus.cc:729] T a8cc07ae8ddb41b99fbee67af7679030 P 56730cd37bee425a8531d86b45bfe3b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56730cd37bee425a8531d86b45bfe3b8, State: Initialized, Role: FOLLOWER
I20260807 08:43:41.787451 27981 ts_tablet_manager.cc:1428] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260807 08:43:41.787726 27982 consensus_queue.cc:260] T a8cc07ae8ddb41b99fbee67af7679030 P 56730cd37bee425a8531d86b45bfe3b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8366e9f2e8a04b55b6cc4acbb4f3efb2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45635 } } peers { permanent_uuid: "56730cd37bee425a8531d86b45bfe3b8" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 44953 } } peers { permanent_uuid: "729f0e54c95a49cc9f621ae566913d1f" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 32853 } }
I20260807 08:43:41.788327 27964 heartbeater.cc:503] Master 127.8.208.254:38101 was elected leader, sending a full tablet report...
I20260807 08:43:41.788636 27982 ts_tablet_manager.cc:1428] T a8cc07ae8ddb41b99fbee67af7679030 P 56730cd37bee425a8531d86b45bfe3b8: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 08:43:41.790155 27987 tablet_bootstrap.cc:492] T a8cc07ae8ddb41b99fbee67af7679030 P 729f0e54c95a49cc9f621ae566913d1f: Bootstrap starting.
I20260807 08:43:41.792611 27987 tablet_bootstrap.cc:654] T a8cc07ae8ddb41b99fbee67af7679030 P 729f0e54c95a49cc9f621ae566913d1f: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:41.793289 27987 log.cc:824] T a8cc07ae8ddb41b99fbee67af7679030 P 729f0e54c95a49cc9f621ae566913d1f: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:41.794699 27987 tablet_bootstrap.cc:492] T a8cc07ae8ddb41b99fbee67af7679030 P 729f0e54c95a49cc9f621ae566913d1f: No bootstrap required, opened a new log
I20260807 08:43:41.794828 27987 ts_tablet_manager.cc:1397] T a8cc07ae8ddb41b99fbee67af7679030 P 729f0e54c95a49cc9f621ae566913d1f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 08:43:41.797271 27987 raft_consensus.cc:348] T a8cc07ae8ddb41b99fbee67af7679030 P 729f0e54c95a49cc9f621ae566913d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8366e9f2e8a04b55b6cc4acbb4f3efb2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45635 } } peers { permanent_uuid: "56730cd37bee425a8531d86b45bfe3b8" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 44953 } } peers { permanent_uuid: "729f0e54c95a49cc9f621ae566913d1f" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 32853 } }
I20260807 08:43:41.797449 27987 raft_consensus.cc:374] T a8cc07ae8ddb41b99fbee67af7679030 P 729f0e54c95a49cc9f621ae566913d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:41.797485 27987 raft_consensus.cc:729] T a8cc07ae8ddb41b99fbee67af7679030 P 729f0e54c95a49cc9f621ae566913d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729f0e54c95a49cc9f621ae566913d1f, State: Initialized, Role: FOLLOWER
W20260807 08:43:41.797654 27685 tablet.cc:2369] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 08:43:41.797902 27987 consensus_queue.cc:260] T a8cc07ae8ddb41b99fbee67af7679030 P 729f0e54c95a49cc9f621ae566913d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8366e9f2e8a04b55b6cc4acbb4f3efb2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45635 } } peers { permanent_uuid: "56730cd37bee425a8531d86b45bfe3b8" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 44953 } } peers { permanent_uuid: "729f0e54c95a49cc9f621ae566913d1f" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 32853 } }
I20260807 08:43:41.798542 27824 heartbeater.cc:503] Master 127.8.208.254:38101 was elected leader, sending a full tablet report...
I20260807 08:43:41.798661 27987 ts_tablet_manager.cc:1428] T a8cc07ae8ddb41b99fbee67af7679030 P 729f0e54c95a49cc9f621ae566913d1f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
W20260807 08:43:41.965384 27965 tablet.cc:2369] T a8cc07ae8ddb41b99fbee67af7679030 P 56730cd37bee425a8531d86b45bfe3b8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 08:43:42.003224 27825 tablet.cc:2369] T a8cc07ae8ddb41b99fbee67af7679030 P 729f0e54c95a49cc9f621ae566913d1f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 08:43:42.016433 27985 raft_consensus.cc:482] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:43:42.016678 27985 raft_consensus.cc:504] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8366e9f2e8a04b55b6cc4acbb4f3efb2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45635 } } peers { permanent_uuid: "56730cd37bee425a8531d86b45bfe3b8" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 44953 } } peers { permanent_uuid: "729f0e54c95a49cc9f621ae566913d1f" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 32853 } }
I20260807 08:43:42.017936 27985 leader_election.cc:288] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56730cd37bee425a8531d86b45bfe3b8 (127.8.208.195:44953), 729f0e54c95a49cc9f621ae566913d1f (127.8.208.194:32853)
I20260807 08:43:42.021852 27990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:42.018062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:44953 (local address 127.8.208.193:58081)
0807 08:43:42.018359 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:42.018421 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:42.018526 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:42.018833 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:42.018835 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:42.018852 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:42.019010 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:42.019016 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.019839 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.019842 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:42.020695 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:42.020704 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.021413 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.021419 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:42.021516 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:42.021551 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 08:43:42.021633 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 08:43:42.021685 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"mutex_wait_us":36,"thread_start_us":114,"threads_started":1}
I20260807 08:43:42.021899 27978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:42.018198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:58081 (local address 127.8.208.195:44953)
0807 08:43:42.018382 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:42.018389 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:42.018477 (+ 88us) server_negotiation.cc:407] Connection header received
0807 08:43:42.018651 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:42.018654 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:42.018727 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:42.018826 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:42.019122 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.019737 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.020820 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.021301 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.021398 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:42.021438 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:42.021661 (+ 223us) server_negotiation.cc:299] Negotiation successful
0807 08:43:42.021748 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 08:43:42.021970 27980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:42.018606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:36175 (local address 127.8.208.194:32853)
0807 08:43:42.018751 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:42.018754 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:42.018915 (+ 161us) server_negotiation.cc:407] Connection header received
0807 08:43:42.019030 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:42.019033 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:42.019086 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:42.019155 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:42.019449 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.019919 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.021013 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.021396 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.021510 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:42.021565 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:42.021760 (+ 195us) server_negotiation.cc:299] Negotiation successful
0807 08:43:42.021847 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 08:43:42.021993 27991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:42.018483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:32853 (local address 127.8.208.193:36175)
0807 08:43:42.018822 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:42.018835 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:42.018932 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:42.019185 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:42.019188 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:42.019205 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:42.019313 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:42.019319 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.020032 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.020034 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:42.020887 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:42.020897 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.021515 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.021519 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:42.021634 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:42.021660 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 08:43:42.021734 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 08:43:42.021794 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"mutex_wait_us":19,"thread_start_us":114,"threads_started":1}
I20260807 08:43:42.022606 27775 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8cc07ae8ddb41b99fbee67af7679030" candidate_uuid: "8366e9f2e8a04b55b6cc4acbb4f3efb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729f0e54c95a49cc9f621ae566913d1f" is_pre_election: true
I20260807 08:43:42.022608 27915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8cc07ae8ddb41b99fbee67af7679030" candidate_uuid: "8366e9f2e8a04b55b6cc4acbb4f3efb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56730cd37bee425a8531d86b45bfe3b8" is_pre_election: true
I20260807 08:43:42.022888 27775 raft_consensus.cc:2454] T a8cc07ae8ddb41b99fbee67af7679030 P 729f0e54c95a49cc9f621ae566913d1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8366e9f2e8a04b55b6cc4acbb4f3efb2 in term 0.
I20260807 08:43:42.022888 27915 raft_consensus.cc:2454] T a8cc07ae8ddb41b99fbee67af7679030 P 56730cd37bee425a8531d86b45bfe3b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8366e9f2e8a04b55b6cc4acbb4f3efb2 in term 0.
I20260807 08:43:42.023388 27568 leader_election.cc:302] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729f0e54c95a49cc9f621ae566913d1f, 8366e9f2e8a04b55b6cc4acbb4f3efb2; no voters:
I20260807 08:43:42.023631 27985 raft_consensus.cc:2781] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:43:42.023730 27985 raft_consensus.cc:482] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:43:42.023784 27985 raft_consensus.cc:3037] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:42.024814 27985 raft_consensus.cc:504] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8366e9f2e8a04b55b6cc4acbb4f3efb2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45635 } } peers { permanent_uuid: "56730cd37bee425a8531d86b45bfe3b8" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 44953 } } peers { permanent_uuid: "729f0e54c95a49cc9f621ae566913d1f" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 32853 } }
I20260807 08:43:42.025192 27985 leader_election.cc:288] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2 [CANDIDATE]: Term 1 election: Requested vote from peers 56730cd37bee425a8531d86b45bfe3b8 (127.8.208.195:44953), 729f0e54c95a49cc9f621ae566913d1f (127.8.208.194:32853)
I20260807 08:43:42.025559 27915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8cc07ae8ddb41b99fbee67af7679030" candidate_uuid: "8366e9f2e8a04b55b6cc4acbb4f3efb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56730cd37bee425a8531d86b45bfe3b8"
I20260807 08:43:42.025581 27775 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8cc07ae8ddb41b99fbee67af7679030" candidate_uuid: "8366e9f2e8a04b55b6cc4acbb4f3efb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729f0e54c95a49cc9f621ae566913d1f"
I20260807 08:43:42.025701 27775 raft_consensus.cc:3037] T a8cc07ae8ddb41b99fbee67af7679030 P 729f0e54c95a49cc9f621ae566913d1f [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:42.025701 27915 raft_consensus.cc:3037] T a8cc07ae8ddb41b99fbee67af7679030 P 56730cd37bee425a8531d86b45bfe3b8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:42.027024 27915 raft_consensus.cc:2454] T a8cc07ae8ddb41b99fbee67af7679030 P 56730cd37bee425a8531d86b45bfe3b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8366e9f2e8a04b55b6cc4acbb4f3efb2 in term 1.
I20260807 08:43:42.027024 27775 raft_consensus.cc:2454] T a8cc07ae8ddb41b99fbee67af7679030 P 729f0e54c95a49cc9f621ae566913d1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8366e9f2e8a04b55b6cc4acbb4f3efb2 in term 1.
I20260807 08:43:42.027326 27568 leader_election.cc:302] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56730cd37bee425a8531d86b45bfe3b8, 8366e9f2e8a04b55b6cc4acbb4f3efb2; no voters:
I20260807 08:43:42.027515 27985 raft_consensus.cc:2781] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:43:42.027765 27985 raft_consensus.cc:686] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2 [term 1 LEADER]: Becoming Leader. State: Replica: 8366e9f2e8a04b55b6cc4acbb4f3efb2, State: Running, Role: LEADER
I20260807 08:43:42.028092 27985 consensus_queue.cc:237] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8366e9f2e8a04b55b6cc4acbb4f3efb2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45635 } } peers { permanent_uuid: "56730cd37bee425a8531d86b45bfe3b8" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 44953 } } peers { permanent_uuid: "729f0e54c95a49cc9f621ae566913d1f" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 32853 } }
I20260807 08:43:42.031216 27482 catalog_manager.cc:5495] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8366e9f2e8a04b55b6cc4acbb4f3efb2 (127.8.208.193). New cstate: current_term: 1 leader_uuid: "8366e9f2e8a04b55b6cc4acbb4f3efb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8366e9f2e8a04b55b6cc4acbb4f3efb2" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 45635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56730cd37bee425a8531d86b45bfe3b8" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 44953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "729f0e54c95a49cc9f621ae566913d1f" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 32853 } health_report { overall_health: UNKNOWN } } }
I20260807 08:43:42.056035 27977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:42.052776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53008 (local address 127.8.208.193:45635)
0807 08:43:42.052920 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:42.052923 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:42.052988 (+ 65us) server_negotiation.cc:407] Connection header received
0807 08:43:42.053110 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:42.053111 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:42.053155 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:42.053226 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:43:42.053411 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.053876 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.054678 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.054872 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.054992 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:42.055310 (+ 318us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:43:42.055673 (+ 363us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:43:42.055794 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:42.055856 (+ 62us) server_negotiation.cc:299] Negotiation successful
0807 08:43:42.055907 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 08:43:42.061306 27775 raft_consensus.cc:1261] T a8cc07ae8ddb41b99fbee67af7679030 P 729f0e54c95a49cc9f621ae566913d1f [term 1 FOLLOWER]: Refusing update from remote peer 8366e9f2e8a04b55b6cc4acbb4f3efb2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:43:42.061324 27915 raft_consensus.cc:1261] T a8cc07ae8ddb41b99fbee67af7679030 P 56730cd37bee425a8531d86b45bfe3b8 [term 1 FOLLOWER]: Refusing update from remote peer 8366e9f2e8a04b55b6cc4acbb4f3efb2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:43:42.061992 27985 consensus_queue.cc:1035] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56730cd37bee425a8531d86b45bfe3b8" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 44953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:43:42.062193 27992 consensus_queue.cc:1035] T a8cc07ae8ddb41b99fbee67af7679030 P 8366e9f2e8a04b55b6cc4acbb4f3efb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729f0e54c95a49cc9f621ae566913d1f" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 32853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:43:42.069412 27996 mvcc.cc:205] Tried to move back new op lower bound from 7315833741556699136 to 7315833741429862400. Current Snapshot: MvccSnapshot[applied={T|T < 7315833741556699136}]
I20260807 08:43:42.070367 27997 mvcc.cc:205] Tried to move back new op lower bound from 7315833741556699136 to 7315833741429862400. Current Snapshot: MvccSnapshot[applied={T|T < 7315833741556699136}]
I20260807 08:43:42.077514 27482 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42844:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:43:42.077674 27482 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42844:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:43:42.079898 27482 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a6a5bcc604964a87bf2eed25d90c1cfa: Sending DeleteTablet for 3 replicas of tablet a8cc07ae8ddb41b99fbee67af7679030
I20260807 08:43:42.080629 27615 tablet_service.cc:1514] Processing DeleteTablet for tablet a8cc07ae8ddb41b99fbee67af7679030 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:43:42 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:52994
I20260807 08:43:42.080761 27894 tablet_service.cc:1514] Processing DeleteTablet for tablet a8cc07ae8ddb41b99fbee67af7679030 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:43:42 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:54040
I20260807 08:43:42.081022 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 27551
I20260807 08:43:42.081161 27754 tablet_service.cc:1514] Processing DeleteTablet for tablet a8cc07ae8ddb41b99fbee67af7679030 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:43:42 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:50100
I20260807 08:43:42.083355 28008 tablet_replica.cc:330] T a8cc07ae8ddb41b99fbee67af7679030 P 729f0e54c95a49cc9f621ae566913d1f: stopping tablet replica
I20260807 08:43:42.083627 28007 tablet_replica.cc:330] T a8cc07ae8ddb41b99fbee67af7679030 P 56730cd37bee425a8531d86b45bfe3b8: stopping tablet replica
I20260807 08:43:42.083654 28008 raft_consensus.cc:2229] T a8cc07ae8ddb41b99fbee67af7679030 P 729f0e54c95a49cc9f621ae566913d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:43:42.083910 28007 raft_consensus.cc:2229] T a8cc07ae8ddb41b99fbee67af7679030 P 56730cd37bee425a8531d86b45bfe3b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:43:42.083940 28008 raft_consensus.cc:2258] T a8cc07ae8ddb41b99fbee67af7679030 P 729f0e54c95a49cc9f621ae566913d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:43:42.084160 28007 raft_consensus.cc:2258] T a8cc07ae8ddb41b99fbee67af7679030 P 56730cd37bee425a8531d86b45bfe3b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:43:42.085325 28008 ts_tablet_manager.cc:1905] T a8cc07ae8ddb41b99fbee67af7679030 P 729f0e54c95a49cc9f621ae566913d1f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:43:42.087505 28008 ts_tablet_manager.cc:1918] T a8cc07ae8ddb41b99fbee67af7679030 P 729f0e54c95a49cc9f621ae566913d1f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:43:42.087580 28008 log.cc:1196] T a8cc07ae8ddb41b99fbee67af7679030 P 729f0e54c95a49cc9f621ae566913d1f: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-1/wal/wals/a8cc07ae8ddb41b99fbee67af7679030
I20260807 08:43:42.087905 28008 ts_tablet_manager.cc:1939] T a8cc07ae8ddb41b99fbee67af7679030 P 729f0e54c95a49cc9f621ae566913d1f: Deleting consensus metadata
I20260807 08:43:42.088708 28007 ts_tablet_manager.cc:1905] T a8cc07ae8ddb41b99fbee67af7679030 P 56730cd37bee425a8531d86b45bfe3b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:43:42.089063 27467 catalog_manager.cc:4841] TS 729f0e54c95a49cc9f621ae566913d1f (127.8.208.194:32853): tablet a8cc07ae8ddb41b99fbee67af7679030 (table test-table [id=9b60800f9183498fae15514ba050e262]) successfully deleted
I20260807 08:43:42.090867 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 27689
W20260807 08:43:42.090862 27469 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.208.193:45635 (error 108)
I20260807 08:43:42.091768 28007 ts_tablet_manager.cc:1918] T a8cc07ae8ddb41b99fbee67af7679030 P 56730cd37bee425a8531d86b45bfe3b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:43:42.091861 28007 log.cc:1196] T a8cc07ae8ddb41b99fbee67af7679030 P 56730cd37bee425a8531d86b45bfe3b8: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/a8cc07ae8ddb41b99fbee67af7679030
I20260807 08:43:42.092206 28007 ts_tablet_manager.cc:1939] T a8cc07ae8ddb41b99fbee67af7679030 P 56730cd37bee425a8531d86b45bfe3b8: Deleting consensus metadata
I20260807 08:43:42.093014 27979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:42.092650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:45635 (local address 127.0.0.1:53022)
0807 08:43:42.092837 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:42.092920 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.193:45635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
W20260807 08:43:42.093195 27469 catalog_manager.cc:4584] TS 8366e9f2e8a04b55b6cc4acbb4f3efb2 (127.8.208.193:45635): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a8cc07ae8ddb41b99fbee67af7679030: Network error: Client connection negotiation failed: client connection to 127.8.208.193:45635: connect: Connection refused (error 111)
I20260807 08:43:42.093439 27467 catalog_manager.cc:4841] TS 56730cd37bee425a8531d86b45bfe3b8 (127.8.208.195:44953): tablet a8cc07ae8ddb41b99fbee67af7679030 (table test-table [id=9b60800f9183498fae15514ba050e262]) successfully deleted
I20260807 08:43:42.098500 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 27829
I20260807 08:43:42.104230 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 27451
2026-08-07T08:43:42Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2426 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-07T08:43:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:43:42Z Disabled control of system clock
I20260807 08:43:42.136500 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:35335
--webserver_interface=127.8.208.254
--webserver_port=0
--builtin_ntp_servers=127.8.208.212:46515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:35335
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 08:43:42.240965 28013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:42.241242 28013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:42.241274 28013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:42.245046 28013 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:43:42.245095 28013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:42.245110 28013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:42.245126 28013 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:43:42.245141 28013 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:43:42.249693 28013 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:46515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:35335
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:35335
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28013
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:42.250682 28013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:42.252097 28013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:42.260417 28019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:42.260512 28013 server_base.cc:1034] running on GCE node
W20260807 08:43:42.260408 28018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:42.260391 28021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:42.261224 28013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:42.262332 28013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:42.263514 28013 hybrid_clock.cc:648] HybridClock initialized: now 1786092222263501 us; error 30 us; skew 500 ppm
I20260807 08:43:42.265210 28013 webserver.cc:460] Webserver started at http://127.8.208.254:39747/ using document root <none> and password file <none>
I20260807 08:43:42.265764 28013 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:42.265878 28013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:42.266122 28013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:42.268043 28013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "82f60e10bebf4e3cbe6d34347cab1c5e"
format_stamp: "Formatted at 2026-08-07 08:43:42 on dist-test-slave-6nmv"
server_key: "aa0b4e981c9b745982c5403e9825e149"
server_key_iv: "d6297f6cc26e339ad01f1b7e67036759"
server_key_version: "encryptionkey@0"
I20260807 08:43:42.268591 28013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "82f60e10bebf4e3cbe6d34347cab1c5e"
format_stamp: "Formatted at 2026-08-07 08:43:42 on dist-test-slave-6nmv"
server_key: "aa0b4e981c9b745982c5403e9825e149"
server_key_iv: "d6297f6cc26e339ad01f1b7e67036759"
server_key_version: "encryptionkey@0"
I20260807 08:43:42.271924 28013 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260807 08:43:42.274132 28027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:42.275269 28013 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:43:42.275403 28013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "82f60e10bebf4e3cbe6d34347cab1c5e"
format_stamp: "Formatted at 2026-08-07 08:43:42 on dist-test-slave-6nmv"
server_key: "aa0b4e981c9b745982c5403e9825e149"
server_key_iv: "d6297f6cc26e339ad01f1b7e67036759"
server_key_version: "encryptionkey@0"
I20260807 08:43:42.275514 28013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:42.292105 28013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:42.292753 28013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:42.292949 28013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:42.299687 28013 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:35335
I20260807 08:43:42.299714 28081 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:35335 every 8 connection(s)
I20260807 08:43:42.300622 28013 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:43:42.301674 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 28013
I20260807 08:43:42.301827 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:43:42.302160 9027 external_mini_cluster.cc:1428] Setting key 802164b236b15e73a8ef6a14b20fcb63
I20260807 08:43:42.304960 28082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:42.310405 28082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82f60e10bebf4e3cbe6d34347cab1c5e: Bootstrap starting.
I20260807 08:43:42.311076 28085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:42.303443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54984 (local address 127.8.208.254:35335)
0807 08:43:42.304089 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:42.304104 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:42.304139 (+ 35us) server_negotiation.cc:407] Connection header received
0807 08:43:42.304780 (+ 641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:42.304795 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:42.305245 (+ 450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:42.305572 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:42.306042 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.306994 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.307837 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.308263 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.308425 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:42.309341 (+ 916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:42.309346 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:42.309357 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:43:42.309726 (+ 369us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:42.309778 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:43:42.309797 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:42.309957 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:42.310129 (+ 172us) server_negotiation.cc:299] Negotiation successful
0807 08:43:42.310367 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":129,"threads_started":1}
I20260807 08:43:42.312763 28082 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82f60e10bebf4e3cbe6d34347cab1c5e: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:42.313591 28082 log.cc:824] T 00000000000000000000000000000000 P 82f60e10bebf4e3cbe6d34347cab1c5e: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:42.315361 28082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82f60e10bebf4e3cbe6d34347cab1c5e: No bootstrap required, opened a new log
I20260807 08:43:42.318696 28082 raft_consensus.cc:348] T 00000000000000000000000000000000 P 82f60e10bebf4e3cbe6d34347cab1c5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82f60e10bebf4e3cbe6d34347cab1c5e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35335 } }
I20260807 08:43:42.318957 28082 raft_consensus.cc:374] T 00000000000000000000000000000000 P 82f60e10bebf4e3cbe6d34347cab1c5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:42.319068 28082 raft_consensus.cc:729] T 00000000000000000000000000000000 P 82f60e10bebf4e3cbe6d34347cab1c5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82f60e10bebf4e3cbe6d34347cab1c5e, State: Initialized, Role: FOLLOWER
I20260807 08:43:42.319504 28082 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82f60e10bebf4e3cbe6d34347cab1c5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82f60e10bebf4e3cbe6d34347cab1c5e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35335 } }
I20260807 08:43:42.319624 28082 raft_consensus.cc:388] T 00000000000000000000000000000000 P 82f60e10bebf4e3cbe6d34347cab1c5e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:43:42.319669 28082 raft_consensus.cc:482] T 00000000000000000000000000000000 P 82f60e10bebf4e3cbe6d34347cab1c5e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:43:42.319736 28082 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 82f60e10bebf4e3cbe6d34347cab1c5e [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:42.320526 28082 raft_consensus.cc:504] T 00000000000000000000000000000000 P 82f60e10bebf4e3cbe6d34347cab1c5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82f60e10bebf4e3cbe6d34347cab1c5e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35335 } }
I20260807 08:43:42.320798 28082 leader_election.cc:302] T 00000000000000000000000000000000 P 82f60e10bebf4e3cbe6d34347cab1c5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 82f60e10bebf4e3cbe6d34347cab1c5e; no voters:
I20260807 08:43:42.321034 28082 leader_election.cc:288] T 00000000000000000000000000000000 P 82f60e10bebf4e3cbe6d34347cab1c5e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:43:42.321166 28087 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 82f60e10bebf4e3cbe6d34347cab1c5e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:43:42.321381 28087 raft_consensus.cc:686] T 00000000000000000000000000000000 P 82f60e10bebf4e3cbe6d34347cab1c5e [term 1 LEADER]: Becoming Leader. State: Replica: 82f60e10bebf4e3cbe6d34347cab1c5e, State: Running, Role: LEADER
I20260807 08:43:42.321702 28087 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82f60e10bebf4e3cbe6d34347cab1c5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82f60e10bebf4e3cbe6d34347cab1c5e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35335 } }
I20260807 08:43:42.322273 28082 sys_catalog.cc:564] T 00000000000000000000000000000000 P 82f60e10bebf4e3cbe6d34347cab1c5e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:43:42.323414 28089 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82f60e10bebf4e3cbe6d34347cab1c5e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82f60e10bebf4e3cbe6d34347cab1c5e. Latest consensus state: current_term: 1 leader_uuid: "82f60e10bebf4e3cbe6d34347cab1c5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82f60e10bebf4e3cbe6d34347cab1c5e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35335 } } }
I20260807 08:43:42.323414 28088 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82f60e10bebf4e3cbe6d34347cab1c5e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "82f60e10bebf4e3cbe6d34347cab1c5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82f60e10bebf4e3cbe6d34347cab1c5e" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35335 } } }
I20260807 08:43:42.323593 28089 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82f60e10bebf4e3cbe6d34347cab1c5e [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:42.323660 28088 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82f60e10bebf4e3cbe6d34347cab1c5e [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:42.324549 28098 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:43:42.327162 28098 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:43:42.331845 28098 catalog_manager.cc:1347] Generated new cluster ID: 7a75d652e138444f9f5b7c4275f329bc
I20260807 08:43:42.331910 28098 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:43:42.341284 28098 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:43:42.342432 28098 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:43:42.353330 28098 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 82f60e10bebf4e3cbe6d34347cab1c5e: Generated new TSK 0
I20260807 08:43:42.354115 28098 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:43:42.362293 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:35335
--builtin_ntp_servers=127.8.208.212:46515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 08:43:42.474488 28107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:42.474745 28107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:42.474807 28107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:42.479724 28107 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:42.479804 28107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:42.479934 28107 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:43:42.485062 28107 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:46515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:35335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28107
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:42.486096 28107 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:42.487838 28107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:42.497604 28115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:42.497623 28113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:42.497751 28107 server_base.cc:1034] running on GCE node
W20260807 08:43:42.497660 28112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:42.498260 28107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:42.498934 28107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:42.500157 28107 hybrid_clock.cc:648] HybridClock initialized: now 1786092222500129 us; error 37 us; skew 500 ppm
I20260807 08:43:42.502103 28107 webserver.cc:460] Webserver started at http://127.8.208.193:41261/ using document root <none> and password file <none>
I20260807 08:43:42.502664 28107 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:42.502761 28107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:42.502991 28107 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:42.504937 28107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "678d1886c77f4ce48b1fcc7ee4956ec0"
format_stamp: "Formatted at 2026-08-07 08:43:42 on dist-test-slave-6nmv"
server_key: "1d55dda90d74ecb362ad79dc67ed087e"
server_key_iv: "65de2b56d7600b77a52c07e6925314df"
server_key_version: "encryptionkey@0"
I20260807 08:43:42.505503 28107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "678d1886c77f4ce48b1fcc7ee4956ec0"
format_stamp: "Formatted at 2026-08-07 08:43:42 on dist-test-slave-6nmv"
server_key: "1d55dda90d74ecb362ad79dc67ed087e"
server_key_iv: "65de2b56d7600b77a52c07e6925314df"
server_key_version: "encryptionkey@0"
I20260807 08:43:42.509703 28107 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 08:43:42.512239 28121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:42.513501 28107 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:43:42.513635 28107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "678d1886c77f4ce48b1fcc7ee4956ec0"
format_stamp: "Formatted at 2026-08-07 08:43:42 on dist-test-slave-6nmv"
server_key: "1d55dda90d74ecb362ad79dc67ed087e"
server_key_iv: "65de2b56d7600b77a52c07e6925314df"
server_key_version: "encryptionkey@0"
I20260807 08:43:42.513746 28107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:42.537480 28107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:42.538162 28107 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:42.538355 28107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:42.538918 28107 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:43:42.539863 28107 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:43:42.539984 28107 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:42.540109 28107 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:43:42.540169 28107 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:42.550207 28107 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:35265
I20260807 08:43:42.550242 28239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:35265 every 8 connection(s)
I20260807 08:43:42.551097 28107 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:43:42.559640 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 28107
I20260807 08:43:42.559782 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
I20260807 08:43:42.560014 28085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:42.552888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:55751 (local address 127.8.208.254:35335)
0807 08:43:42.553048 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:42.553053 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:42.554104 (+ 1051us) server_negotiation.cc:407] Connection header received
0807 08:43:42.555440 (+ 1336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:42.555443 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:42.555496 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:42.555575 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:42.556427 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.556948 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.558083 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.558291 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.558372 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:42.559431 (+ 1059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:42.559434 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:42.559436 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:43:42.559447 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:42.559467 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:43:42.559474 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:42.559534 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:42.559772 (+ 238us) server_negotiation.cc:299] Negotiation successful
0807 08:43:42.559893 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 08:43:42.560115 9027 external_mini_cluster.cc:1428] Setting key 377ff783275ec699488753f64dc72254
I20260807 08:43:42.561004 28242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:42.553274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35335 (local address 127.8.208.193:55751)
0807 08:43:42.553963 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:42.554002 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:42.555230 (+ 1228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:42.555732 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:42.555738 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:42.555816 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:43:42.556304 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:42.556316 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.557089 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.557091 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:42.557977 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:42.557986 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.558432 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.558436 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:42.558584 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:42.559156 (+ 572us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 08:43:42.559157 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:43:42.559193 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 08:43:42.559250 (+ 57us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:43:42.559578 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:43:42.559590 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:43:42.559596 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 08:43:42.559732 (+ 136us) client_negotiation.cc:240] Negotiation successful
0807 08:43:42.560041 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":120,"threads_started":1}
I20260807 08:43:42.562361 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:35335
--builtin_ntp_servers=127.8.208.212:46515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 08:43:42.562752 28240 heartbeater.cc:347] Connected to a master server at 127.8.208.254:35335
I20260807 08:43:42.562983 28240 heartbeater.cc:464] Registering TS with master...
I20260807 08:43:42.563544 28240 heartbeater.cc:511] Master 127.8.208.254:35335 requested a full tablet report, sending...
I20260807 08:43:42.565145 28045 ts_manager.cc:194] Registered new tserver with Master: 678d1886c77f4ce48b1fcc7ee4956ec0 (127.8.208.193:35265)
I20260807 08:43:42.566342 28045 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.208.193:55751
W20260807 08:43:42.680986 28243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:42.681195 28243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:42.681232 28243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:42.684890 28243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:42.684934 28243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:42.685036 28243 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:43:42.689342 28243 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:46515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:35335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28243
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:42.690158 28243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:42.691267 28243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 08:43:42.700147 28243 server_base.cc:1034] running on GCE node
W20260807 08:43:42.700089 28249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:42.700098 28251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:42.700081 28248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:42.700825 28243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:42.701463 28243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:42.702642 28243 hybrid_clock.cc:648] HybridClock initialized: now 1786092222702621 us; error 38 us; skew 500 ppm
I20260807 08:43:42.704511 28243 webserver.cc:460] Webserver started at http://127.8.208.194:39875/ using document root <none> and password file <none>
I20260807 08:43:42.705092 28243 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:42.705188 28243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:42.705423 28243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:42.707279 28243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "121bf08ceda84ea79d96d9b41c94ace4"
format_stamp: "Formatted at 2026-08-07 08:43:42 on dist-test-slave-6nmv"
server_key: "c314db11652400dcdd32c44aac91548c"
server_key_iv: "6ae214108bbc392e37338082ed335b57"
server_key_version: "encryptionkey@0"
I20260807 08:43:42.707798 28243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "121bf08ceda84ea79d96d9b41c94ace4"
format_stamp: "Formatted at 2026-08-07 08:43:42 on dist-test-slave-6nmv"
server_key: "c314db11652400dcdd32c44aac91548c"
server_key_iv: "6ae214108bbc392e37338082ed335b57"
server_key_version: "encryptionkey@0"
I20260807 08:43:42.711187 28243 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260807 08:43:42.713436 28257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:42.714561 28243 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:43:42.714654 28243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "121bf08ceda84ea79d96d9b41c94ace4"
format_stamp: "Formatted at 2026-08-07 08:43:42 on dist-test-slave-6nmv"
server_key: "c314db11652400dcdd32c44aac91548c"
server_key_iv: "6ae214108bbc392e37338082ed335b57"
server_key_version: "encryptionkey@0"
I20260807 08:43:42.714731 28243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:42.728001 28243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:42.728550 28243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:42.728747 28243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:42.729202 28243 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:43:42.730016 28243 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:43:42.730077 28243 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:42.730127 28243 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:43:42.730171 28243 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:42.738113 28243 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:39027
I20260807 08:43:42.738179 28375 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:39027 every 8 connection(s)
I20260807 08:43:42.738915 28243 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:43:42.747124 28085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:42.740444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:36993 (local address 127.8.208.254:35335)
0807 08:43:42.740571 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:42.740574 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:42.741434 (+ 860us) server_negotiation.cc:407] Connection header received
0807 08:43:42.742718 (+ 1284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:42.742721 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:42.742798 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:42.742921 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:42.743703 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.744197 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.745241 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.745464 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.745576 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:42.746597 (+ 1021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:42.746604 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:42.746606 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:43:42.746617 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:42.746637 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:43:42.746644 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:42.746742 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:42.746912 (+ 170us) server_negotiation.cc:299] Negotiation successful
0807 08:43:42.746969 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 08:43:42.747795 28378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:42.740746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35335 (local address 127.8.208.194:36993)
0807 08:43:42.741302 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:42.741333 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:42.742540 (+ 1207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:42.743076 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:42.743082 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:42.743152 (+ 70us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:43:42.743577 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:42.743587 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.744315 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.744324 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:42.745113 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:42.745122 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.745610 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.745614 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:42.745767 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:42.746345 (+ 578us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 08:43:42.746347 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:43:42.746389 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 08:43:42.746439 (+ 50us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:43:42.746755 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:43:42.746764 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:43:42.746772 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 08:43:42.746896 (+ 124us) client_negotiation.cc:240] Negotiation successful
0807 08:43:42.747142 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":112,"threads_started":1}
I20260807 08:43:42.748761 28376 heartbeater.cc:347] Connected to a master server at 127.8.208.254:35335
I20260807 08:43:42.748961 28376 heartbeater.cc:464] Registering TS with master...
I20260807 08:43:42.749143 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 28243
I20260807 08:43:42.749264 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:43:42.749501 28376 heartbeater.cc:511] Master 127.8.208.254:35335 requested a full tablet report, sending...
I20260807 08:43:42.749579 9027 external_mini_cluster.cc:1428] Setting key e93ef13b4f0e2af6f718ee6086bb7ea6
I20260807 08:43:42.750576 28044 ts_manager.cc:194] Registered new tserver with Master: 121bf08ceda84ea79d96d9b41c94ace4 (127.8.208.194:39027)
I20260807 08:43:42.751107 28044 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.208.194:36993
I20260807 08:43:42.751442 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:35335
--builtin_ntp_servers=127.8.208.212:46515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 08:43:42.853924 28379 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:42.854161 28379 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:42.854226 28379 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:42.857892 28379 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:42.857957 28379 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:42.858035 28379 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:43:42.862056 28379 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:46515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:35335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28379
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:42.862884 28379 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:42.863976 28379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:42.872527 28385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:42.872617 28384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:42.872696 28379 server_base.cc:1034] running on GCE node
W20260807 08:43:42.872593 28387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:42.873180 28379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:42.873724 28379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:42.874872 28379 hybrid_clock.cc:648] HybridClock initialized: now 1786092222874858 us; error 25 us; skew 500 ppm
I20260807 08:43:42.876627 28379 webserver.cc:460] Webserver started at http://127.8.208.195:35973/ using document root <none> and password file <none>
I20260807 08:43:42.877136 28379 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:42.877197 28379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:42.877425 28379 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:42.879257 28379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "4dedf34535d64a6c818e12f128911881"
format_stamp: "Formatted at 2026-08-07 08:43:42 on dist-test-slave-6nmv"
server_key: "3e5b6304bfdd95f91c56e6d955bd2b4f"
server_key_iv: "d57fc2a296ef04bfc381b44c337be9c2"
server_key_version: "encryptionkey@0"
I20260807 08:43:42.879760 28379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "4dedf34535d64a6c818e12f128911881"
format_stamp: "Formatted at 2026-08-07 08:43:42 on dist-test-slave-6nmv"
server_key: "3e5b6304bfdd95f91c56e6d955bd2b4f"
server_key_iv: "d57fc2a296ef04bfc381b44c337be9c2"
server_key_version: "encryptionkey@0"
I20260807 08:43:42.883011 28379 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.002s
I20260807 08:43:42.885102 28393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:42.886261 28379 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:43:42.886376 28379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "4dedf34535d64a6c818e12f128911881"
format_stamp: "Formatted at 2026-08-07 08:43:42 on dist-test-slave-6nmv"
server_key: "3e5b6304bfdd95f91c56e6d955bd2b4f"
server_key_iv: "d57fc2a296ef04bfc381b44c337be9c2"
server_key_version: "encryptionkey@0"
I20260807 08:43:42.886475 28379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:42.895289 28379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:42.895852 28379 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:42.896030 28379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:42.896592 28379 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:43:42.897437 28379 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:43:42.897506 28379 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:42.897579 28379 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:43:42.897624 28379 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:42.906599 28379 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:37317
I20260807 08:43:42.906646 28510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:37317 every 8 connection(s)
I20260807 08:43:42.907380 28379 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:43:42.915988 28085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:42.908939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:53999 (local address 127.8.208.254:35335)
0807 08:43:42.909066 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:42.909070 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:42.910023 (+ 953us) server_negotiation.cc:407] Connection header received
0807 08:43:42.911398 (+ 1375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:42.911401 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:42.911460 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:42.911563 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:42.912412 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.912948 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.914215 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.914418 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.914520 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:42.915498 (+ 978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:42.915502 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:42.915505 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:43:42.915523 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:42.915542 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:43:42.915550 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:42.915627 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:42.915784 (+ 157us) server_negotiation.cc:299] Negotiation successful
0807 08:43:42.915847 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 08:43:42.916767 28513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:42.909265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35335 (local address 127.8.208.195:53999)
0807 08:43:42.909836 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:42.909900 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:42.911179 (+ 1279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:42.911743 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:42.911749 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:42.911826 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:43:42.912262 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:42.912273 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.913069 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.913075 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:42.914086 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:42.914107 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.914553 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.914557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:42.914701 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:42.915257 (+ 556us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 08:43:42.915259 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:43:42.915293 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 08:43:42.915349 (+ 56us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:43:42.915628 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:43:42.915639 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:43:42.915647 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 08:43:42.915769 (+ 122us) client_negotiation.cc:240] Negotiation successful
0807 08:43:42.916038 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":97,"threads_started":1}
I20260807 08:43:42.917452 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 28379
I20260807 08:43:42.917618 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:43:42.918000 9027 external_mini_cluster.cc:1428] Setting key 1471492e95f7bfd3367cccf37f970165
I20260807 08:43:42.918061 28511 heartbeater.cc:347] Connected to a master server at 127.8.208.254:35335
I20260807 08:43:42.918304 28511 heartbeater.cc:464] Registering TS with master...
I20260807 08:43:42.918836 28511 heartbeater.cc:511] Master 127.8.208.254:35335 requested a full tablet report, sending...
I20260807 08:43:42.919806 28045 ts_manager.cc:194] Registered new tserver with Master: 4dedf34535d64a6c818e12f128911881 (127.8.208.195:37317)
I20260807 08:43:42.920342 28045 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.208.195:53999
I20260807 08:43:42.931423 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 08:43:42.936699 28085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:42.933284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54992 (local address 127.8.208.254:35335)
0807 08:43:42.933405 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:42.933409 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:42.933556 (+ 147us) server_negotiation.cc:407] Connection header received
0807 08:43:42.933672 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:42.933674 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:42.933705 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:42.933753 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:42.934011 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.934572 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.935406 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.935604 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.935682 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:42.936348 (+ 666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:42.936350 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:42.936352 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:43:42.936361 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:42.936407 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:43:42.936414 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:42.936464 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:42.936535 (+ 71us) server_negotiation.cc:299] Negotiation successful
0807 08:43:42.936570 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 08:43:42.939018 28045 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54992:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 08:43:42.941601 28045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:43:42.954756 28524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:42.949384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57586 (local address 127.8.208.193:35265)
0807 08:43:42.950335 (+ 951us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:42.950347 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:42.950370 (+ 23us) server_negotiation.cc:407] Connection header received
0807 08:43:42.950441 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:42.950445 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:42.950629 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:42.950751 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:42.950964 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.952074 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.953423 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.954013 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.954134 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:42.954303 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:42.954521 (+ 218us) server_negotiation.cc:299] Negotiation successful
0807 08:43:42.954611 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":96,"threads_started":1}
I20260807 08:43:42.954751 28522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:42.949207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:35265 (local address 127.0.0.1:57586)
0807 08:43:42.949997 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:42.950009 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:42.950077 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:42.950738 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:42.950741 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:42.950756 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:42.950843 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:42.950848 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.952197 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.952200 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:42.953298 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:42.953307 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.954136 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.954139 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:42.954291 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:42.954386 (+ 95us) client_negotiation.cc:769] Sending connection context
0807 08:43:42.954491 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 08:43:42.954611 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":720,"mutex_wait_us":91,"thread_start_us":84,"threads_started":1}
I20260807 08:43:42.954751 28523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:42.949058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:37317 (local address 127.0.0.1:56716)
0807 08:43:42.949735 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:42.949780 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:42.949922 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:42.950591 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:42.950596 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:42.950615 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:42.950731 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:42.950737 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.951769 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.951773 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:42.952950 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:42.952960 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.954137 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.954141 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:42.954325 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:42.954383 (+ 58us) client_negotiation.cc:769] Sending connection context
0807 08:43:42.954475 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 08:43:42.954606 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"mutex_wait_us":56,"thread_start_us":71,"threads_started":1}
I20260807 08:43:42.955185 28528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:42.949925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60862 (local address 127.8.208.194:39027)
0807 08:43:42.950333 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:42.950348 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:42.950627 (+ 279us) server_negotiation.cc:407] Connection header received
0807 08:43:42.950699 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:42.950705 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:42.950861 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:42.951015 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:42.951210 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.952254 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.953530 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.954267 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.954358 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:42.954525 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:42.954880 (+ 355us) server_negotiation.cc:299] Negotiation successful
0807 08:43:42.954977 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":144,"threads_started":1}
I20260807 08:43:42.955287 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:42.949636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56716 (local address 127.8.208.195:37317)
0807 08:43:42.950196 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:42.950204 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:42.950220 (+ 16us) server_negotiation.cc:407] Connection header received
0807 08:43:42.950264 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:42.950287 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:42.950459 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:42.950599 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:42.950843 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.951638 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.953080 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.953793 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.953914 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:42.954072 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:42.954973 (+ 901us) server_negotiation.cc:299] Negotiation successful
0807 08:43:42.955112 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":119,"threads_started":1}
I20260807 08:43:42.955300 28525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:42.949529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:39027 (local address 127.0.0.1:60862)
0807 08:43:42.950455 (+ 926us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:42.950466 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:42.950548 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:42.951009 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:42.951011 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:42.951028 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:42.951096 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:42.951102 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.952365 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.952369 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:42.953413 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:42.953423 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:42.954584 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:42.954587 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:42.954661 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:42.954680 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 08:43:42.954741 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 08:43:42.954802 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":876,"mutex_wait_us":18,"thread_start_us":93,"threads_started":1}
I20260807 08:43:42.957805 28171 tablet_service.cc:1467] Processing CreateTablet for tablet 03742e5fc771434eb32a9f61cc97f42d (DEFAULT_TABLE table=test-table [id=85ab8ad193b74ef3aac19f06a875b149]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:43:42.958423 28444 tablet_service.cc:1467] Processing CreateTablet for tablet 03742e5fc771434eb32a9f61cc97f42d (DEFAULT_TABLE table=test-table [id=85ab8ad193b74ef3aac19f06a875b149]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:43:42.958881 28171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03742e5fc771434eb32a9f61cc97f42d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:42.958424 28308 tablet_service.cc:1467] Processing CreateTablet for tablet 03742e5fc771434eb32a9f61cc97f42d (DEFAULT_TABLE table=test-table [id=85ab8ad193b74ef3aac19f06a875b149]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:43:42.959517 28308 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03742e5fc771434eb32a9f61cc97f42d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:42.959517 28444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03742e5fc771434eb32a9f61cc97f42d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:42.965128 28529 tablet_bootstrap.cc:492] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0: Bootstrap starting.
I20260807 08:43:42.965929 28530 tablet_bootstrap.cc:492] T 03742e5fc771434eb32a9f61cc97f42d P 4dedf34535d64a6c818e12f128911881: Bootstrap starting.
I20260807 08:43:42.967413 28529 tablet_bootstrap.cc:654] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:42.967913 28530 tablet_bootstrap.cc:654] T 03742e5fc771434eb32a9f61cc97f42d P 4dedf34535d64a6c818e12f128911881: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:42.968230 28529 log.cc:824] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:42.968659 28530 log.cc:824] T 03742e5fc771434eb32a9f61cc97f42d P 4dedf34535d64a6c818e12f128911881: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:42.968881 28531 tablet_bootstrap.cc:492] T 03742e5fc771434eb32a9f61cc97f42d P 121bf08ceda84ea79d96d9b41c94ace4: Bootstrap starting.
I20260807 08:43:42.970148 28529 tablet_bootstrap.cc:492] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0: No bootstrap required, opened a new log
I20260807 08:43:42.970366 28529 ts_tablet_manager.cc:1397] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260807 08:43:42.970448 28530 tablet_bootstrap.cc:492] T 03742e5fc771434eb32a9f61cc97f42d P 4dedf34535d64a6c818e12f128911881: No bootstrap required, opened a new log
I20260807 08:43:42.970631 28530 ts_tablet_manager.cc:1397] T 03742e5fc771434eb32a9f61cc97f42d P 4dedf34535d64a6c818e12f128911881: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 08:43:42.970781 28531 tablet_bootstrap.cc:654] T 03742e5fc771434eb32a9f61cc97f42d P 121bf08ceda84ea79d96d9b41c94ace4: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:42.971537 28531 log.cc:824] T 03742e5fc771434eb32a9f61cc97f42d P 121bf08ceda84ea79d96d9b41c94ace4: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:42.973428 28531 tablet_bootstrap.cc:492] T 03742e5fc771434eb32a9f61cc97f42d P 121bf08ceda84ea79d96d9b41c94ace4: No bootstrap required, opened a new log
I20260807 08:43:42.973623 28531 ts_tablet_manager.cc:1397] T 03742e5fc771434eb32a9f61cc97f42d P 121bf08ceda84ea79d96d9b41c94ace4: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 08:43:42.973765 28529 raft_consensus.cc:348] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dedf34535d64a6c818e12f128911881" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 37317 } } peers { permanent_uuid: "678d1886c77f4ce48b1fcc7ee4956ec0" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35265 } } peers { permanent_uuid: "121bf08ceda84ea79d96d9b41c94ace4" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39027 } }
I20260807 08:43:42.974007 28529 raft_consensus.cc:374] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:42.974056 28529 raft_consensus.cc:729] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 678d1886c77f4ce48b1fcc7ee4956ec0, State: Initialized, Role: FOLLOWER
I20260807 08:43:42.974475 28529 consensus_queue.cc:260] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dedf34535d64a6c818e12f128911881" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 37317 } } peers { permanent_uuid: "678d1886c77f4ce48b1fcc7ee4956ec0" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35265 } } peers { permanent_uuid: "121bf08ceda84ea79d96d9b41c94ace4" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39027 } }
I20260807 08:43:42.974511 28530 raft_consensus.cc:348] T 03742e5fc771434eb32a9f61cc97f42d P 4dedf34535d64a6c818e12f128911881 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dedf34535d64a6c818e12f128911881" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 37317 } } peers { permanent_uuid: "678d1886c77f4ce48b1fcc7ee4956ec0" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35265 } } peers { permanent_uuid: "121bf08ceda84ea79d96d9b41c94ace4" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39027 } }
I20260807 08:43:42.974735 28530 raft_consensus.cc:374] T 03742e5fc771434eb32a9f61cc97f42d P 4dedf34535d64a6c818e12f128911881 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:42.974789 28530 raft_consensus.cc:729] T 03742e5fc771434eb32a9f61cc97f42d P 4dedf34535d64a6c818e12f128911881 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dedf34535d64a6c818e12f128911881, State: Initialized, Role: FOLLOWER
I20260807 08:43:42.975238 28530 consensus_queue.cc:260] T 03742e5fc771434eb32a9f61cc97f42d P 4dedf34535d64a6c818e12f128911881 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dedf34535d64a6c818e12f128911881" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 37317 } } peers { permanent_uuid: "678d1886c77f4ce48b1fcc7ee4956ec0" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35265 } } peers { permanent_uuid: "121bf08ceda84ea79d96d9b41c94ace4" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39027 } }
I20260807 08:43:42.975353 28529 ts_tablet_manager.cc:1428] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260807 08:43:42.975721 28240 heartbeater.cc:503] Master 127.8.208.254:35335 was elected leader, sending a full tablet report...
I20260807 08:43:42.975821 28511 heartbeater.cc:503] Master 127.8.208.254:35335 was elected leader, sending a full tablet report...
I20260807 08:43:42.976146 28530 ts_tablet_manager.cc:1428] T 03742e5fc771434eb32a9f61cc97f42d P 4dedf34535d64a6c818e12f128911881: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 08:43:42.978492 28531 raft_consensus.cc:348] T 03742e5fc771434eb32a9f61cc97f42d P 121bf08ceda84ea79d96d9b41c94ace4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dedf34535d64a6c818e12f128911881" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 37317 } } peers { permanent_uuid: "678d1886c77f4ce48b1fcc7ee4956ec0" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35265 } } peers { permanent_uuid: "121bf08ceda84ea79d96d9b41c94ace4" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39027 } }
I20260807 08:43:42.979020 28531 raft_consensus.cc:374] T 03742e5fc771434eb32a9f61cc97f42d P 121bf08ceda84ea79d96d9b41c94ace4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:42.979081 28531 raft_consensus.cc:729] T 03742e5fc771434eb32a9f61cc97f42d P 121bf08ceda84ea79d96d9b41c94ace4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 121bf08ceda84ea79d96d9b41c94ace4, State: Initialized, Role: FOLLOWER
I20260807 08:43:42.979434 28531 consensus_queue.cc:260] T 03742e5fc771434eb32a9f61cc97f42d P 121bf08ceda84ea79d96d9b41c94ace4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dedf34535d64a6c818e12f128911881" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 37317 } } peers { permanent_uuid: "678d1886c77f4ce48b1fcc7ee4956ec0" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35265 } } peers { permanent_uuid: "121bf08ceda84ea79d96d9b41c94ace4" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39027 } }
I20260807 08:43:42.980032 28376 heartbeater.cc:503] Master 127.8.208.254:35335 was elected leader, sending a full tablet report...
I20260807 08:43:42.980365 28531 ts_tablet_manager.cc:1428] T 03742e5fc771434eb32a9f61cc97f42d P 121bf08ceda84ea79d96d9b41c94ace4: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
W20260807 08:43:42.989635 28377 tablet.cc:2369] T 03742e5fc771434eb32a9f61cc97f42d P 121bf08ceda84ea79d96d9b41c94ace4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 08:43:43.036870 28536 raft_consensus.cc:482] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:43:43.037048 28536 raft_consensus.cc:504] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dedf34535d64a6c818e12f128911881" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 37317 } } peers { permanent_uuid: "678d1886c77f4ce48b1fcc7ee4956ec0" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35265 } } peers { permanent_uuid: "121bf08ceda84ea79d96d9b41c94ace4" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39027 } }
I20260807 08:43:43.038054 28536 leader_election.cc:288] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dedf34535d64a6c818e12f128911881 (127.8.208.195:37317), 121bf08ceda84ea79d96d9b41c94ace4 (127.8.208.194:39027)
I20260807 08:43:43.041863 28528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:43.038440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:50727 (local address 127.8.208.194:39027)
0807 08:43:43.038575 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:43.038581 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:43.038605 (+ 24us) server_negotiation.cc:407] Connection header received
0807 08:43:43.038691 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:43.038694 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:43.038761 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:43.038898 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:43.039227 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:43.039767 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:43.040866 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:43.041247 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:43.041406 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:43.041465 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:43.041644 (+ 179us) server_negotiation.cc:299] Negotiation successful
0807 08:43:43.041713 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 08:43:43.041885 28242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:43.038314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:39027 (local address 127.8.208.193:50727)
0807 08:43:43.038435 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:43.038451 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:43.038553 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:43.038928 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:43.038931 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:43.038961 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:43.039088 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:43.039107 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:43.039896 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:43.039901 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:43.040725 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:43.040734 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:43.041386 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:43.041391 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:43.041498 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:43.041534 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 08:43:43.041628 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 08:43:43.041703 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":25,"spinlock_wait_cycles":2304}
I20260807 08:43:43.041930 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:43.038401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:52133 (local address 127.8.208.195:37317)
0807 08:43:43.038532 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:43.038536 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:43.038925 (+ 389us) server_negotiation.cc:407] Connection header received
0807 08:43:43.039068 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:43.039071 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:43.039135 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:43.039213 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:43.039486 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:43.039947 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:43.040999 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:43.041376 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:43.041506 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:43.041551 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:43.041736 (+ 185us) server_negotiation.cc:299] Negotiation successful
0807 08:43:43.041802 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 08:43:43.041947 28539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:43.038313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:37317 (local address 127.8.208.193:52133)
0807 08:43:43.038817 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:43.038827 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:43.038960 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:43.039224 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:43.039227 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:43.039241 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:43.039363 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:43.039368 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:43.040076 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:43.040079 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:43.040878 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:43.040886 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:43.041506 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:43.041510 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:43.041617 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:43.041634 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 08:43:43.041720 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 08:43:43.041785 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"mutex_wait_us":206,"spinlock_wait_cycles":4864,"thread_start_us":127,"threads_started":1}
I20260807 08:43:43.042615 28328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03742e5fc771434eb32a9f61cc97f42d" candidate_uuid: "678d1886c77f4ce48b1fcc7ee4956ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "121bf08ceda84ea79d96d9b41c94ace4" is_pre_election: true
I20260807 08:43:43.042683 28465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03742e5fc771434eb32a9f61cc97f42d" candidate_uuid: "678d1886c77f4ce48b1fcc7ee4956ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dedf34535d64a6c818e12f128911881" is_pre_election: true
I20260807 08:43:43.042930 28465 raft_consensus.cc:2454] T 03742e5fc771434eb32a9f61cc97f42d P 4dedf34535d64a6c818e12f128911881 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 678d1886c77f4ce48b1fcc7ee4956ec0 in term 0.
I20260807 08:43:43.042930 28328 raft_consensus.cc:2454] T 03742e5fc771434eb32a9f61cc97f42d P 121bf08ceda84ea79d96d9b41c94ace4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 678d1886c77f4ce48b1fcc7ee4956ec0 in term 0.
I20260807 08:43:43.043406 28122 leader_election.cc:302] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121bf08ceda84ea79d96d9b41c94ace4, 678d1886c77f4ce48b1fcc7ee4956ec0; no voters:
I20260807 08:43:43.043663 28536 raft_consensus.cc:2781] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:43:43.043736 28536 raft_consensus.cc:482] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:43:43.043764 28536 raft_consensus.cc:3037] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:43.044745 28536 raft_consensus.cc:504] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dedf34535d64a6c818e12f128911881" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 37317 } } peers { permanent_uuid: "678d1886c77f4ce48b1fcc7ee4956ec0" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35265 } } peers { permanent_uuid: "121bf08ceda84ea79d96d9b41c94ace4" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39027 } }
I20260807 08:43:43.045086 28536 leader_election.cc:288] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0 [CANDIDATE]: Term 1 election: Requested vote from peers 4dedf34535d64a6c818e12f128911881 (127.8.208.195:37317), 121bf08ceda84ea79d96d9b41c94ace4 (127.8.208.194:39027)
I20260807 08:43:43.045452 28465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03742e5fc771434eb32a9f61cc97f42d" candidate_uuid: "678d1886c77f4ce48b1fcc7ee4956ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dedf34535d64a6c818e12f128911881"
I20260807 08:43:43.045446 28328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03742e5fc771434eb32a9f61cc97f42d" candidate_uuid: "678d1886c77f4ce48b1fcc7ee4956ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "121bf08ceda84ea79d96d9b41c94ace4"
I20260807 08:43:43.045567 28328 raft_consensus.cc:3037] T 03742e5fc771434eb32a9f61cc97f42d P 121bf08ceda84ea79d96d9b41c94ace4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:43.045567 28465 raft_consensus.cc:3037] T 03742e5fc771434eb32a9f61cc97f42d P 4dedf34535d64a6c818e12f128911881 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:43.046835 28465 raft_consensus.cc:2454] T 03742e5fc771434eb32a9f61cc97f42d P 4dedf34535d64a6c818e12f128911881 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 678d1886c77f4ce48b1fcc7ee4956ec0 in term 1.
I20260807 08:43:43.046835 28328 raft_consensus.cc:2454] T 03742e5fc771434eb32a9f61cc97f42d P 121bf08ceda84ea79d96d9b41c94ace4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 678d1886c77f4ce48b1fcc7ee4956ec0 in term 1.
I20260807 08:43:43.047194 28123 leader_election.cc:302] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dedf34535d64a6c818e12f128911881, 678d1886c77f4ce48b1fcc7ee4956ec0; no voters:
I20260807 08:43:43.047402 28536 raft_consensus.cc:2781] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:43:43.047648 28536 raft_consensus.cc:686] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0 [term 1 LEADER]: Becoming Leader. State: Replica: 678d1886c77f4ce48b1fcc7ee4956ec0, State: Running, Role: LEADER
I20260807 08:43:43.047986 28536 consensus_queue.cc:237] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dedf34535d64a6c818e12f128911881" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 37317 } } peers { permanent_uuid: "678d1886c77f4ce48b1fcc7ee4956ec0" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35265 } } peers { permanent_uuid: "121bf08ceda84ea79d96d9b41c94ace4" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39027 } }
I20260807 08:43:43.050833 28043 catalog_manager.cc:5495] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 678d1886c77f4ce48b1fcc7ee4956ec0 (127.8.208.193). New cstate: current_term: 1 leader_uuid: "678d1886c77f4ce48b1fcc7ee4956ec0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dedf34535d64a6c818e12f128911881" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 37317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "678d1886c77f4ce48b1fcc7ee4956ec0" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121bf08ceda84ea79d96d9b41c94ace4" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39027 } health_report { overall_health: UNKNOWN } } }
W20260807 08:43:43.052141 28241 tablet.cc:2369] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 08:43:43.074365 28524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:43.071266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57602 (local address 127.8.208.193:35265)
0807 08:43:43.071384 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:43.071387 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:43.071418 (+ 31us) server_negotiation.cc:407] Connection header received
0807 08:43:43.071544 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:43.071546 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:43.071624 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:43.071737 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:43:43.071950 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:43.072419 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:43.073188 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:43.073376 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:43.073468 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:43.073711 (+ 243us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:43:43.074103 (+ 392us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:43:43.074186 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:43.074239 (+ 53us) server_negotiation.cc:299] Negotiation successful
0807 08:43:43.074278 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 08:43:43.079603 28465 raft_consensus.cc:1261] T 03742e5fc771434eb32a9f61cc97f42d P 4dedf34535d64a6c818e12f128911881 [term 1 FOLLOWER]: Refusing update from remote peer 678d1886c77f4ce48b1fcc7ee4956ec0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:43:43.079603 28328 raft_consensus.cc:1261] T 03742e5fc771434eb32a9f61cc97f42d P 121bf08ceda84ea79d96d9b41c94ace4 [term 1 FOLLOWER]: Refusing update from remote peer 678d1886c77f4ce48b1fcc7ee4956ec0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:43:43.080312 28540 consensus_queue.cc:1035] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121bf08ceda84ea79d96d9b41c94ace4" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:43:43.080495 28536 consensus_queue.cc:1035] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dedf34535d64a6c818e12f128911881" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 37317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:43:43.090927 28544 mvcc.cc:205] Tried to move back new op lower bound from 7315833745727549440 to 7315833745607028736. Current Snapshot: MvccSnapshot[applied={T|T < 7315833745727549440}]
I20260807 08:43:43.097635 28045 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54992:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:43:43.097765 28045 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54992:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:43:43.100044 28045 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 82f60e10bebf4e3cbe6d34347cab1c5e: Sending DeleteTablet for 3 replicas of tablet 03742e5fc771434eb32a9f61cc97f42d
I20260807 08:43:43.100705 28444 tablet_service.cc:1514] Processing DeleteTablet for tablet 03742e5fc771434eb32a9f61cc97f42d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:43:43 UTC) from {username='slave'} at 127.0.0.1:56716
I20260807 08:43:43.100816 28171 tablet_service.cc:1514] Processing DeleteTablet for tablet 03742e5fc771434eb32a9f61cc97f42d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:43:43 UTC) from {username='slave'} at 127.0.0.1:57586
I20260807 08:43:43.100929 28308 tablet_service.cc:1514] Processing DeleteTablet for tablet 03742e5fc771434eb32a9f61cc97f42d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:43:43 UTC) from {username='slave'} at 127.0.0.1:60862
I20260807 08:43:43.101312 28555 tablet_replica.cc:330] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0: stopping tablet replica
I20260807 08:43:43.101485 28556 tablet_replica.cc:330] T 03742e5fc771434eb32a9f61cc97f42d P 121bf08ceda84ea79d96d9b41c94ace4: stopping tablet replica
I20260807 08:43:43.101624 28555 raft_consensus.cc:2229] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0 [term 1 LEADER]: Raft consensus shutting down.
I20260807 08:43:43.102026 28555 raft_consensus.cc:2258] T 03742e5fc771434eb32a9f61cc97f42d P 678d1886c77f4ce48b1fcc7ee4956ec0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:43:43.102047 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 28107
I20260807 08:43:43.105072 28554 tablet_replica.cc:330] T 03742e5fc771434eb32a9f61cc97f42d P 4dedf34535d64a6c818e12f128911881: stopping tablet replica
I20260807 08:43:43.105307 28554 raft_consensus.cc:2229] T 03742e5fc771434eb32a9f61cc97f42d P 4dedf34535d64a6c818e12f128911881 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:43:43.101940 28556 raft_consensus.cc:2229] T 03742e5fc771434eb32a9f61cc97f42d P 121bf08ceda84ea79d96d9b41c94ace4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:43:43.105610 28554 raft_consensus.cc:2258] T 03742e5fc771434eb32a9f61cc97f42d P 4dedf34535d64a6c818e12f128911881 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:43:43.105726 28556 raft_consensus.cc:2258] T 03742e5fc771434eb32a9f61cc97f42d P 121bf08ceda84ea79d96d9b41c94ace4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:43:43.107395 28556 ts_tablet_manager.cc:1905] T 03742e5fc771434eb32a9f61cc97f42d P 121bf08ceda84ea79d96d9b41c94ace4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:43:43.108625 28554 ts_tablet_manager.cc:1905] T 03742e5fc771434eb32a9f61cc97f42d P 4dedf34535d64a6c818e12f128911881: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:43:43.110900 28554 ts_tablet_manager.cc:1918] T 03742e5fc771434eb32a9f61cc97f42d P 4dedf34535d64a6c818e12f128911881: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:43:43.110913 28556 ts_tablet_manager.cc:1918] T 03742e5fc771434eb32a9f61cc97f42d P 121bf08ceda84ea79d96d9b41c94ace4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:43:43.111006 28556 log.cc:1196] T 03742e5fc771434eb32a9f61cc97f42d P 121bf08ceda84ea79d96d9b41c94ace4: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-1/wal/wals/03742e5fc771434eb32a9f61cc97f42d
I20260807 08:43:43.111011 28554 log.cc:1196] T 03742e5fc771434eb32a9f61cc97f42d P 4dedf34535d64a6c818e12f128911881: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/03742e5fc771434eb32a9f61cc97f42d
I20260807 08:43:43.111302 28554 ts_tablet_manager.cc:1939] T 03742e5fc771434eb32a9f61cc97f42d P 4dedf34535d64a6c818e12f128911881: Deleting consensus metadata
I20260807 08:43:43.111310 28556 ts_tablet_manager.cc:1939] T 03742e5fc771434eb32a9f61cc97f42d P 121bf08ceda84ea79d96d9b41c94ace4: Deleting consensus metadata
I20260807 08:43:43.112445 28029 catalog_manager.cc:4841] TS 4dedf34535d64a6c818e12f128911881 (127.8.208.195:37317): tablet 03742e5fc771434eb32a9f61cc97f42d (table test-table [id=85ab8ad193b74ef3aac19f06a875b149]) successfully deleted
I20260807 08:43:43.112514 28028 catalog_manager.cc:4841] TS 121bf08ceda84ea79d96d9b41c94ace4 (127.8.208.194:39027): tablet 03742e5fc771434eb32a9f61cc97f42d (table test-table [id=85ab8ad193b74ef3aac19f06a875b149]) successfully deleted
W20260807 08:43:43.113900 28031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.208.193:35265 (error 108)
I20260807 08:43:43.114713 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 28243
I20260807 08:43:43.115049 28525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:43.114692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:35265 (local address 127.0.0.1:57610)
0807 08:43:43.114854 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:43.114941 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.193:35265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 08:43:43.116012 28031 catalog_manager.cc:4584] TS 678d1886c77f4ce48b1fcc7ee4956ec0 (127.8.208.193:35265): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 03742e5fc771434eb32a9f61cc97f42d: Network error: Client connection negotiation failed: client connection to 127.8.208.193:35265: connect: Connection refused (error 111)
I20260807 08:43:43.121225 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 28379
I20260807 08:43:43.127959 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 28013
2026-08-07T08:43:43Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1022 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:43:43 dist-test-slave-6nmv krb5kdc[28560](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:43:43 dist-test-slave-6nmv krb5kdc[28560](info): set up 2 sockets
Aug 07 08:43:43 dist-test-slave-6nmv krb5kdc[28560](info): commencing operation
krb5kdc: starting...
W20260807 08:43:44.128439 9027 mini_kdc.cc:121] Time spent starting KDC: real 0.978s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:43:44 dist-test-slave-6nmv krb5kdc[28560](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092224, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:43:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:43:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:43:44.238629 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:45443
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:41337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:45443
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:43:44.340612 28574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:44.340842 28574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:44.340881 28574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:44.344631 28574 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:43:44.344683 28574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:44.344703 28574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:44.344722 28574 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:43:44.344738 28574 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:43:44.349781 28574 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:41337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:45443
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:45443
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28574
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:44.350746 28574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:44.351683 28574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 08:43:44.359781 28574 server_base.cc:1034] running on GCE node
W20260807 08:43:44.359737 28579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:44.359810 28580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:44.359738 28582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:44.360417 28574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:44.361460 28574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:44.362646 28574 hybrid_clock.cc:648] HybridClock initialized: now 1786092224362631 us; error 50 us; skew 500 ppm
Aug 07 08:43:44 dist-test-slave-6nmv krb5kdc[28560](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092224, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:44.365092 28574 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:43:44.366022 28574 webserver.cc:460] Webserver started at http://127.8.208.254:44807/ using document root <none> and password file <none>
I20260807 08:43:44.366550 28574 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:44.366652 28574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:44.366899 28574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:44.368714 28574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "11f6f4f4e01a43278a79f59f5950df1c"
format_stamp: "Formatted at 2026-08-07 08:43:44 on dist-test-slave-6nmv"
server_key: "b25794f1e67a6503e174703513f4448d"
server_key_iv: "283661557af419fbacc83ccea17b4b2c"
server_key_version: "encryptionkey@0"
I20260807 08:43:44.369258 28574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "11f6f4f4e01a43278a79f59f5950df1c"
format_stamp: "Formatted at 2026-08-07 08:43:44 on dist-test-slave-6nmv"
server_key: "b25794f1e67a6503e174703513f4448d"
server_key_iv: "283661557af419fbacc83ccea17b4b2c"
server_key_version: "encryptionkey@0"
I20260807 08:43:44.372654 28574 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 08:43:44.374861 28589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:44.375932 28574 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 08:43:44.376066 28574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "11f6f4f4e01a43278a79f59f5950df1c"
format_stamp: "Formatted at 2026-08-07 08:43:44 on dist-test-slave-6nmv"
server_key: "b25794f1e67a6503e174703513f4448d"
server_key_iv: "283661557af419fbacc83ccea17b4b2c"
server_key_version: "encryptionkey@0"
I20260807 08:43:44.376171 28574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:44.393420 28574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:44.396034 28574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:44.396227 28574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:44.403424 28574 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:45443
I20260807 08:43:44.403429 28644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:45443 every 8 connection(s)
I20260807 08:43:44.404366 28574 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:43:44.407184 28645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:44.412143 28645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11f6f4f4e01a43278a79f59f5950df1c: Bootstrap starting.
I20260807 08:43:44.413939 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 28574
I20260807 08:43:44.414083 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:43:44.414351 9027 external_mini_cluster.cc:1428] Setting key 987dbedbcc504f29cb5e5a1f39de6ea7
I20260807 08:43:44.414526 28645 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11f6f4f4e01a43278a79f59f5950df1c: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:44.415374 28645 log.cc:824] T 00000000000000000000000000000000 P 11f6f4f4e01a43278a79f59f5950df1c: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:44.417299 28645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11f6f4f4e01a43278a79f59f5950df1c: No bootstrap required, opened a new log
I20260807 08:43:44.421361 28645 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11f6f4f4e01a43278a79f59f5950df1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11f6f4f4e01a43278a79f59f5950df1c" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45443 } }
I20260807 08:43:44.421625 28645 raft_consensus.cc:374] T 00000000000000000000000000000000 P 11f6f4f4e01a43278a79f59f5950df1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:44.421693 28645 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11f6f4f4e01a43278a79f59f5950df1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11f6f4f4e01a43278a79f59f5950df1c, State: Initialized, Role: FOLLOWER
I20260807 08:43:44.422173 28645 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11f6f4f4e01a43278a79f59f5950df1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11f6f4f4e01a43278a79f59f5950df1c" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45443 } }
I20260807 08:43:44.422370 28645 raft_consensus.cc:388] T 00000000000000000000000000000000 P 11f6f4f4e01a43278a79f59f5950df1c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:43:44.422438 28645 raft_consensus.cc:482] T 00000000000000000000000000000000 P 11f6f4f4e01a43278a79f59f5950df1c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:43:44.422531 28645 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11f6f4f4e01a43278a79f59f5950df1c [term 0 FOLLOWER]: Advancing to term 1
Aug 07 08:43:44 dist-test-slave-6nmv krb5kdc[28560](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092224, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:43:44.423467 28645 raft_consensus.cc:504] T 00000000000000000000000000000000 P 11f6f4f4e01a43278a79f59f5950df1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11f6f4f4e01a43278a79f59f5950df1c" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45443 } }
I20260807 08:43:44.423839 28645 leader_election.cc:302] T 00000000000000000000000000000000 P 11f6f4f4e01a43278a79f59f5950df1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11f6f4f4e01a43278a79f59f5950df1c; no voters:
I20260807 08:43:44.424173 28645 leader_election.cc:288] T 00000000000000000000000000000000 P 11f6f4f4e01a43278a79f59f5950df1c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:43:44.424507 28650 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 11f6f4f4e01a43278a79f59f5950df1c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:43:44.424726 28650 raft_consensus.cc:686] T 00000000000000000000000000000000 P 11f6f4f4e01a43278a79f59f5950df1c [term 1 LEADER]: Becoming Leader. State: Replica: 11f6f4f4e01a43278a79f59f5950df1c, State: Running, Role: LEADER
I20260807 08:43:44.425016 28650 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11f6f4f4e01a43278a79f59f5950df1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11f6f4f4e01a43278a79f59f5950df1c" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45443 } }
I20260807 08:43:44.425319 28645 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11f6f4f4e01a43278a79f59f5950df1c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:43:44.426776 28652 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11f6f4f4e01a43278a79f59f5950df1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11f6f4f4e01a43278a79f59f5950df1c. Latest consensus state: current_term: 1 leader_uuid: "11f6f4f4e01a43278a79f59f5950df1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11f6f4f4e01a43278a79f59f5950df1c" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45443 } } }
I20260807 08:43:44.426826 28651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11f6f4f4e01a43278a79f59f5950df1c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "11f6f4f4e01a43278a79f59f5950df1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11f6f4f4e01a43278a79f59f5950df1c" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45443 } } }
I20260807 08:43:44.426900 28652 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11f6f4f4e01a43278a79f59f5950df1c [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:44.426939 28651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11f6f4f4e01a43278a79f59f5950df1c [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:44.427284 28661 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:43:44.429421 28648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:44.415413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55884 (local address 127.8.208.254:45443)
0807 08:43:44.415835 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:44.415850 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:44.415886 (+ 36us) server_negotiation.cc:407] Connection header received
0807 08:43:44.416488 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:44.416501 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:44.416765 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:44.416999 (+ 234us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:44.417858 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:44.418836 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:44.420052 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:44.420491 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:44.420609 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:44.423421 (+ 2812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:44.423429 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:44.423446 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:44.423480 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:44.425498 (+ 2018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:44.426201 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:44.426207 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:44.426212 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:44.426375 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:44.426705 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:44.426708 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:44.426711 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:44.427198 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:44.427405 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:44.428243 (+ 838us) server_negotiation.cc:299] Negotiation successful
0807 08:43:44.428542 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":142,"threads_started":1}
I20260807 08:43:44.430481 28661 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:43:44.435616 28661 catalog_manager.cc:1347] Generated new cluster ID: 42d60d1d2d1943398ba6918fc9f9e2a3
I20260807 08:43:44.435678 28661 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:43:44.444322 28661 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:43:44.445113 28661 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:43:44.458868 28661 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 11f6f4f4e01a43278a79f59f5950df1c: Generated new TSK 0
I20260807 08:43:44.459540 28661 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.208.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
I20260807 08:43:44.489193 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:45443
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:41337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:43:44.598531 28672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:44.598724 28672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:44.598758 28672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:44.602533 28672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:44.602578 28672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:44.602659 28672 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:43:44.609294 28672 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:41337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:45443
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28672
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:44.610364 28672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:44.611269 28672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:44.620357 28677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:44.620391 28678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:44.620368 28680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:44.620630 28672 server_base.cc:1034] running on GCE node
I20260807 08:43:44.621037 28672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:44.621610 28672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:44.622802 28672 hybrid_clock.cc:648] HybridClock initialized: now 1786092224622807 us; error 60 us; skew 500 ppm
Aug 07 08:43:44 dist-test-slave-6nmv krb5kdc[28560](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092224, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:44.625461 28672 init.cc:377] Logged in from keytab as kudu/127.8.208.193@KRBTEST.COM (short username kudu)
I20260807 08:43:44.626470 28672 webserver.cc:460] Webserver started at http://127.8.208.193:33951/ using document root <none> and password file <none>
I20260807 08:43:44.626995 28672 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:44.627079 28672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:44.627323 28672 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:44.629359 28672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "5ff63180d5834e598fa6f822431c958e"
format_stamp: "Formatted at 2026-08-07 08:43:44 on dist-test-slave-6nmv"
server_key: "3be4194ec15bf4d8f54b1645b845b4c3"
server_key_iv: "3ff8b60509837038366693e2b941aeee"
server_key_version: "encryptionkey@0"
I20260807 08:43:44.630010 28672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "5ff63180d5834e598fa6f822431c958e"
format_stamp: "Formatted at 2026-08-07 08:43:44 on dist-test-slave-6nmv"
server_key: "3be4194ec15bf4d8f54b1645b845b4c3"
server_key_iv: "3ff8b60509837038366693e2b941aeee"
server_key_version: "encryptionkey@0"
I20260807 08:43:44.633386 28672 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 08:43:44.635654 28687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:44.636727 28672 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:43:44.636850 28672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "5ff63180d5834e598fa6f822431c958e"
format_stamp: "Formatted at 2026-08-07 08:43:44 on dist-test-slave-6nmv"
server_key: "3be4194ec15bf4d8f54b1645b845b4c3"
server_key_iv: "3ff8b60509837038366693e2b941aeee"
server_key_version: "encryptionkey@0"
I20260807 08:43:44.636947 28672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:44.651742 28672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:44.654386 28672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:44.654575 28672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:44.655136 28672 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:43:44.655905 28672 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:43:44.655983 28672 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:44.656062 28672 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:43:44.656114 28672 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:44.664606 28672 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:33263
I20260807 08:43:44.664642 28805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:33263 every 8 connection(s)
I20260807 08:43:44.665452 28672 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
Aug 07 08:43:44 dist-test-slave-6nmv krb5kdc[28560](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092224, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:43:44.675583 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 28672
I20260807 08:43:44.675743 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
I20260807 08:43:44.676047 9027 external_mini_cluster.cc:1428] Setting key 11ce3364eb71def2df613c6f926f9ee9
I20260807 08:43:44.678146 28648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:44.667157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:51615 (local address 127.8.208.254:45443)
0807 08:43:44.667299 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:44.667304 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:44.668138 (+ 834us) server_negotiation.cc:407] Connection header received
0807 08:43:44.669297 (+ 1159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:44.669300 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:44.669344 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:44.669415 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:44.670504 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:44.671008 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:44.672083 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:44.672305 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:44.672390 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:44.674645 (+ 2255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:44.674648 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:44.674650 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:44.674672 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:44.676070 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:44.676657 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:44.676663 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:44.676665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:44.676748 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:44.677088 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:44.677091 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:44.677093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:44.677282 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:44.677393 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:44.677932 (+ 539us) server_negotiation.cc:299] Negotiation successful
0807 08:43:44.678025 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 08:43:44.679195 28808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:44.667545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:45443 (local address 127.8.208.193:51615)
0807 08:43:44.667995 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:44.668035 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:44.669124 (+ 1089us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:44.669568 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:44.669574 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:44.669971 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:43:44.670393 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:44.670404 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:44.671107 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:44.671109 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:44.671974 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:44.671984 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:44.672437 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:44.672439 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:44.672582 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:44.673042 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:43:44.673057 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:43:44.674502 (+ 1445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:43:44.676207 (+ 1705us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:44.676213 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:44.676226 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:44.676562 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:44.676839 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:44.676844 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:44.676848 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:44.676987 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:44.677390 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:43:44.677396 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:43:44.677660 (+ 264us) client_negotiation.cc:769] Sending connection context
0807 08:43:44.677893 (+ 233us) client_negotiation.cc:240] Negotiation successful
0807 08:43:44.678226 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":139,"threads_started":1}
I20260807 08:43:44.680529 28806 heartbeater.cc:347] Connected to a master server at 127.8.208.254:45443
I20260807 08:43:44.680768 28806 heartbeater.cc:464] Registering TS with master...
I20260807 08:43:44.681196 28806 heartbeater.cc:511] Master 127.8.208.254:45443 requested a full tablet report, sending...
I20260807 08:43:44.682595 28607 ts_manager.cc:194] Registered new tserver with Master: 5ff63180d5834e598fa6f822431c958e (127.8.208.193:33263)
I20260807 08:43:44.683625 28607 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.193@KRBTEST.COM'} at 127.8.208.193:51615
WARNING: no policy specified for kudu/127.8.208.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
I20260807 08:43:44.702888 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:45443
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:41337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:43:44.806311 28811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:44.806578 28811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:44.806645 28811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:44.810595 28811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:44.810673 28811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:44.810757 28811 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:43:44.815797 28811 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:41337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:45443
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28811
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:44.816764 28811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:44.817771 28811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:44.827019 28816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:44.827031 28817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:44.827031 28821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:44.827374 28811 server_base.cc:1034] running on GCE node
I20260807 08:43:44.827782 28811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:44.828400 28811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:44.829559 28811 hybrid_clock.cc:648] HybridClock initialized: now 1786092224829539 us; error 30 us; skew 500 ppm
Aug 07 08:43:44 dist-test-slave-6nmv krb5kdc[28560](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092224, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:44.836249 28811 init.cc:377] Logged in from keytab as kudu/127.8.208.194@KRBTEST.COM (short username kudu)
I20260807 08:43:44.837118 28811 webserver.cc:460] Webserver started at http://127.8.208.194:46243/ using document root <none> and password file <none>
I20260807 08:43:44.837700 28811 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:44.837791 28811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:44.838020 28811 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:44.840204 28811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "8347f094dcb44a96a4560890d8d82693"
format_stamp: "Formatted at 2026-08-07 08:43:44 on dist-test-slave-6nmv"
server_key: "ad231043ff48bd051ca2f2c65fd6bb9c"
server_key_iv: "b4a2fc8685417bce9ba7b7184e7fe41f"
server_key_version: "encryptionkey@0"
I20260807 08:43:44.840787 28811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "8347f094dcb44a96a4560890d8d82693"
format_stamp: "Formatted at 2026-08-07 08:43:44 on dist-test-slave-6nmv"
server_key: "ad231043ff48bd051ca2f2c65fd6bb9c"
server_key_iv: "b4a2fc8685417bce9ba7b7184e7fe41f"
server_key_version: "encryptionkey@0"
I20260807 08:43:44.844542 28811 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260807 08:43:44.846863 28829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:44.848013 28811 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 08:43:44.848127 28811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "8347f094dcb44a96a4560890d8d82693"
format_stamp: "Formatted at 2026-08-07 08:43:44 on dist-test-slave-6nmv"
server_key: "ad231043ff48bd051ca2f2c65fd6bb9c"
server_key_iv: "b4a2fc8685417bce9ba7b7184e7fe41f"
server_key_version: "encryptionkey@0"
I20260807 08:43:44.848225 28811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:44.868290 28811 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:44.870899 28811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:44.871088 28811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:44.871639 28811 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:43:44.872427 28811 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:43:44.872474 28811 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:44.872535 28811 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:43:44.872568 28811 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:44.881603 28811 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:38185
I20260807 08:43:44.881618 28946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:38185 every 8 connection(s)
I20260807 08:43:44.882475 28811 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:43:44.888975 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 28811
I20260807 08:43:44.889125 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:43:44.889460 9027 external_mini_cluster.cc:1428] Setting key 87093a69d562972f3688d8ec75fc91b6
Aug 07 08:43:44 dist-test-slave-6nmv krb5kdc[28560](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092224, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:43:44.896443 28648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:44.884090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:49537 (local address 127.8.208.254:45443)
0807 08:43:44.884228 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:44.884232 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:44.885129 (+ 897us) server_negotiation.cc:407] Connection header received
0807 08:43:44.886437 (+ 1308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:44.886439 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:44.886489 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:44.886570 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:44.887906 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:44.888415 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:44.890097 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:44.890427 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:44.890532 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:44.892961 (+ 2429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:44.892965 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:44.892968 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:44.892998 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:44.894436 (+ 1438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:44.894939 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:44.894944 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:44.894945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:44.895030 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:44.895403 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:44.895407 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:44.895409 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:44.895584 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:44.895694 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:44.896151 (+ 457us) server_negotiation.cc:299] Negotiation successful
0807 08:43:44.896267 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 08:43:44.897153 28949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:44.884533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:45443 (local address 127.8.208.194:49537)
0807 08:43:44.884978 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:44.885019 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:44.886208 (+ 1189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:44.886958 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:44.886966 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:44.887324 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:43:44.887773 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:44.887785 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:44.888541 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:44.888549 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:44.889974 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:44.889984 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:44.890580 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:44.890583 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:44.890717 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:44.891350 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:43:44.891365 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:43:44.892799 (+ 1434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:43:44.894557 (+ 1758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:44.894563 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:44.894584 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:44.894833 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:44.895146 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:44.895151 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:44.895153 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:44.895305 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:44.895693 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:43:44.895699 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:43:44.895917 (+ 218us) client_negotiation.cc:769] Sending connection context
0807 08:43:44.896098 (+ 181us) client_negotiation.cc:240] Negotiation successful
0807 08:43:44.896390 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":118,"threads_started":1}
I20260807 08:43:44.898245 28947 heartbeater.cc:347] Connected to a master server at 127.8.208.254:45443
I20260807 08:43:44.898494 28947 heartbeater.cc:464] Registering TS with master...
I20260807 08:43:44.899045 28947 heartbeater.cc:511] Master 127.8.208.254:45443 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.8.208.195@KRBTEST.COM; defaulting to no policy
I20260807 08:43:44.900045 28607 ts_manager.cc:194] Registered new tserver with Master: 8347f094dcb44a96a4560890d8d82693 (127.8.208.194:38185)
I20260807 08:43:44.900580 28607 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.194@KRBTEST.COM'} at 127.8.208.194:49537
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
I20260807 08:43:44.916843 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:45443
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:41337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:43:45.020771 28952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:45.020991 28952 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:45.021028 28952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:45.024617 28952 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:45.024663 28952 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:45.024755 28952 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:43:45.029698 28952 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:41337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:45443
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28952
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:45.030537 28952 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:45.031452 28952 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:45.040618 28958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:45.040691 28952 server_base.cc:1034] running on GCE node
W20260807 08:43:45.040627 28957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:45.040637 28960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:45.041292 28952 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:45.041961 28952 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:45.043107 28952 hybrid_clock.cc:648] HybridClock initialized: now 1786092225043083 us; error 36 us; skew 500 ppm
Aug 07 08:43:45 dist-test-slave-6nmv krb5kdc[28560](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092225, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:45.045630 28952 init.cc:377] Logged in from keytab as kudu/127.8.208.195@KRBTEST.COM (short username kudu)
I20260807 08:43:45.046445 28952 webserver.cc:460] Webserver started at http://127.8.208.195:43281/ using document root <none> and password file <none>
I20260807 08:43:45.046972 28952 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:45.047027 28952 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:45.047179 28952 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:45.049008 28952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "cdee3ea65ab54be6a797a3dce77a48c7"
format_stamp: "Formatted at 2026-08-07 08:43:45 on dist-test-slave-6nmv"
server_key: "4a9c470812cb104e701670061f38a4b5"
server_key_iv: "b0b861cdc351a165a3546d8815dead8a"
server_key_version: "encryptionkey@0"
I20260807 08:43:45.049553 28952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "cdee3ea65ab54be6a797a3dce77a48c7"
format_stamp: "Formatted at 2026-08-07 08:43:45 on dist-test-slave-6nmv"
server_key: "4a9c470812cb104e701670061f38a4b5"
server_key_iv: "b0b861cdc351a165a3546d8815dead8a"
server_key_version: "encryptionkey@0"
I20260807 08:43:45.053284 28952 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 08:43:45.055531 28967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:45.056622 28952 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:43:45.056766 28952 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "cdee3ea65ab54be6a797a3dce77a48c7"
format_stamp: "Formatted at 2026-08-07 08:43:45 on dist-test-slave-6nmv"
server_key: "4a9c470812cb104e701670061f38a4b5"
server_key_iv: "b0b861cdc351a165a3546d8815dead8a"
server_key_version: "encryptionkey@0"
I20260807 08:43:45.056866 28952 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:45.098887 28952 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:45.101769 28952 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:45.101979 28952 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:45.102535 28952 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:43:45.103308 28952 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:43:45.103412 28952 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:45.103502 28952 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:43:45.103556 28952 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:45.112406 28952 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:33259
I20260807 08:43:45.112434 29086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:33259 every 8 connection(s)
I20260807 08:43:45.113265 28952 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
Aug 07 08:43:45 dist-test-slave-6nmv krb5kdc[28560](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092225, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:43:45.122604 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 28952
I20260807 08:43:45.122741 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:43:45.123046 9027 external_mini_cluster.cc:1428] Setting key 60b66d2238e13a645a3c5a2c35128e9f
I20260807 08:43:45.126787 28648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:45.115009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:50235 (local address 127.8.208.254:45443)
0807 08:43:45.115162 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:45.115171 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:45.116005 (+ 834us) server_negotiation.cc:407] Connection header received
0807 08:43:45.117193 (+ 1188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:45.117196 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:45.117241 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:45.117313 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:45.118422 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.118971 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.119992 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.120222 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.120298 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:45.122769 (+ 2471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:45.122772 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:45.122774 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:45.122820 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:45.124418 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:45.124998 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:45.125000 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:45.125001 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:45.125119 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:45.125519 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:45.125524 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:45.125526 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:45.125771 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:45.125926 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:45.126474 (+ 548us) server_negotiation.cc:299] Negotiation successful
0807 08:43:45.126621 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 08:43:45.127568 29089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:45.115429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:45443 (local address 127.8.208.195:50235)
0807 08:43:45.115853 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:45.115894 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:45.117012 (+ 1118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:45.117464 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:45.117470 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:45.117791 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:43:45.118281 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:45.118294 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.119074 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.119076 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:45.119890 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:45.119898 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.120341 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.120343 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:45.120488 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:45.121020 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:43:45.121035 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:43:45.122589 (+ 1554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:43:45.124534 (+ 1945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:45.124539 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:45.124551 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:45.124877 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:45.125229 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:45.125233 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:45.125235 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:45.125399 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:45.125908 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:43:45.125914 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:43:45.126208 (+ 294us) client_negotiation.cc:769] Sending connection context
0807 08:43:45.126432 (+ 224us) client_negotiation.cc:240] Negotiation successful
0807 08:43:45.126734 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":128,"threads_started":1}
I20260807 08:43:45.128520 29087 heartbeater.cc:347] Connected to a master server at 127.8.208.254:45443
I20260807 08:43:45.128737 29087 heartbeater.cc:464] Registering TS with master...
I20260807 08:43:45.129204 29087 heartbeater.cc:511] Master 127.8.208.254:45443 requested a full tablet report, sending...
I20260807 08:43:45.130204 28607 ts_manager.cc:194] Registered new tserver with Master: cdee3ea65ab54be6a797a3dce77a48c7 (127.8.208.195:33259)
I20260807 08:43:45.130769 28607 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.195@KRBTEST.COM'} at 127.8.208.195:50235
I20260807 08:43:45.136775 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 08:43:45.146727 28648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:45.138744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45000 (local address 127.8.208.254:45443)
0807 08:43:45.138892 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:45.138896 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:45.139071 (+ 175us) server_negotiation.cc:407] Connection header received
0807 08:43:45.139155 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:45.139157 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:45.139192 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:45.139253 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:45.139941 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.140449 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.141581 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.141773 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.141917 (+ 144us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:45.143423 (+ 1506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:45.143435 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:45.143437 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:45.143458 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:45.144839 (+ 1381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:45.145345 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:45.145348 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:45.145349 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:45.145420 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:45.145746 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:45.145748 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:45.145749 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:45.146058 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:45.146231 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:45.146431 (+ 200us) server_negotiation.cc:299] Negotiation successful
0807 08:43:45.146538 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 08:43:45.149533 28607 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45000:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 08:43:45.152757 28607 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:43:45.167692 29099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:45.161422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:38185 (local address 127.0.0.1:51504)
0807 08:43:45.162211 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:45.162227 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:45.162352 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:45.163643 (+ 1291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:45.163645 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:45.163659 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:45.163720 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:45.163723 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.164804 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.164809 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:45.166078 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:45.166088 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.167135 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.167139 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:45.167266 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:45.167306 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 08:43:45.167414 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 08:43:45.167532 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"mutex_wait_us":59,"thread_start_us":90,"threads_started":1}
I20260807 08:43:45.167697 29101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:45.162114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51504 (local address 127.8.208.194:38185)
0807 08:43:45.163014 (+ 900us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:45.163026 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:45.163048 (+ 22us) server_negotiation.cc:407] Connection header received
0807 08:43:45.163151 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:45.163158 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:45.163335 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:45.163502 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:45.163834 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.164672 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.166205 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.166983 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.167091 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:45.167230 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:45.167464 (+ 234us) server_negotiation.cc:299] Negotiation successful
0807 08:43:45.167554 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":788,"thread_start_us":167,"threads_started":1}
I20260807 08:43:45.167997 29100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:45.161679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53920 (local address 127.8.208.193:33263)
0807 08:43:45.162655 (+ 976us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:45.162672 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:45.162696 (+ 24us) server_negotiation.cc:407] Connection header received
0807 08:43:45.162778 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:45.162786 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:45.162992 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:45.163196 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:45.163497 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.164713 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.166476 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.167194 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.167280 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:45.167405 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:45.167747 (+ 342us) server_negotiation.cc:299] Negotiation successful
0807 08:43:45.167846 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":866,"thread_start_us":148,"threads_started":1}
I20260807 08:43:45.168397 29098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:45.161537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:33263 (local address 127.0.0.1:53920)
0807 08:43:45.162177 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:45.162226 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:45.162352 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:45.163196 (+ 844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:45.163202 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:45.163226 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:45.163364 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:45.163372 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.164865 (+ 1493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.164868 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:45.166312 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:45.166323 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.167493 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.167496 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:45.167593 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:45.167614 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 08:43:45.168191 (+ 577us) client_negotiation.cc:240] Negotiation successful
0807 08:43:45.168275 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":91,"threads_started":1}
I20260807 08:43:45.168689 29103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:45.162225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:33259 (local address 127.0.0.1:52824)
0807 08:43:45.162581 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:45.162596 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:45.162674 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:45.163908 (+ 1234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:45.163911 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:45.163928 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:45.164001 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:45.164007 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.165373 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.165377 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:45.166492 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:45.166501 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.167693 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.167698 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:45.168166 (+ 468us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:45.168205 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 08:43:45.168282 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 08:43:45.168351 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":103,"threads_started":1}
I20260807 08:43:45.169480 29104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:45.162664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52824 (local address 127.8.208.195:33259)
0807 08:43:45.163495 (+ 831us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:45.163511 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:45.163531 (+ 20us) server_negotiation.cc:407] Connection header received
0807 08:43:45.163602 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:45.163607 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:45.163775 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:45.163922 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:45.164127 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.165177 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.166588 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.167376 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.167508 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:45.167627 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:45.168474 (+ 847us) server_negotiation.cc:299] Negotiation successful
0807 08:43:45.169302 (+ 828us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":704,"thread_start_us":145,"threads_started":1}
I20260807 08:43:45.170954 28738 tablet_service.cc:1467] Processing CreateTablet for tablet b3b588995a494a8385504a2c947f77a7 (DEFAULT_TABLE table=test-table [id=c1d2ef390ee444b0b796d0eb18abf3eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:43:45.170883 28879 tablet_service.cc:1467] Processing CreateTablet for tablet b3b588995a494a8385504a2c947f77a7 (DEFAULT_TABLE table=test-table [id=c1d2ef390ee444b0b796d0eb18abf3eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:43:45.171720 29017 tablet_service.cc:1467] Processing CreateTablet for tablet b3b588995a494a8385504a2c947f77a7 (DEFAULT_TABLE table=test-table [id=c1d2ef390ee444b0b796d0eb18abf3eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:43:45.172065 28879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3b588995a494a8385504a2c947f77a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:45.172065 28738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3b588995a494a8385504a2c947f77a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:45.172701 29017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3b588995a494a8385504a2c947f77a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:45.178645 29105 tablet_bootstrap.cc:492] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7: Bootstrap starting.
I20260807 08:43:45.180029 29106 tablet_bootstrap.cc:492] T b3b588995a494a8385504a2c947f77a7 P 8347f094dcb44a96a4560890d8d82693: Bootstrap starting.
I20260807 08:43:45.181013 29105 tablet_bootstrap.cc:654] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:45.182150 29105 log.cc:824] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:45.182224 29106 tablet_bootstrap.cc:654] T b3b588995a494a8385504a2c947f77a7 P 8347f094dcb44a96a4560890d8d82693: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:45.182206 29107 tablet_bootstrap.cc:492] T b3b588995a494a8385504a2c947f77a7 P 5ff63180d5834e598fa6f822431c958e: Bootstrap starting.
I20260807 08:43:45.183022 29106 log.cc:824] T b3b588995a494a8385504a2c947f77a7 P 8347f094dcb44a96a4560890d8d82693: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:45.184230 29107 tablet_bootstrap.cc:654] T b3b588995a494a8385504a2c947f77a7 P 5ff63180d5834e598fa6f822431c958e: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:45.184267 29105 tablet_bootstrap.cc:492] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7: No bootstrap required, opened a new log
I20260807 08:43:45.184468 29105 ts_tablet_manager.cc:1397] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 08:43:45.185003 29107 log.cc:824] T b3b588995a494a8385504a2c947f77a7 P 5ff63180d5834e598fa6f822431c958e: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:45.185144 29106 tablet_bootstrap.cc:492] T b3b588995a494a8385504a2c947f77a7 P 8347f094dcb44a96a4560890d8d82693: No bootstrap required, opened a new log
I20260807 08:43:45.185334 29106 ts_tablet_manager.cc:1397] T b3b588995a494a8385504a2c947f77a7 P 8347f094dcb44a96a4560890d8d82693: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260807 08:43:45.186903 29107 tablet_bootstrap.cc:492] T b3b588995a494a8385504a2c947f77a7 P 5ff63180d5834e598fa6f822431c958e: No bootstrap required, opened a new log
I20260807 08:43:45.187081 29107 ts_tablet_manager.cc:1397] T b3b588995a494a8385504a2c947f77a7 P 5ff63180d5834e598fa6f822431c958e: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 08:43:45.187667 29105 raft_consensus.cc:348] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8347f094dcb44a96a4560890d8d82693" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 38185 } } peers { permanent_uuid: "5ff63180d5834e598fa6f822431c958e" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 33263 } } peers { permanent_uuid: "cdee3ea65ab54be6a797a3dce77a48c7" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 33259 } }
I20260807 08:43:45.187920 29105 raft_consensus.cc:374] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:45.187984 29105 raft_consensus.cc:729] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdee3ea65ab54be6a797a3dce77a48c7, State: Initialized, Role: FOLLOWER
I20260807 08:43:45.188443 29105 consensus_queue.cc:260] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8347f094dcb44a96a4560890d8d82693" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 38185 } } peers { permanent_uuid: "5ff63180d5834e598fa6f822431c958e" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 33263 } } peers { permanent_uuid: "cdee3ea65ab54be6a797a3dce77a48c7" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 33259 } }
I20260807 08:43:45.189092 29087 heartbeater.cc:503] Master 127.8.208.254:45443 was elected leader, sending a full tablet report...
I20260807 08:43:45.189142 29106 raft_consensus.cc:348] T b3b588995a494a8385504a2c947f77a7 P 8347f094dcb44a96a4560890d8d82693 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8347f094dcb44a96a4560890d8d82693" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 38185 } } peers { permanent_uuid: "5ff63180d5834e598fa6f822431c958e" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 33263 } } peers { permanent_uuid: "cdee3ea65ab54be6a797a3dce77a48c7" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 33259 } }
I20260807 08:43:45.189388 29106 raft_consensus.cc:374] T b3b588995a494a8385504a2c947f77a7 P 8347f094dcb44a96a4560890d8d82693 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:45.189436 29106 raft_consensus.cc:729] T b3b588995a494a8385504a2c947f77a7 P 8347f094dcb44a96a4560890d8d82693 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8347f094dcb44a96a4560890d8d82693, State: Initialized, Role: FOLLOWER
I20260807 08:43:45.189445 29105 ts_tablet_manager.cc:1428] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7: Time spent starting tablet: real 0.005s user 0.000s sys 0.005s
I20260807 08:43:45.190307 29106 consensus_queue.cc:260] T b3b588995a494a8385504a2c947f77a7 P 8347f094dcb44a96a4560890d8d82693 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8347f094dcb44a96a4560890d8d82693" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 38185 } } peers { permanent_uuid: "5ff63180d5834e598fa6f822431c958e" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 33263 } } peers { permanent_uuid: "cdee3ea65ab54be6a797a3dce77a48c7" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 33259 } }
I20260807 08:43:45.190982 28947 heartbeater.cc:503] Master 127.8.208.254:45443 was elected leader, sending a full tablet report...
I20260807 08:43:45.191280 29106 ts_tablet_manager.cc:1428] T b3b588995a494a8385504a2c947f77a7 P 8347f094dcb44a96a4560890d8d82693: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260807 08:43:45.191242 29107 raft_consensus.cc:348] T b3b588995a494a8385504a2c947f77a7 P 5ff63180d5834e598fa6f822431c958e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8347f094dcb44a96a4560890d8d82693" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 38185 } } peers { permanent_uuid: "5ff63180d5834e598fa6f822431c958e" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 33263 } } peers { permanent_uuid: "cdee3ea65ab54be6a797a3dce77a48c7" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 33259 } }
I20260807 08:43:45.191473 29107 raft_consensus.cc:374] T b3b588995a494a8385504a2c947f77a7 P 5ff63180d5834e598fa6f822431c958e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:45.191526 29107 raft_consensus.cc:729] T b3b588995a494a8385504a2c947f77a7 P 5ff63180d5834e598fa6f822431c958e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ff63180d5834e598fa6f822431c958e, State: Initialized, Role: FOLLOWER
I20260807 08:43:45.191919 29107 consensus_queue.cc:260] T b3b588995a494a8385504a2c947f77a7 P 5ff63180d5834e598fa6f822431c958e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8347f094dcb44a96a4560890d8d82693" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 38185 } } peers { permanent_uuid: "5ff63180d5834e598fa6f822431c958e" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 33263 } } peers { permanent_uuid: "cdee3ea65ab54be6a797a3dce77a48c7" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 33259 } }
I20260807 08:43:45.192914 29107 ts_tablet_manager.cc:1428] T b3b588995a494a8385504a2c947f77a7 P 5ff63180d5834e598fa6f822431c958e: Time spent starting tablet: real 0.006s user 0.002s sys 0.005s
I20260807 08:43:45.193150 28806 heartbeater.cc:503] Master 127.8.208.254:45443 was elected leader, sending a full tablet report...
W20260807 08:43:45.364279 29088 tablet.cc:2369] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 08:43:45.383579 28948 tablet.cc:2369] T b3b588995a494a8385504a2c947f77a7 P 8347f094dcb44a96a4560890d8d82693: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 08:43:45.416793 28807 tablet.cc:2369] T b3b588995a494a8385504a2c947f77a7 P 5ff63180d5834e598fa6f822431c958e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 08:43:45.443147 29111 raft_consensus.cc:482] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:43:45.443346 29111 raft_consensus.cc:504] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8347f094dcb44a96a4560890d8d82693" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 38185 } } peers { permanent_uuid: "5ff63180d5834e598fa6f822431c958e" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 33263 } } peers { permanent_uuid: "cdee3ea65ab54be6a797a3dce77a48c7" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 33259 } }
I20260807 08:43:45.444506 29111 leader_election.cc:288] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8347f094dcb44a96a4560890d8d82693 (127.8.208.194:38185), 5ff63180d5834e598fa6f822431c958e (127.8.208.193:33263)
I20260807 08:43:45.448695 29101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:45.444907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:49435 (local address 127.8.208.194:38185)
0807 08:43:45.445056 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:45.445062 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:45.445118 (+ 56us) server_negotiation.cc:407] Connection header received
0807 08:43:45.445188 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:45.445191 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:45.445267 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:45.445357 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:45.445878 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.446531 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.447661 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.448084 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.448180 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:45.448268 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:45.448466 (+ 198us) server_negotiation.cc:299] Negotiation successful
0807 08:43:45.448544 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 08:43:45.448714 29100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:45.444924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:38427 (local address 127.8.208.193:33263)
0807 08:43:45.445056 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:45.445062 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:45.445473 (+ 411us) server_negotiation.cc:407] Connection header received
0807 08:43:45.445634 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:45.445637 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:45.445704 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:45.445782 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:45.446145 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.446669 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.447704 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.448112 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.448260 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:45.448315 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:45.448527 (+ 212us) server_negotiation.cc:299] Negotiation successful
0807 08:43:45.448608 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 08:43:45.448711 29089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:45.444798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:38185 (local address 127.8.208.195:49435)
0807 08:43:45.444902 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:45.444916 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:45.445018 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:45.445392 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:45.445394 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:45.445414 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:45.445617 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:45.445623 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.446643 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.446646 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:45.447513 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:45.447522 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.448217 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.448221 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:45.448324 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:45.448353 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 08:43:45.448425 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 08:43:45.448514 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25,"mutex_wait_us":1,"spinlock_wait_cycles":31232}
I20260807 08:43:45.448724 29114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:45.444798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:33263 (local address 127.8.208.195:38427)
0807 08:43:45.445358 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:45.445374 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:45.445515 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:45.445878 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:45.445881 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:45.445900 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:45.446019 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:45.446025 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.446773 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.446776 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:45.447541 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:45.447550 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.448279 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.448285 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:45.448371 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:45.448389 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 08:43:45.448492 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 08:43:45.448555 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"mutex_wait_us":129,"spinlock_wait_cycles":768,"thread_start_us":147,"threads_started":1}
I20260807 08:43:45.449448 28899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3b588995a494a8385504a2c947f77a7" candidate_uuid: "cdee3ea65ab54be6a797a3dce77a48c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8347f094dcb44a96a4560890d8d82693" is_pre_election: true
I20260807 08:43:45.449553 28758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3b588995a494a8385504a2c947f77a7" candidate_uuid: "cdee3ea65ab54be6a797a3dce77a48c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff63180d5834e598fa6f822431c958e" is_pre_election: true
I20260807 08:43:45.449803 28758 raft_consensus.cc:2454] T b3b588995a494a8385504a2c947f77a7 P 5ff63180d5834e598fa6f822431c958e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdee3ea65ab54be6a797a3dce77a48c7 in term 0.
I20260807 08:43:45.449803 28899 raft_consensus.cc:2454] T b3b588995a494a8385504a2c947f77a7 P 8347f094dcb44a96a4560890d8d82693 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdee3ea65ab54be6a797a3dce77a48c7 in term 0.
I20260807 08:43:45.450340 28968 leader_election.cc:302] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5ff63180d5834e598fa6f822431c958e, 8347f094dcb44a96a4560890d8d82693, cdee3ea65ab54be6a797a3dce77a48c7; no voters:
I20260807 08:43:45.450640 29111 raft_consensus.cc:2781] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:43:45.450759 29111 raft_consensus.cc:482] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:43:45.450819 29111 raft_consensus.cc:3037] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:45.452082 29111 raft_consensus.cc:504] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8347f094dcb44a96a4560890d8d82693" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 38185 } } peers { permanent_uuid: "5ff63180d5834e598fa6f822431c958e" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 33263 } } peers { permanent_uuid: "cdee3ea65ab54be6a797a3dce77a48c7" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 33259 } }
I20260807 08:43:45.452486 29111 leader_election.cc:288] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7 [CANDIDATE]: Term 1 election: Requested vote from peers 8347f094dcb44a96a4560890d8d82693 (127.8.208.194:38185), 5ff63180d5834e598fa6f822431c958e (127.8.208.193:33263)
I20260807 08:43:45.452863 28899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3b588995a494a8385504a2c947f77a7" candidate_uuid: "cdee3ea65ab54be6a797a3dce77a48c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8347f094dcb44a96a4560890d8d82693"
I20260807 08:43:45.452863 28758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3b588995a494a8385504a2c947f77a7" candidate_uuid: "cdee3ea65ab54be6a797a3dce77a48c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff63180d5834e598fa6f822431c958e"
I20260807 08:43:45.452994 28758 raft_consensus.cc:3037] T b3b588995a494a8385504a2c947f77a7 P 5ff63180d5834e598fa6f822431c958e [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:45.452994 28899 raft_consensus.cc:3037] T b3b588995a494a8385504a2c947f77a7 P 8347f094dcb44a96a4560890d8d82693 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:45.454285 28899 raft_consensus.cc:2454] T b3b588995a494a8385504a2c947f77a7 P 8347f094dcb44a96a4560890d8d82693 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdee3ea65ab54be6a797a3dce77a48c7 in term 1.
I20260807 08:43:45.454285 28758 raft_consensus.cc:2454] T b3b588995a494a8385504a2c947f77a7 P 5ff63180d5834e598fa6f822431c958e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdee3ea65ab54be6a797a3dce77a48c7 in term 1.
I20260807 08:43:45.454594 28969 leader_election.cc:302] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5ff63180d5834e598fa6f822431c958e, 8347f094dcb44a96a4560890d8d82693, cdee3ea65ab54be6a797a3dce77a48c7; no voters:
I20260807 08:43:45.454818 29111 raft_consensus.cc:2781] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:43:45.454998 29111 raft_consensus.cc:686] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7 [term 1 LEADER]: Becoming Leader. State: Replica: cdee3ea65ab54be6a797a3dce77a48c7, State: Running, Role: LEADER
I20260807 08:43:45.455331 29111 consensus_queue.cc:237] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8347f094dcb44a96a4560890d8d82693" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 38185 } } peers { permanent_uuid: "5ff63180d5834e598fa6f822431c958e" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 33263 } } peers { permanent_uuid: "cdee3ea65ab54be6a797a3dce77a48c7" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 33259 } }
I20260807 08:43:45.458237 28607 catalog_manager.cc:5495] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to cdee3ea65ab54be6a797a3dce77a48c7 (127.8.208.195). New cstate: current_term: 1 leader_uuid: "cdee3ea65ab54be6a797a3dce77a48c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8347f094dcb44a96a4560890d8d82693" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 38185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ff63180d5834e598fa6f822431c958e" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdee3ea65ab54be6a797a3dce77a48c7" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 33259 } health_report { overall_health: HEALTHY } } }
I20260807 08:43:45.531075 29104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:45.527526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52826 (local address 127.8.208.195:33259)
0807 08:43:45.527660 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:45.527663 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:45.527675 (+ 12us) server_negotiation.cc:407] Connection header received
0807 08:43:45.527741 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:45.527743 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:45.527793 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:45.527914 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:43:45.528172 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.528667 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.529507 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.529722 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.529848 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:45.530180 (+ 332us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:43:45.530615 (+ 435us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:43:45.530782 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:45.530883 (+ 101us) server_negotiation.cc:299] Negotiation successful
0807 08:43:45.530925 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 08:43:45.536687 28758 raft_consensus.cc:1261] T b3b588995a494a8385504a2c947f77a7 P 5ff63180d5834e598fa6f822431c958e [term 1 FOLLOWER]: Refusing update from remote peer cdee3ea65ab54be6a797a3dce77a48c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:43:45.536690 28899 raft_consensus.cc:1261] T b3b588995a494a8385504a2c947f77a7 P 8347f094dcb44a96a4560890d8d82693 [term 1 FOLLOWER]: Refusing update from remote peer cdee3ea65ab54be6a797a3dce77a48c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:43:45.537431 29111 consensus_queue.cc:1035] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8347f094dcb44a96a4560890d8d82693" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 38185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:43:45.537609 29115 consensus_queue.cc:1035] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff63180d5834e598fa6f822431c958e" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:43:45.552095 28607 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45000:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:43:45.552284 28607 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45000:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:43:45.554608 28607 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 11f6f4f4e01a43278a79f59f5950df1c: Sending DeleteTablet for 3 replicas of tablet b3b588995a494a8385504a2c947f77a7
I20260807 08:43:45.555338 28738 tablet_service.cc:1514] Processing DeleteTablet for tablet b3b588995a494a8385504a2c947f77a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:43:45 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:53920
I20260807 08:43:45.555410 29017 tablet_service.cc:1514] Processing DeleteTablet for tablet b3b588995a494a8385504a2c947f77a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:43:45 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:52824
I20260807 08:43:45.555965 29131 tablet_replica.cc:330] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7: stopping tablet replica
I20260807 08:43:45.555974 28879 tablet_service.cc:1514] Processing DeleteTablet for tablet b3b588995a494a8385504a2c947f77a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:43:45 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:51504
I20260807 08:43:45.556157 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 28672
I20260807 08:43:45.565760 29131 raft_consensus.cc:2229] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7 [term 1 LEADER]: Raft consensus shutting down.
I20260807 08:43:45.566149 29132 tablet_replica.cc:330] T b3b588995a494a8385504a2c947f77a7 P 8347f094dcb44a96a4560890d8d82693: stopping tablet replica
I20260807 08:43:45.566210 29131 raft_consensus.cc:2258] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:43:45.566632 29132 raft_consensus.cc:2229] T b3b588995a494a8385504a2c947f77a7 P 8347f094dcb44a96a4560890d8d82693 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:43:45.567059 29132 raft_consensus.cc:2258] T b3b588995a494a8385504a2c947f77a7 P 8347f094dcb44a96a4560890d8d82693 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:43:45.567746 29131 ts_tablet_manager.cc:1905] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:43:45.568806 29132 ts_tablet_manager.cc:1905] T b3b588995a494a8385504a2c947f77a7 P 8347f094dcb44a96a4560890d8d82693: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:43:45.570393 29131 ts_tablet_manager.cc:1918] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:43:45.570487 29131 log.cc:1196] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/b3b588995a494a8385504a2c947f77a7
I20260807 08:43:45.570781 29131 ts_tablet_manager.cc:1939] T b3b588995a494a8385504a2c947f77a7 P cdee3ea65ab54be6a797a3dce77a48c7: Deleting consensus metadata
I20260807 08:43:45.571962 28590 catalog_manager.cc:4841] TS cdee3ea65ab54be6a797a3dce77a48c7 (127.8.208.195:33259): tablet b3b588995a494a8385504a2c947f77a7 (table test-table [id=c1d2ef390ee444b0b796d0eb18abf3eb]) successfully deleted
W20260807 08:43:45.572633 28592 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.208.193:33263 (error 108)
I20260807 08:43:45.572809 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 28811
I20260807 08:43:45.575284 29103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:45.574851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:33263 (local address 127.0.0.1:53934)
0807 08:43:45.575063 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:45.575155 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.193:33263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
W20260807 08:43:45.575556 28592 catalog_manager.cc:4584] TS 5ff63180d5834e598fa6f822431c958e (127.8.208.193:33263): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b3b588995a494a8385504a2c947f77a7: Network error: Client connection negotiation failed: client connection to 127.8.208.193:33263: connect: Connection refused (error 111)
I20260807 08:43:45.580390 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 28952
I20260807 08:43:45.582065 29103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:45.580550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:38185 (local address 127.0.0.1:51512)
0807 08:43:45.581898 (+ 1348us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:45.581966 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.194:38185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1202}
I20260807 08:43:45.587004 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 28574
2026-08-07T08:43:45Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2459 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-07T08:43:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:43:45Z Disabled control of system clock
I20260807 08:43:45.619335 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:45603
--webserver_interface=127.8.208.254
--webserver_port=0
--builtin_ntp_servers=127.8.208.212:32977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:45603
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 08:43:45.725004 29138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:45.725219 29138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:45.725255 29138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:45.729013 29138 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:43:45.729063 29138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:45.729077 29138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:45.729091 29138 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:43:45.729103 29138 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:43:45.733449 29138 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:32977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:45603
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:45603
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:45.734365 29138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:45.735560 29138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:45.743440 29146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:45.743479 29143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:45.743642 29138 server_base.cc:1034] running on GCE node
W20260807 08:43:45.743716 29144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:45.744206 29138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:45.745139 29138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:45.746316 29138 hybrid_clock.cc:648] HybridClock initialized: now 1786092225746297 us; error 29 us; skew 500 ppm
I20260807 08:43:45.748031 29138 webserver.cc:460] Webserver started at http://127.8.208.254:39497/ using document root <none> and password file <none>
I20260807 08:43:45.748541 29138 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:45.748624 29138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:45.748829 29138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:45.750777 29138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "9a6854a2b05144ac9d5244785df6390a"
format_stamp: "Formatted at 2026-08-07 08:43:45 on dist-test-slave-6nmv"
server_key: "c40120c66256ecbaeff5d8eb43ad6002"
server_key_iv: "aafdf384611c6bac2ed00cd7aed622ba"
server_key_version: "encryptionkey@0"
I20260807 08:43:45.751281 29138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "9a6854a2b05144ac9d5244785df6390a"
format_stamp: "Formatted at 2026-08-07 08:43:45 on dist-test-slave-6nmv"
server_key: "c40120c66256ecbaeff5d8eb43ad6002"
server_key_iv: "aafdf384611c6bac2ed00cd7aed622ba"
server_key_version: "encryptionkey@0"
I20260807 08:43:45.754637 29138 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.002s
I20260807 08:43:45.756892 29152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:45.758059 29138 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 08:43:45.758188 29138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "9a6854a2b05144ac9d5244785df6390a"
format_stamp: "Formatted at 2026-08-07 08:43:45 on dist-test-slave-6nmv"
server_key: "c40120c66256ecbaeff5d8eb43ad6002"
server_key_iv: "aafdf384611c6bac2ed00cd7aed622ba"
server_key_version: "encryptionkey@0"
I20260807 08:43:45.758286 29138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:45.767460 29138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:45.768030 29138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:45.768198 29138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:45.774345 29138 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:45603
I20260807 08:43:45.774376 29204 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:45603 every 8 connection(s)
I20260807 08:43:45.775085 29138 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:43:45.777792 29205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:45.782220 29205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a6854a2b05144ac9d5244785df6390a: Bootstrap starting.
I20260807 08:43:45.784152 29205 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a6854a2b05144ac9d5244785df6390a: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:45.784504 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 29138
I20260807 08:43:45.784628 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:43:45.784830 29205 log.cc:824] T 00000000000000000000000000000000 P 9a6854a2b05144ac9d5244785df6390a: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:45.784907 9027 external_mini_cluster.cc:1428] Setting key ee2b0aec487cc690c5dff2c169874a28
I20260807 08:43:45.786846 29205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a6854a2b05144ac9d5244785df6390a: No bootstrap required, opened a new log
I20260807 08:43:45.789661 29205 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9a6854a2b05144ac9d5244785df6390a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a6854a2b05144ac9d5244785df6390a" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45603 } }
I20260807 08:43:45.789881 29205 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9a6854a2b05144ac9d5244785df6390a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:45.789951 29205 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9a6854a2b05144ac9d5244785df6390a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a6854a2b05144ac9d5244785df6390a, State: Initialized, Role: FOLLOWER
I20260807 08:43:45.790333 29205 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a6854a2b05144ac9d5244785df6390a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a6854a2b05144ac9d5244785df6390a" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45603 } }
I20260807 08:43:45.790465 29205 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9a6854a2b05144ac9d5244785df6390a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:43:45.790529 29205 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9a6854a2b05144ac9d5244785df6390a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:43:45.790616 29205 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9a6854a2b05144ac9d5244785df6390a [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:45.791465 29205 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9a6854a2b05144ac9d5244785df6390a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a6854a2b05144ac9d5244785df6390a" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45603 } }
I20260807 08:43:45.791806 29205 leader_election.cc:302] T 00000000000000000000000000000000 P 9a6854a2b05144ac9d5244785df6390a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a6854a2b05144ac9d5244785df6390a; no voters:
I20260807 08:43:45.792140 29205 leader_election.cc:288] T 00000000000000000000000000000000 P 9a6854a2b05144ac9d5244785df6390a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:43:45.792205 29210 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9a6854a2b05144ac9d5244785df6390a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:43:45.792438 29210 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9a6854a2b05144ac9d5244785df6390a [term 1 LEADER]: Becoming Leader. State: Replica: 9a6854a2b05144ac9d5244785df6390a, State: Running, Role: LEADER
I20260807 08:43:45.792737 29210 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a6854a2b05144ac9d5244785df6390a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a6854a2b05144ac9d5244785df6390a" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45603 } }
I20260807 08:43:45.793082 29209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:45.786051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35312 (local address 127.8.208.254:45603)
0807 08:43:45.786639 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:45.786651 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:45.786679 (+ 28us) server_negotiation.cc:407] Connection header received
0807 08:43:45.787254 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:45.787269 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:45.787537 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:45.787810 (+ 273us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:45.788165 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.788946 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.789720 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:45.790259 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:45.790412 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:45.791174 (+ 762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:45.791179 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:45.791194 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:43:45.791551 (+ 357us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:45.791625 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:43:45.791653 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:45.791772 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:45.791916 (+ 144us) server_negotiation.cc:299] Negotiation successful
0807 08:43:45.792160 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":125,"threads_started":1}
I20260807 08:43:45.793371 29205 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9a6854a2b05144ac9d5244785df6390a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:43:45.793839 29212 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a6854a2b05144ac9d5244785df6390a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9a6854a2b05144ac9d5244785df6390a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a6854a2b05144ac9d5244785df6390a" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45603 } } }
I20260807 08:43:45.793949 29212 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a6854a2b05144ac9d5244785df6390a [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:45.794171 29211 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a6854a2b05144ac9d5244785df6390a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a6854a2b05144ac9d5244785df6390a. Latest consensus state: current_term: 1 leader_uuid: "9a6854a2b05144ac9d5244785df6390a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a6854a2b05144ac9d5244785df6390a" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45603 } } }
I20260807 08:43:45.794265 29211 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a6854a2b05144ac9d5244785df6390a [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:45.794816 29215 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:43:45.797559 29215 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:43:45.802399 29215 catalog_manager.cc:1347] Generated new cluster ID: 208ad768c5904aa7828c0d89cf713756
I20260807 08:43:45.802489 29215 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:43:45.816679 29215 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:43:45.817523 29215 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:43:45.824738 29215 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9a6854a2b05144ac9d5244785df6390a: Generated new TSK 0
I20260807 08:43:45.825347 29215 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:43:45.830520 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:45603
--builtin_ntp_servers=127.8.208.212:32977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 08:43:45.932813 29230 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:45.933073 29230 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:45.933139 29230 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:45.936935 29230 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:45.937021 29230 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:45.937114 29230 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:43:45.941522 29230 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:32977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:45603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29230
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:45.942484 29230 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:45.943755 29230 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:45.952778 29235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:45.952778 29238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:45.952899 29230 server_base.cc:1034] running on GCE node
W20260807 08:43:45.952800 29236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:45.953420 29230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:45.953985 29230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:45.955137 29230 hybrid_clock.cc:648] HybridClock initialized: now 1786092225955120 us; error 27 us; skew 500 ppm
I20260807 08:43:45.956875 29230 webserver.cc:460] Webserver started at http://127.8.208.193:44097/ using document root <none> and password file <none>
I20260807 08:43:45.957379 29230 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:45.957435 29230 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:45.957583 29230 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:45.959497 29230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "43ea85f6ddd94c028a83e5a2ff522376"
format_stamp: "Formatted at 2026-08-07 08:43:45 on dist-test-slave-6nmv"
server_key: "240f1ec102922eeb5f78b617e4312bda"
server_key_iv: "db20660ad7c1e3aa6e82dc97d2ac8efd"
server_key_version: "encryptionkey@0"
I20260807 08:43:45.959968 29230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "43ea85f6ddd94c028a83e5a2ff522376"
format_stamp: "Formatted at 2026-08-07 08:43:45 on dist-test-slave-6nmv"
server_key: "240f1ec102922eeb5f78b617e4312bda"
server_key_iv: "db20660ad7c1e3aa6e82dc97d2ac8efd"
server_key_version: "encryptionkey@0"
I20260807 08:43:45.963434 29230 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 08:43:45.965484 29244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:45.966639 29230 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 08:43:45.966724 29230 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "43ea85f6ddd94c028a83e5a2ff522376"
format_stamp: "Formatted at 2026-08-07 08:43:45 on dist-test-slave-6nmv"
server_key: "240f1ec102922eeb5f78b617e4312bda"
server_key_iv: "db20660ad7c1e3aa6e82dc97d2ac8efd"
server_key_version: "encryptionkey@0"
I20260807 08:43:45.966799 29230 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:45.983215 29230 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:45.983752 29230 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:45.983889 29230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:45.984364 29230 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:43:45.985173 29230 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:43:45.985219 29230 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:45.985257 29230 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:43:45.985277 29230 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:45.994129 29230 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:43381
I20260807 08:43:45.994165 29361 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:43381 every 8 connection(s)
I20260807 08:43:45.995033 29230 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:43:45.996832 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 29230
I20260807 08:43:45.996958 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
I20260807 08:43:45.997244 9027 external_mini_cluster.cc:1428] Setting key 0e2534eb28b804c175529c3dce1b01f0
I20260807 08:43:45.999461 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:45603
--builtin_ntp_servers=127.8.208.212:32977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 08:43:46.005463 29209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:45.996700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:45795 (local address 127.8.208.254:45603)
0807 08:43:45.996852 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:45.996857 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:45.998025 (+ 1168us) server_negotiation.cc:407] Connection header received
0807 08:43:45.999633 (+ 1608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:45.999639 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:45.999696 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:45.999783 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:46.000933 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.001476 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.003237 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.003466 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.003548 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:46.004966 (+ 1418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:46.004969 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:46.004971 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:43:46.004982 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:46.005002 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:43:46.005009 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:46.005073 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:46.005284 (+ 211us) server_negotiation.cc:299] Negotiation successful
0807 08:43:46.005337 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 08:43:46.006690 29364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:45.997096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:45603 (local address 127.8.208.193:45795)
0807 08:43:45.997875 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:45.997924 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:45.999370 (+ 1446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:45.999967 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:45.999979 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:46.000127 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:43:46.000784 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:46.000804 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.001616 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.001623 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:46.003082 (+ 1459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:46.003096 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.003630 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.003637 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:46.003866 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:46.004649 (+ 783us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 08:43:46.004652 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:43:46.004709 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 08:43:46.004796 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:43:46.005105 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:43:46.005117 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:43:46.005125 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 08:43:46.005269 (+ 144us) client_negotiation.cc:240] Negotiation successful
0807 08:43:46.005571 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":142,"threads_started":1}
I20260807 08:43:46.008059 29362 heartbeater.cc:347] Connected to a master server at 127.8.208.254:45603
I20260807 08:43:46.008311 29362 heartbeater.cc:464] Registering TS with master...
I20260807 08:43:46.008831 29362 heartbeater.cc:511] Master 127.8.208.254:45603 requested a full tablet report, sending...
I20260807 08:43:46.010416 29169 ts_manager.cc:194] Registered new tserver with Master: 43ea85f6ddd94c028a83e5a2ff522376 (127.8.208.193:43381)
I20260807 08:43:46.011696 29169 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.208.193:45795
W20260807 08:43:46.107889 29365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:46.108091 29365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:46.108122 29365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:46.111985 29365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:46.112031 29365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:46.112118 29365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:43:46.116641 29365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:32977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:45603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29365
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:46.117604 29365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:46.118891 29365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:46.128460 29370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:46.128471 29371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:46.128516 29365 server_base.cc:1034] running on GCE node
W20260807 08:43:46.128481 29373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:46.129105 29365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:46.129700 29365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:46.130874 29365 hybrid_clock.cc:648] HybridClock initialized: now 1786092226130842 us; error 25 us; skew 500 ppm
I20260807 08:43:46.132731 29365 webserver.cc:460] Webserver started at http://127.8.208.194:35667/ using document root <none> and password file <none>
I20260807 08:43:46.133285 29365 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:46.133347 29365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:46.133615 29365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:46.135613 29365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "aa65df02f4cf4d54a9daedef1b9ac9bf"
format_stamp: "Formatted at 2026-08-07 08:43:46 on dist-test-slave-6nmv"
server_key: "c55166a8b1d88c53cc2626a37833d79d"
server_key_iv: "a1e1426c9ee454cbb4eb6552d8d729db"
server_key_version: "encryptionkey@0"
I20260807 08:43:46.136176 29365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "aa65df02f4cf4d54a9daedef1b9ac9bf"
format_stamp: "Formatted at 2026-08-07 08:43:46 on dist-test-slave-6nmv"
server_key: "c55166a8b1d88c53cc2626a37833d79d"
server_key_iv: "a1e1426c9ee454cbb4eb6552d8d729db"
server_key_version: "encryptionkey@0"
I20260807 08:43:46.139645 29365 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 08:43:46.142061 29379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:46.143237 29365 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:43:46.143353 29365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "aa65df02f4cf4d54a9daedef1b9ac9bf"
format_stamp: "Formatted at 2026-08-07 08:43:46 on dist-test-slave-6nmv"
server_key: "c55166a8b1d88c53cc2626a37833d79d"
server_key_iv: "a1e1426c9ee454cbb4eb6552d8d729db"
server_key_version: "encryptionkey@0"
I20260807 08:43:46.143460 29365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:46.164891 29365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:46.165472 29365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:46.165654 29365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:46.166204 29365 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:43:46.167053 29365 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:43:46.167097 29365 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:46.167160 29365 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:43:46.167203 29365 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:46.175433 29365 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:41455
I20260807 08:43:46.175458 29499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:41455 every 8 connection(s)
I20260807 08:43:46.176230 29365 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:43:46.176717 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 29365
I20260807 08:43:46.176851 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:43:46.177158 9027 external_mini_cluster.cc:1428] Setting key ef7b4c829bf2a679e60c0c895219fdb7
I20260807 08:43:46.179088 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:45603
--builtin_ntp_servers=127.8.208.212:32977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 08:43:46.185181 29209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:46.177927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:46927 (local address 127.8.208.254:45603)
0807 08:43:46.178033 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:46.178036 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:46.179172 (+ 1136us) server_negotiation.cc:407] Connection header received
0807 08:43:46.180537 (+ 1365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:46.180540 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:46.180592 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:46.180690 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:46.181476 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.182165 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.183203 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.183592 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.183706 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:46.184658 (+ 952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:46.184664 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:46.184669 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:43:46.184685 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:46.184709 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:43:46.184722 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:46.184804 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:46.184929 (+ 125us) server_negotiation.cc:299] Negotiation successful
0807 08:43:46.184994 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 08:43:46.185952 29502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:46.178395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:45603 (local address 127.8.208.194:46927)
0807 08:43:46.179035 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:46.179079 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:46.180334 (+ 1255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:46.180847 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:46.180853 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:46.180935 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:43:46.181347 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:46.181358 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.182283 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.182286 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:46.183059 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:46.183068 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.183725 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.183728 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:46.183850 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:46.184429 (+ 579us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 08:43:46.184431 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:43:46.184464 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 08:43:46.184516 (+ 52us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:43:46.184808 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:43:46.184814 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:43:46.184818 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 08:43:46.184900 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 08:43:46.185082 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":129,"threads_started":1}
I20260807 08:43:46.187000 29500 heartbeater.cc:347] Connected to a master server at 127.8.208.254:45603
I20260807 08:43:46.187214 29500 heartbeater.cc:464] Registering TS with master...
I20260807 08:43:46.187665 29500 heartbeater.cc:511] Master 127.8.208.254:45603 requested a full tablet report, sending...
I20260807 08:43:46.188637 29169 ts_manager.cc:194] Registered new tserver with Master: aa65df02f4cf4d54a9daedef1b9ac9bf (127.8.208.194:41455)
I20260807 08:43:46.189433 29169 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.208.194:46927
W20260807 08:43:46.282234 29503 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:46.282424 29503 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:46.282456 29503 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:46.286072 29503 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:46.286113 29503 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:46.286162 29503 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:43:46.290248 29503 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:32977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:45603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29503
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:46.291006 29503 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:46.292204 29503 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:46.301222 29511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:46.301227 29508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:46.301230 29509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:46.301268 29503 server_base.cc:1034] running on GCE node
I20260807 08:43:46.301757 29503 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:46.302320 29503 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:46.303515 29503 hybrid_clock.cc:648] HybridClock initialized: now 1786092226303499 us; error 22 us; skew 500 ppm
I20260807 08:43:46.305467 29503 webserver.cc:460] Webserver started at http://127.8.208.195:36447/ using document root <none> and password file <none>
I20260807 08:43:46.306115 29503 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:46.306193 29503 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:46.306465 29503 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:46.308420 29503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "e3e59e3607ab4440a2e3411eefffbbd3"
format_stamp: "Formatted at 2026-08-07 08:43:46 on dist-test-slave-6nmv"
server_key: "5d7fb77d92b05f4c81176d3e4634233f"
server_key_iv: "77696ce0823c78be8aa6a4e033b08f11"
server_key_version: "encryptionkey@0"
I20260807 08:43:46.308960 29503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "e3e59e3607ab4440a2e3411eefffbbd3"
format_stamp: "Formatted at 2026-08-07 08:43:46 on dist-test-slave-6nmv"
server_key: "5d7fb77d92b05f4c81176d3e4634233f"
server_key_iv: "77696ce0823c78be8aa6a4e033b08f11"
server_key_version: "encryptionkey@0"
I20260807 08:43:46.312602 29503 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260807 08:43:46.314944 29517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:46.316134 29503 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 08:43:46.316279 29503 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "e3e59e3607ab4440a2e3411eefffbbd3"
format_stamp: "Formatted at 2026-08-07 08:43:46 on dist-test-slave-6nmv"
server_key: "5d7fb77d92b05f4c81176d3e4634233f"
server_key_iv: "77696ce0823c78be8aa6a4e033b08f11"
server_key_version: "encryptionkey@0"
I20260807 08:43:46.316408 29503 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:46.341457 29503 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:46.342211 29503 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:46.342425 29503 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:46.343066 29503 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:43:46.344080 29503 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:43:46.344158 29503 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:46.344245 29503 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:43:46.344298 29503 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:46.353992 29503 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:39311
I20260807 08:43:46.354049 29634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:39311 every 8 connection(s)
I20260807 08:43:46.354802 29503 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:43:46.355592 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 29503
I20260807 08:43:46.355727 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:43:46.356007 9027 external_mini_cluster.cc:1428] Setting key 77559d57b89a7566ab3d47146c1e0915
I20260807 08:43:46.364375 29209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:46.356609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:57957 (local address 127.8.208.254:45603)
0807 08:43:46.356740 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:46.356744 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:46.357874 (+ 1130us) server_negotiation.cc:407] Connection header received
0807 08:43:46.359593 (+ 1719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:46.359596 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:46.359653 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:46.359726 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:46.360530 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.361053 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.362354 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.362621 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.362732 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:46.363896 (+ 1164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:46.363899 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:46.363902 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:43:46.363914 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:46.363941 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:43:46.363949 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:46.364022 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:46.364177 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 08:43:46.364238 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 08:43:46.365204 29637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:46.356988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:45603 (local address 127.8.208.195:57957)
0807 08:43:46.357708 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:46.357755 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:46.359372 (+ 1617us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:46.359881 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:46.359887 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:46.359962 (+ 75us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:43:46.360400 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:46.360411 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.361205 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.361208 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:46.362230 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:46.362239 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.362780 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.362784 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:46.362948 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:46.363606 (+ 658us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 08:43:46.363607 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:43:46.363660 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 08:43:46.363717 (+ 57us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:43:46.364024 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:43:46.364035 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:43:46.364043 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 08:43:46.364177 (+ 134us) client_negotiation.cc:240] Negotiation successful
0807 08:43:46.364420 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":102,"threads_started":1}
I20260807 08:43:46.366283 29635 heartbeater.cc:347] Connected to a master server at 127.8.208.254:45603
I20260807 08:43:46.366500 29635 heartbeater.cc:464] Registering TS with master...
I20260807 08:43:46.366990 29635 heartbeater.cc:511] Master 127.8.208.254:45603 requested a full tablet report, sending...
I20260807 08:43:46.367996 29169 ts_manager.cc:194] Registered new tserver with Master: e3e59e3607ab4440a2e3411eefffbbd3 (127.8.208.195:39311)
I20260807 08:43:46.368578 29169 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.208.195:57957
I20260807 08:43:46.371138 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 08:43:46.376709 29209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:46.373013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35316 (local address 127.8.208.254:45603)
0807 08:43:46.373126 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:46.373130 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:46.373354 (+ 224us) server_negotiation.cc:407] Connection header received
0807 08:43:46.373485 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:46.373487 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:46.373522 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:46.373579 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:46.373949 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.374403 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.375254 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.375467 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.375538 (+ 71us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:46.376317 (+ 779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:46.376320 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:46.376322 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:43:46.376333 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:46.376350 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:43:46.376357 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:46.376453 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:46.376599 (+ 146us) server_negotiation.cc:299] Negotiation successful
0807 08:43:46.376626 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 08:43:46.379081 29169 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35316:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 08:43:46.381793 29169 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:43:46.395589 29647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:46.389594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:43381 (local address 127.0.0.1:60734)
0807 08:43:46.390270 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:46.390317 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:46.390450 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:46.391057 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:46.391062 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:46.391094 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:46.391227 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:46.391234 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.392591 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.392595 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:46.394064 (+ 1469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:46.394075 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.395051 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.395055 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:46.395170 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:46.395208 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 08:43:46.395316 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 08:43:46.395427 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"mutex_wait_us":60,"thread_start_us":63,"threads_started":1}
I20260807 08:43:46.395583 29648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:46.389780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60734 (local address 127.8.208.193:43381)
0807 08:43:46.390147 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:46.390159 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:46.390579 (+ 420us) server_negotiation.cc:407] Connection header received
0807 08:43:46.390662 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:46.390669 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:46.390888 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:46.391054 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:46.391369 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.392470 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.394200 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.394927 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.395049 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:46.395239 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:46.395342 (+ 103us) server_negotiation.cc:299] Negotiation successful
0807 08:43:46.395430 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":150,"threads_started":1}
I20260807 08:43:46.395934 29649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:46.389800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:41455 (local address 127.0.0.1:46252)
0807 08:43:46.390765 (+ 965us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:46.390778 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:46.390924 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:46.391754 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:46.391757 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:46.391777 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:46.391855 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:46.391861 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.392994 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.392998 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:46.394259 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:46.394266 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.395524 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.395528 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:46.395616 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:46.395638 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 08:43:46.395710 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 08:43:46.395783 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":907,"mutex_wait_us":25,"thread_start_us":111,"threads_started":1}
I20260807 08:43:46.396430 29652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:46.390606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46252 (local address 127.8.208.194:41455)
0807 08:43:46.391244 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:46.391254 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:46.391272 (+ 18us) server_negotiation.cc:407] Connection header received
0807 08:43:46.391344 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:46.391348 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:46.391570 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:46.391755 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:46.391954 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.392863 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.394366 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.395155 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.395264 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:46.395456 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:46.396199 (+ 743us) server_negotiation.cc:299] Negotiation successful
0807 08:43:46.396300 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":87,"threads_started":1}
I20260807 08:43:46.396234 29650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:46.390215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:39311 (local address 127.0.0.1:59702)
0807 08:43:46.391135 (+ 920us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:46.391147 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:46.391235 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:46.391915 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:46.391921 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:46.391941 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:46.392028 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:46.392034 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.393221 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.393225 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:46.394323 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:46.394334 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.395579 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.395583 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:46.395649 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:46.395761 (+ 112us) client_negotiation.cc:769] Sending connection context
0807 08:43:46.395831 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 08:43:46.395886 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":865,"mutex_wait_us":2,"thread_start_us":95,"threads_started":1}
I20260807 08:43:46.396152 29651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:46.390377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59702 (local address 127.8.208.195:39311)
0807 08:43:46.391040 (+ 663us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:46.391050 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:46.391220 (+ 170us) server_negotiation.cc:407] Connection header received
0807 08:43:46.391343 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:46.391347 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:46.391570 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:46.391754 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:46.392154 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.393092 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.394447 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.395286 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.395392 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:46.395530 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:46.395880 (+ 350us) server_negotiation.cc:299] Negotiation successful
0807 08:43:46.395975 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":145,"threads_started":1}
I20260807 08:43:46.398996 29292 tablet_service.cc:1467] Processing CreateTablet for tablet d28c742f775c4a59b0aed5a9ec32f821 (DEFAULT_TABLE table=test-table [id=421f6dd29d814792aa28913efb248290]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:43:46.399111 29430 tablet_service.cc:1467] Processing CreateTablet for tablet d28c742f775c4a59b0aed5a9ec32f821 (DEFAULT_TABLE table=test-table [id=421f6dd29d814792aa28913efb248290]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:43:46.399327 29567 tablet_service.cc:1467] Processing CreateTablet for tablet d28c742f775c4a59b0aed5a9ec32f821 (DEFAULT_TABLE table=test-table [id=421f6dd29d814792aa28913efb248290]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:43:46.400070 29292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d28c742f775c4a59b0aed5a9ec32f821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:46.400089 29430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d28c742f775c4a59b0aed5a9ec32f821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:46.400228 29567 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d28c742f775c4a59b0aed5a9ec32f821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:46.405922 29653 tablet_bootstrap.cc:492] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3: Bootstrap starting.
I20260807 08:43:46.407541 29654 tablet_bootstrap.cc:492] T d28c742f775c4a59b0aed5a9ec32f821 P aa65df02f4cf4d54a9daedef1b9ac9bf: Bootstrap starting.
I20260807 08:43:46.408562 29653 tablet_bootstrap.cc:654] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:46.409423 29653 log.cc:824] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:46.409744 29654 tablet_bootstrap.cc:654] T d28c742f775c4a59b0aed5a9ec32f821 P aa65df02f4cf4d54a9daedef1b9ac9bf: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:46.409950 29655 tablet_bootstrap.cc:492] T d28c742f775c4a59b0aed5a9ec32f821 P 43ea85f6ddd94c028a83e5a2ff522376: Bootstrap starting.
I20260807 08:43:46.411527 29653 tablet_bootstrap.cc:492] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3: No bootstrap required, opened a new log
I20260807 08:43:46.411748 29653 ts_tablet_manager.cc:1397] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 08:43:46.411993 29655 tablet_bootstrap.cc:654] T d28c742f775c4a59b0aed5a9ec32f821 P 43ea85f6ddd94c028a83e5a2ff522376: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:46.412844 29655 log.cc:824] T d28c742f775c4a59b0aed5a9ec32f821 P 43ea85f6ddd94c028a83e5a2ff522376: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:46.413991 29654 log.cc:824] T d28c742f775c4a59b0aed5a9ec32f821 P aa65df02f4cf4d54a9daedef1b9ac9bf: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:46.414706 29655 tablet_bootstrap.cc:492] T d28c742f775c4a59b0aed5a9ec32f821 P 43ea85f6ddd94c028a83e5a2ff522376: No bootstrap required, opened a new log
I20260807 08:43:46.414918 29655 ts_tablet_manager.cc:1397] T d28c742f775c4a59b0aed5a9ec32f821 P 43ea85f6ddd94c028a83e5a2ff522376: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260807 08:43:46.415957 29654 tablet_bootstrap.cc:492] T d28c742f775c4a59b0aed5a9ec32f821 P aa65df02f4cf4d54a9daedef1b9ac9bf: No bootstrap required, opened a new log
I20260807 08:43:46.416136 29654 ts_tablet_manager.cc:1397] T d28c742f775c4a59b0aed5a9ec32f821 P aa65df02f4cf4d54a9daedef1b9ac9bf: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.002s
I20260807 08:43:46.416049 29653 raft_consensus.cc:348] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ea85f6ddd94c028a83e5a2ff522376" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43381 } } peers { permanent_uuid: "aa65df02f4cf4d54a9daedef1b9ac9bf" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 41455 } } peers { permanent_uuid: "e3e59e3607ab4440a2e3411eefffbbd3" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 39311 } }
I20260807 08:43:46.416309 29653 raft_consensus.cc:374] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:46.416420 29653 raft_consensus.cc:729] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3e59e3607ab4440a2e3411eefffbbd3, State: Initialized, Role: FOLLOWER
I20260807 08:43:46.416937 29653 consensus_queue.cc:260] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ea85f6ddd94c028a83e5a2ff522376" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43381 } } peers { permanent_uuid: "aa65df02f4cf4d54a9daedef1b9ac9bf" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 41455 } } peers { permanent_uuid: "e3e59e3607ab4440a2e3411eefffbbd3" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 39311 } }
I20260807 08:43:46.417945 29653 ts_tablet_manager.cc:1428] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3: Time spent starting tablet: real 0.006s user 0.004s sys 0.004s
I20260807 08:43:46.418300 29635 heartbeater.cc:503] Master 127.8.208.254:45603 was elected leader, sending a full tablet report...
I20260807 08:43:46.418844 29655 raft_consensus.cc:348] T d28c742f775c4a59b0aed5a9ec32f821 P 43ea85f6ddd94c028a83e5a2ff522376 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ea85f6ddd94c028a83e5a2ff522376" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43381 } } peers { permanent_uuid: "aa65df02f4cf4d54a9daedef1b9ac9bf" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 41455 } } peers { permanent_uuid: "e3e59e3607ab4440a2e3411eefffbbd3" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 39311 } }
I20260807 08:43:46.419059 29655 raft_consensus.cc:374] T d28c742f775c4a59b0aed5a9ec32f821 P 43ea85f6ddd94c028a83e5a2ff522376 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:46.419122 29655 raft_consensus.cc:729] T d28c742f775c4a59b0aed5a9ec32f821 P 43ea85f6ddd94c028a83e5a2ff522376 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43ea85f6ddd94c028a83e5a2ff522376, State: Initialized, Role: FOLLOWER
I20260807 08:43:46.419518 29655 consensus_queue.cc:260] T d28c742f775c4a59b0aed5a9ec32f821 P 43ea85f6ddd94c028a83e5a2ff522376 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ea85f6ddd94c028a83e5a2ff522376" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43381 } } peers { permanent_uuid: "aa65df02f4cf4d54a9daedef1b9ac9bf" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 41455 } } peers { permanent_uuid: "e3e59e3607ab4440a2e3411eefffbbd3" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 39311 } }
I20260807 08:43:46.420145 29362 heartbeater.cc:503] Master 127.8.208.254:45603 was elected leader, sending a full tablet report...
I20260807 08:43:46.420540 29655 ts_tablet_manager.cc:1428] T d28c742f775c4a59b0aed5a9ec32f821 P 43ea85f6ddd94c028a83e5a2ff522376: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 08:43:46.419957 29654 raft_consensus.cc:348] T d28c742f775c4a59b0aed5a9ec32f821 P aa65df02f4cf4d54a9daedef1b9ac9bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ea85f6ddd94c028a83e5a2ff522376" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43381 } } peers { permanent_uuid: "aa65df02f4cf4d54a9daedef1b9ac9bf" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 41455 } } peers { permanent_uuid: "e3e59e3607ab4440a2e3411eefffbbd3" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 39311 } }
I20260807 08:43:46.421078 29654 raft_consensus.cc:374] T d28c742f775c4a59b0aed5a9ec32f821 P aa65df02f4cf4d54a9daedef1b9ac9bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:46.421150 29654 raft_consensus.cc:729] T d28c742f775c4a59b0aed5a9ec32f821 P aa65df02f4cf4d54a9daedef1b9ac9bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa65df02f4cf4d54a9daedef1b9ac9bf, State: Initialized, Role: FOLLOWER
I20260807 08:43:46.421545 29654 consensus_queue.cc:260] T d28c742f775c4a59b0aed5a9ec32f821 P aa65df02f4cf4d54a9daedef1b9ac9bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ea85f6ddd94c028a83e5a2ff522376" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43381 } } peers { permanent_uuid: "aa65df02f4cf4d54a9daedef1b9ac9bf" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 41455 } } peers { permanent_uuid: "e3e59e3607ab4440a2e3411eefffbbd3" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 39311 } }
I20260807 08:43:46.422158 29500 heartbeater.cc:503] Master 127.8.208.254:45603 was elected leader, sending a full tablet report...
I20260807 08:43:46.422986 29654 ts_tablet_manager.cc:1428] T d28c742f775c4a59b0aed5a9ec32f821 P aa65df02f4cf4d54a9daedef1b9ac9bf: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
W20260807 08:43:46.427168 29501 tablet.cc:2369] T d28c742f775c4a59b0aed5a9ec32f821 P aa65df02f4cf4d54a9daedef1b9ac9bf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 08:43:46.445704 29659 raft_consensus.cc:482] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:43:46.445891 29659 raft_consensus.cc:504] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ea85f6ddd94c028a83e5a2ff522376" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43381 } } peers { permanent_uuid: "aa65df02f4cf4d54a9daedef1b9ac9bf" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 41455 } } peers { permanent_uuid: "e3e59e3607ab4440a2e3411eefffbbd3" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 39311 } }
I20260807 08:43:46.446980 29659 leader_election.cc:288] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43ea85f6ddd94c028a83e5a2ff522376 (127.8.208.193:43381), aa65df02f4cf4d54a9daedef1b9ac9bf (127.8.208.194:41455)
I20260807 08:43:46.451110 29637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:46.447207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:43381 (local address 127.8.208.195:58787)
0807 08:43:46.447423 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:46.447439 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:46.447540 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:46.447854 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:46.447859 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:46.447877 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:46.447975 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:46.447980 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.449036 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.449038 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:46.450026 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:46.450036 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.450664 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.450668 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:46.450770 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:46.450791 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 08:43:46.450886 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 08:43:46.450955 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":26}
I20260807 08:43:46.451107 29648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:46.447416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:58787 (local address 127.8.208.193:43381)
0807 08:43:46.447587 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:46.447592 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:46.447626 (+ 34us) server_negotiation.cc:407] Connection header received
0807 08:43:46.447675 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:46.447677 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:46.447716 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:46.447829 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:46.448120 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.448934 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.450152 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.450540 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.450671 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:46.450719 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:46.450903 (+ 184us) server_negotiation.cc:299] Negotiation successful
0807 08:43:46.450973 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 08:43:46.451105 29652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:46.447326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:39115 (local address 127.8.208.194:41455)
0807 08:43:46.447450 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:46.447455 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:46.447782 (+ 327us) server_negotiation.cc:407] Connection header received
0807 08:43:46.447891 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:46.447894 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:46.447950 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:46.448010 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:46.448266 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.448993 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.450153 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.450540 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.450679 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:46.450724 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:46.450928 (+ 204us) server_negotiation.cc:299] Negotiation successful
0807 08:43:46.450988 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 08:43:46.451133 29662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:46.447239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:41455 (local address 127.8.208.195:39115)
0807 08:43:46.447680 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:46.447690 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:46.447778 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:46.448044 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:46.448050 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:46.448068 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:46.448166 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:46.448171 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.449088 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.449092 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:46.450027 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:46.450037 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.450686 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.450689 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:46.450796 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:46.450817 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 08:43:46.450911 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 08:43:46.450979 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"mutex_wait_us":42,"thread_start_us":121,"threads_started":1}
I20260807 08:43:46.451759 29313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d28c742f775c4a59b0aed5a9ec32f821" candidate_uuid: "e3e59e3607ab4440a2e3411eefffbbd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43ea85f6ddd94c028a83e5a2ff522376" is_pre_election: true
I20260807 08:43:46.452044 29451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d28c742f775c4a59b0aed5a9ec32f821" candidate_uuid: "e3e59e3607ab4440a2e3411eefffbbd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa65df02f4cf4d54a9daedef1b9ac9bf" is_pre_election: true
I20260807 08:43:46.452097 29313 raft_consensus.cc:2454] T d28c742f775c4a59b0aed5a9ec32f821 P 43ea85f6ddd94c028a83e5a2ff522376 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3e59e3607ab4440a2e3411eefffbbd3 in term 0.
I20260807 08:43:46.452308 29451 raft_consensus.cc:2454] T d28c742f775c4a59b0aed5a9ec32f821 P aa65df02f4cf4d54a9daedef1b9ac9bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3e59e3607ab4440a2e3411eefffbbd3 in term 0.
I20260807 08:43:46.452636 29521 leader_election.cc:302] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43ea85f6ddd94c028a83e5a2ff522376, e3e59e3607ab4440a2e3411eefffbbd3; no voters:
I20260807 08:43:46.452913 29659 raft_consensus.cc:2781] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:43:46.453006 29659 raft_consensus.cc:482] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:43:46.453064 29659 raft_consensus.cc:3037] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:46.454087 29659 raft_consensus.cc:504] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ea85f6ddd94c028a83e5a2ff522376" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43381 } } peers { permanent_uuid: "aa65df02f4cf4d54a9daedef1b9ac9bf" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 41455 } } peers { permanent_uuid: "e3e59e3607ab4440a2e3411eefffbbd3" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 39311 } }
I20260807 08:43:46.454452 29659 leader_election.cc:288] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3 [CANDIDATE]: Term 1 election: Requested vote from peers 43ea85f6ddd94c028a83e5a2ff522376 (127.8.208.193:43381), aa65df02f4cf4d54a9daedef1b9ac9bf (127.8.208.194:41455)
I20260807 08:43:46.454779 29313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d28c742f775c4a59b0aed5a9ec32f821" candidate_uuid: "e3e59e3607ab4440a2e3411eefffbbd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43ea85f6ddd94c028a83e5a2ff522376"
I20260807 08:43:46.454900 29451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d28c742f775c4a59b0aed5a9ec32f821" candidate_uuid: "e3e59e3607ab4440a2e3411eefffbbd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa65df02f4cf4d54a9daedef1b9ac9bf"
I20260807 08:43:46.454921 29313 raft_consensus.cc:3037] T d28c742f775c4a59b0aed5a9ec32f821 P 43ea85f6ddd94c028a83e5a2ff522376 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:46.455039 29451 raft_consensus.cc:3037] T d28c742f775c4a59b0aed5a9ec32f821 P aa65df02f4cf4d54a9daedef1b9ac9bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:46.456013 29313 raft_consensus.cc:2454] T d28c742f775c4a59b0aed5a9ec32f821 P 43ea85f6ddd94c028a83e5a2ff522376 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3e59e3607ab4440a2e3411eefffbbd3 in term 1.
I20260807 08:43:46.456017 29451 raft_consensus.cc:2454] T d28c742f775c4a59b0aed5a9ec32f821 P aa65df02f4cf4d54a9daedef1b9ac9bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3e59e3607ab4440a2e3411eefffbbd3 in term 1.
I20260807 08:43:46.456306 29519 leader_election.cc:302] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa65df02f4cf4d54a9daedef1b9ac9bf, e3e59e3607ab4440a2e3411eefffbbd3; no voters:
I20260807 08:43:46.456467 29659 raft_consensus.cc:2781] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:43:46.456715 29659 raft_consensus.cc:686] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3 [term 1 LEADER]: Becoming Leader. State: Replica: e3e59e3607ab4440a2e3411eefffbbd3, State: Running, Role: LEADER
I20260807 08:43:46.457031 29659 consensus_queue.cc:237] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ea85f6ddd94c028a83e5a2ff522376" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43381 } } peers { permanent_uuid: "aa65df02f4cf4d54a9daedef1b9ac9bf" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 41455 } } peers { permanent_uuid: "e3e59e3607ab4440a2e3411eefffbbd3" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 39311 } }
I20260807 08:43:46.460079 29168 catalog_manager.cc:5495] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3e59e3607ab4440a2e3411eefffbbd3 (127.8.208.195). New cstate: current_term: 1 leader_uuid: "e3e59e3607ab4440a2e3411eefffbbd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ea85f6ddd94c028a83e5a2ff522376" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa65df02f4cf4d54a9daedef1b9ac9bf" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 41455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3e59e3607ab4440a2e3411eefffbbd3" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 39311 } health_report { overall_health: HEALTHY } } }
I20260807 08:43:46.472103 29651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:46.468857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59716 (local address 127.8.208.195:39311)
0807 08:43:46.468962 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:46.468966 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:46.468977 (+ 11us) server_negotiation.cc:407] Connection header received
0807 08:43:46.469025 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:46.469026 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:46.469070 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:46.469169 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:43:46.469362 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.469944 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.470814 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:46.470995 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:46.471067 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:46.471305 (+ 238us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:43:46.471670 (+ 365us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:43:46.471815 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:46.471962 (+ 147us) server_negotiation.cc:299] Negotiation successful
0807 08:43:46.471988 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 08:43:46.477267 29451 raft_consensus.cc:1261] T d28c742f775c4a59b0aed5a9ec32f821 P aa65df02f4cf4d54a9daedef1b9ac9bf [term 1 FOLLOWER]: Refusing update from remote peer e3e59e3607ab4440a2e3411eefffbbd3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:43:46.477313 29313 raft_consensus.cc:1261] T d28c742f775c4a59b0aed5a9ec32f821 P 43ea85f6ddd94c028a83e5a2ff522376 [term 1 FOLLOWER]: Refusing update from remote peer e3e59e3607ab4440a2e3411eefffbbd3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:43:46.478018 29663 consensus_queue.cc:1035] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43ea85f6ddd94c028a83e5a2ff522376" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 43381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:43:46.478189 29659 consensus_queue.cc:1035] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa65df02f4cf4d54a9daedef1b9ac9bf" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 41455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:43:46.485598 29667 mvcc.cc:205] Tried to move back new op lower bound from 7315833759645085696 to 7315833759570513920. Current Snapshot: MvccSnapshot[applied={T|T < 7315833759645085696}]
I20260807 08:43:46.492937 29169 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:43:46.493062 29169 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:43:46.495427 29169 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9a6854a2b05144ac9d5244785df6390a: Sending DeleteTablet for 3 replicas of tablet d28c742f775c4a59b0aed5a9ec32f821
I20260807 08:43:46.496209 29430 tablet_service.cc:1514] Processing DeleteTablet for tablet d28c742f775c4a59b0aed5a9ec32f821 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:43:46 UTC) from {username='slave'} at 127.0.0.1:46252
I20260807 08:43:46.496695 29676 tablet_replica.cc:330] T d28c742f775c4a59b0aed5a9ec32f821 P aa65df02f4cf4d54a9daedef1b9ac9bf: stopping tablet replica
I20260807 08:43:46.496793 29292 tablet_service.cc:1514] Processing DeleteTablet for tablet d28c742f775c4a59b0aed5a9ec32f821 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:43:46 UTC) from {username='slave'} at 127.0.0.1:60734
I20260807 08:43:46.497100 29676 raft_consensus.cc:2229] T d28c742f775c4a59b0aed5a9ec32f821 P aa65df02f4cf4d54a9daedef1b9ac9bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:43:46.497231 29567 tablet_service.cc:1514] Processing DeleteTablet for tablet d28c742f775c4a59b0aed5a9ec32f821 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:43:46 UTC) from {username='slave'} at 127.0.0.1:59702
I20260807 08:43:46.497321 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 29230
I20260807 08:43:46.498062 29676 raft_consensus.cc:2258] T d28c742f775c4a59b0aed5a9ec32f821 P aa65df02f4cf4d54a9daedef1b9ac9bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:43:46.498083 29678 tablet_replica.cc:330] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3: stopping tablet replica
I20260807 08:43:46.498353 29678 raft_consensus.cc:2229] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3 [term 1 LEADER]: Raft consensus shutting down.
I20260807 08:43:46.498697 29678 raft_consensus.cc:2258] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:43:46.499953 29676 ts_tablet_manager.cc:1905] T d28c742f775c4a59b0aed5a9ec32f821 P aa65df02f4cf4d54a9daedef1b9ac9bf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:43:46.500191 29678 ts_tablet_manager.cc:1905] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:43:46.502705 29676 ts_tablet_manager.cc:1918] T d28c742f775c4a59b0aed5a9ec32f821 P aa65df02f4cf4d54a9daedef1b9ac9bf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:43:46.502861 29676 log.cc:1196] T d28c742f775c4a59b0aed5a9ec32f821 P aa65df02f4cf4d54a9daedef1b9ac9bf: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-1/wal/wals/d28c742f775c4a59b0aed5a9ec32f821
I20260807 08:43:46.503216 29676 ts_tablet_manager.cc:1939] T d28c742f775c4a59b0aed5a9ec32f821 P aa65df02f4cf4d54a9daedef1b9ac9bf: Deleting consensus metadata
I20260807 08:43:46.503326 29678 ts_tablet_manager.cc:1918] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:43:46.503444 29678 log.cc:1196] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/d28c742f775c4a59b0aed5a9ec32f821
I20260807 08:43:46.503799 29678 ts_tablet_manager.cc:1939] T d28c742f775c4a59b0aed5a9ec32f821 P e3e59e3607ab4440a2e3411eefffbbd3: Deleting consensus metadata
I20260807 08:43:46.504544 29154 catalog_manager.cc:4841] TS aa65df02f4cf4d54a9daedef1b9ac9bf (127.8.208.194:41455): tablet d28c742f775c4a59b0aed5a9ec32f821 (table test-table [id=421f6dd29d814792aa28913efb248290]) successfully deleted
I20260807 08:43:46.504835 29154 catalog_manager.cc:4841] TS e3e59e3607ab4440a2e3411eefffbbd3 (127.8.208.195:39311): tablet d28c742f775c4a59b0aed5a9ec32f821 (table test-table [id=421f6dd29d814792aa28913efb248290]) successfully deleted
W20260807 08:43:46.508803 29156 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.208.193:43381 (error 108)
I20260807 08:43:46.509594 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 29365
I20260807 08:43:46.509773 29649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:46.509485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:43381 (local address 127.0.0.1:60746)
0807 08:43:46.509642 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:46.509702 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.193:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
W20260807 08:43:46.509913 29156 catalog_manager.cc:4584] TS 43ea85f6ddd94c028a83e5a2ff522376 (127.8.208.193:43381): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d28c742f775c4a59b0aed5a9ec32f821: Network error: Client connection negotiation failed: client connection to 127.8.208.193:43381: connect: Connection refused (error 111)
I20260807 08:43:46.517251 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 29503
I20260807 08:43:46.523484 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 29138
2026-08-07T08:43:46Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (935 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:43:46 dist-test-slave-6nmv krb5kdc[29682](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:43:46 dist-test-slave-6nmv krb5kdc[29682](info): set up 2 sockets
Aug 07 08:43:46 dist-test-slave-6nmv krb5kdc[29682](info): commencing operation
krb5kdc: starting...
W20260807 08:43:47.566581 9027 mini_kdc.cc:121] Time spent starting KDC: real 1.020s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:43:47 dist-test-slave-6nmv krb5kdc[29682](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092227, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:43:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:43:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:43:47.681115 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:35689
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:34737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:35689
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:43:47.785202 29696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:47.785517 29696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:47.785621 29696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:47.789532 29696 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:43:47.789636 29696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:47.789680 29696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:47.789774 29696 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:43:47.789831 29696 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:43:47.794960 29696 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:34737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:35689
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:35689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29696
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:47.795953 29696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:47.796947 29696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:47.805452 29704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:47.805495 29702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:47.805505 29701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:47.805675 29696 server_base.cc:1034] running on GCE node
I20260807 08:43:47.806389 29696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:47.807395 29696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:47.808584 29696 hybrid_clock.cc:648] HybridClock initialized: now 1786092227808551 us; error 41 us; skew 500 ppm
Aug 07 08:43:47 dist-test-slave-6nmv krb5kdc[29682](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092227, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:47.811236 29696 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:43:47.812026 29696 webserver.cc:460] Webserver started at http://127.8.208.254:41557/ using document root <none> and password file <none>
I20260807 08:43:47.812493 29696 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:47.812548 29696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:47.812711 29696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:47.814651 29696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "62fa4187f4a94499aac49b82fb8347eb"
format_stamp: "Formatted at 2026-08-07 08:43:47 on dist-test-slave-6nmv"
server_key: "6d03ad4521e7539b8fb00a993b4cfaaf"
server_key_iv: "9b815e9d8d91006e3a2bfc7286bd56ac"
server_key_version: "encryptionkey@0"
I20260807 08:43:47.815145 29696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "62fa4187f4a94499aac49b82fb8347eb"
format_stamp: "Formatted at 2026-08-07 08:43:47 on dist-test-slave-6nmv"
server_key: "6d03ad4521e7539b8fb00a993b4cfaaf"
server_key_iv: "9b815e9d8d91006e3a2bfc7286bd56ac"
server_key_version: "encryptionkey@0"
I20260807 08:43:47.818821 29696 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 08:43:47.820956 29711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:47.822130 29696 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:43:47.822232 29696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "62fa4187f4a94499aac49b82fb8347eb"
format_stamp: "Formatted at 2026-08-07 08:43:47 on dist-test-slave-6nmv"
server_key: "6d03ad4521e7539b8fb00a993b4cfaaf"
server_key_iv: "9b815e9d8d91006e3a2bfc7286bd56ac"
server_key_version: "encryptionkey@0"
I20260807 08:43:47.822309 29696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:47.835186 29696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:47.838403 29696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:47.838550 29696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:47.845300 29696 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:35689
I20260807 08:43:47.845323 29764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:35689 every 8 connection(s)
I20260807 08:43:47.846298 29696 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:43:47.849014 29765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:47.854242 29765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62fa4187f4a94499aac49b82fb8347eb: Bootstrap starting.
I20260807 08:43:47.856503 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 29696
I20260807 08:43:47.856536 29765 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62fa4187f4a94499aac49b82fb8347eb: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:47.856683 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:43:47.856956 9027 external_mini_cluster.cc:1428] Setting key 4729876f0bcd79b1a59a20b31166d085
I20260807 08:43:47.857326 29765 log.cc:824] T 00000000000000000000000000000000 P 62fa4187f4a94499aac49b82fb8347eb: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:47.859175 29765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62fa4187f4a94499aac49b82fb8347eb: No bootstrap required, opened a new log
I20260807 08:43:47.862433 29765 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62fa4187f4a94499aac49b82fb8347eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62fa4187f4a94499aac49b82fb8347eb" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35689 } }
I20260807 08:43:47.862639 29765 raft_consensus.cc:374] T 00000000000000000000000000000000 P 62fa4187f4a94499aac49b82fb8347eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:47.862707 29765 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62fa4187f4a94499aac49b82fb8347eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62fa4187f4a94499aac49b82fb8347eb, State: Initialized, Role: FOLLOWER
I20260807 08:43:47.863178 29765 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62fa4187f4a94499aac49b82fb8347eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62fa4187f4a94499aac49b82fb8347eb" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35689 } }
I20260807 08:43:47.863340 29765 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62fa4187f4a94499aac49b82fb8347eb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:43:47.863739 29765 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62fa4187f4a94499aac49b82fb8347eb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:43:47.863850 29765 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62fa4187f4a94499aac49b82fb8347eb [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:47.864941 29765 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62fa4187f4a94499aac49b82fb8347eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62fa4187f4a94499aac49b82fb8347eb" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35689 } }
Aug 07 08:43:47 dist-test-slave-6nmv krb5kdc[29682](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092227, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:43:47.865295 29765 leader_election.cc:302] T 00000000000000000000000000000000 P 62fa4187f4a94499aac49b82fb8347eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62fa4187f4a94499aac49b82fb8347eb; no voters:
I20260807 08:43:47.865641 29765 leader_election.cc:288] T 00000000000000000000000000000000 P 62fa4187f4a94499aac49b82fb8347eb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:43:47.865752 29770 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62fa4187f4a94499aac49b82fb8347eb [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:43:47.866011 29770 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62fa4187f4a94499aac49b82fb8347eb [term 1 LEADER]: Becoming Leader. State: Replica: 62fa4187f4a94499aac49b82fb8347eb, State: Running, Role: LEADER
I20260807 08:43:47.866334 29770 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62fa4187f4a94499aac49b82fb8347eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62fa4187f4a94499aac49b82fb8347eb" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35689 } }
I20260807 08:43:47.866976 29765 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62fa4187f4a94499aac49b82fb8347eb [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:43:47.867579 29770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62fa4187f4a94499aac49b82fb8347eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62fa4187f4a94499aac49b82fb8347eb. Latest consensus state: current_term: 1 leader_uuid: "62fa4187f4a94499aac49b82fb8347eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62fa4187f4a94499aac49b82fb8347eb" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35689 } } }
I20260807 08:43:47.867690 29770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62fa4187f4a94499aac49b82fb8347eb [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:47.868839 29772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62fa4187f4a94499aac49b82fb8347eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "62fa4187f4a94499aac49b82fb8347eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62fa4187f4a94499aac49b82fb8347eb" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 35689 } } }
I20260807 08:43:47.869024 29772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62fa4187f4a94499aac49b82fb8347eb [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:47.871368 29769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:47.858037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50016 (local address 127.8.208.254:35689)
0807 08:43:47.858449 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:47.858472 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:47.858503 (+ 31us) server_negotiation.cc:407] Connection header received
0807 08:43:47.859055 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:47.859068 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:47.859405 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:47.859732 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:47.860550 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:47.861477 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:47.862345 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:47.862889 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:47.863072 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:47.865992 (+ 2920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:47.866001 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:47.866016 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:47.866050 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:47.868149 (+ 2099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:47.868683 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:47.868690 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:47.868698 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:47.868855 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:47.869210 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:47.869215 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:47.869217 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:47.869695 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:47.869938 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:47.870194 (+ 256us) server_negotiation.cc:299] Negotiation successful
0807 08:43:47.870486 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":147,"threads_started":1}
W20260807 08:43:47.871956 29787 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 62fa4187f4a94499aac49b82fb8347eb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:43:47.872042 29787 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:43:47.872128 29776 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:43:47.872799 29776 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:43:47.877149 29776 catalog_manager.cc:1347] Generated new cluster ID: b6450026620548539597bc7bf8861a3d
I20260807 08:43:47.877205 29776 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:43:47.886260 29776 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:43:47.887041 29776 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:43:47.895598 29776 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 62fa4187f4a94499aac49b82fb8347eb: Generated new TSK 0
I20260807 08:43:47.896237 29776 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.208.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
Entry for principal kudu/127.8.208.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab.
I20260807 08:43:47.926750 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:35689
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:34737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:43:48.029462 29793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:48.029672 29793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:48.029708 29793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:48.033347 29793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:48.033396 29793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:48.033484 29793 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:43:48.038216 29793 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:34737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.193.keytab
--principal=kudu/127.8.208.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:35689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:48.039079 29793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:48.039959 29793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:48.048858 29798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:48.048898 29799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:48.049098 29793 server_base.cc:1034] running on GCE node
W20260807 08:43:48.048897 29801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:48.049460 29793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:48.050053 29793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:48.051211 29793 hybrid_clock.cc:648] HybridClock initialized: now 1786092228051195 us; error 27 us; skew 500 ppm
Aug 07 08:43:48 dist-test-slave-6nmv krb5kdc[29682](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092228, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:48.053799 29793 init.cc:377] Logged in from keytab as kudu/127.8.208.193@KRBTEST.COM (short username kudu)
I20260807 08:43:48.054560 29793 webserver.cc:460] Webserver started at http://127.8.208.193:41665/ using document root <none> and password file <none>
I20260807 08:43:48.055003 29793 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:48.055058 29793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:48.055200 29793 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:48.056977 29793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "c8c831bb26084f6796cc7b0d78aab6e7"
format_stamp: "Formatted at 2026-08-07 08:43:48 on dist-test-slave-6nmv"
server_key: "61646a549bfad0aabe936cf6c58bbe90"
server_key_iv: "e76f9d57bd61045396dc641c39380cc5"
server_key_version: "encryptionkey@0"
I20260807 08:43:48.057466 29793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "c8c831bb26084f6796cc7b0d78aab6e7"
format_stamp: "Formatted at 2026-08-07 08:43:48 on dist-test-slave-6nmv"
server_key: "61646a549bfad0aabe936cf6c58bbe90"
server_key_iv: "e76f9d57bd61045396dc641c39380cc5"
server_key_version: "encryptionkey@0"
I20260807 08:43:48.060719 29793 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.001s
I20260807 08:43:48.062809 29808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:48.063848 29793 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 08:43:48.063954 29793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "c8c831bb26084f6796cc7b0d78aab6e7"
format_stamp: "Formatted at 2026-08-07 08:43:48 on dist-test-slave-6nmv"
server_key: "61646a549bfad0aabe936cf6c58bbe90"
server_key_iv: "e76f9d57bd61045396dc641c39380cc5"
server_key_version: "encryptionkey@0"
I20260807 08:43:48.064044 29793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:48.085794 29793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:48.088277 29793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:48.088462 29793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:48.088991 29793 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:43:48.089663 29793 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:43:48.089749 29793 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:48.089790 29793 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:43:48.089836 29793 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:48.098171 29793 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:35013
I20260807 08:43:48.098199 29925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:35013 every 8 connection(s)
I20260807 08:43:48.098912 29793 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:43:48.102159 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 29793
I20260807 08:43:48.102314 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
I20260807 08:43:48.102643 9027 external_mini_cluster.cc:1428] Setting key 4b4e407eb1d0fa8094b946dcefa194ba
Aug 07 08:43:48 dist-test-slave-6nmv krb5kdc[29682](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092228, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.193@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.208.194@KRBTEST.COM; defaulting to no policy
I20260807 08:43:48.112371 29769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:48.100499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:44711 (local address 127.8.208.254:35689)
0807 08:43:48.100637 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:48.100642 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:48.101407 (+ 765us) server_negotiation.cc:407] Connection header received
0807 08:43:48.102492 (+ 1085us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:48.102496 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:48.102554 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:48.102647 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:48.103839 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.104592 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.105660 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.106084 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.106169 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:48.108720 (+ 2551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:48.108723 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:48.108725 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:48.108746 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:48.110351 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:48.110869 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:48.110873 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:48.110875 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:48.110960 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:48.111289 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:48.111294 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:48.111295 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:48.111478 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:48.111641 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:48.112089 (+ 448us) server_negotiation.cc:299] Negotiation successful
0807 08:43:48.112208 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 08:43:48.113036 29928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:48.100797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35689 (local address 127.8.208.193:44711)
0807 08:43:48.101246 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:48.101302 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:48.102230 (+ 928us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:48.102819 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:48.102824 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:48.103248 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:43:48.103695 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:48.103708 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.104722 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.104725 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:48.105503 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:48.105512 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.106244 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.106251 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:48.106470 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:48.107069 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:43:48.107100 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:43:48.108544 (+ 1444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:43:48.110493 (+ 1949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:48.110498 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:48.110510 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:48.110763 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:48.111051 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:48.111056 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:48.111057 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:48.111193 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:48.111643 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:43:48.111650 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:43:48.111865 (+ 215us) client_negotiation.cc:769] Sending connection context
0807 08:43:48.112039 (+ 174us) client_negotiation.cc:240] Negotiation successful
0807 08:43:48.112318 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":126,"threads_started":1}
I20260807 08:43:48.114166 29926 heartbeater.cc:347] Connected to a master server at 127.8.208.254:35689
I20260807 08:43:48.114347 29926 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.194@KRBTEST.COM" created.
I20260807 08:43:48.114832 29926 heartbeater.cc:511] Master 127.8.208.254:35689 requested a full tablet report, sending...
I20260807 08:43:48.116284 29729 ts_manager.cc:194] Registered new tserver with Master: c8c831bb26084f6796cc7b0d78aab6e7 (127.8.208.193:35013)
I20260807 08:43:48.117789 29729 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.193@KRBTEST.COM'} at 127.8.208.193:44711
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
Entry for principal kudu/127.8.208.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab.
I20260807 08:43:48.128625 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:35689
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:34737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:43:48.231209 29931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:48.231411 29931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:48.231446 29931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:48.235078 29931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:48.235121 29931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:48.235179 29931 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:43:48.239673 29931 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:34737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.194.keytab
--principal=kudu/127.8.208.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:35689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29931
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:48.240422 29931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:48.241192 29931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:48.249706 29936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:48.249711 29939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:48.249711 29937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:48.250031 29931 server_base.cc:1034] running on GCE node
I20260807 08:43:48.250402 29931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:48.250929 29931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:48.252139 29931 hybrid_clock.cc:648] HybridClock initialized: now 1786092228252114 us; error 36 us; skew 500 ppm
Aug 07 08:43:48 dist-test-slave-6nmv krb5kdc[29682](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092228, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:48.254830 29931 init.cc:377] Logged in from keytab as kudu/127.8.208.194@KRBTEST.COM (short username kudu)
I20260807 08:43:48.255707 29931 webserver.cc:460] Webserver started at http://127.8.208.194:44633/ using document root <none> and password file <none>
I20260807 08:43:48.256247 29931 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:48.256343 29931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:48.256570 29931 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:48.258455 29931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "19a1a91d76954fd8aa2c5ca01f76c04e"
format_stamp: "Formatted at 2026-08-07 08:43:48 on dist-test-slave-6nmv"
server_key: "e411481a2c95404b03a3063588cc69e4"
server_key_iv: "654469875ed560bc6517f38e5e1a17cd"
server_key_version: "encryptionkey@0"
I20260807 08:43:48.259052 29931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "19a1a91d76954fd8aa2c5ca01f76c04e"
format_stamp: "Formatted at 2026-08-07 08:43:48 on dist-test-slave-6nmv"
server_key: "e411481a2c95404b03a3063588cc69e4"
server_key_iv: "654469875ed560bc6517f38e5e1a17cd"
server_key_version: "encryptionkey@0"
I20260807 08:43:48.262405 29931 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 08:43:48.264799 29946 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:48.265991 29931 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:43:48.266121 29931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "19a1a91d76954fd8aa2c5ca01f76c04e"
format_stamp: "Formatted at 2026-08-07 08:43:48 on dist-test-slave-6nmv"
server_key: "e411481a2c95404b03a3063588cc69e4"
server_key_iv: "654469875ed560bc6517f38e5e1a17cd"
server_key_version: "encryptionkey@0"
I20260807 08:43:48.266230 29931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:48.277052 29931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:48.279666 29931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:48.279847 29931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:48.280381 29931 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:43:48.281071 29931 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:43:48.281143 29931 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:48.281206 29931 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:43:48.281246 29931 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:48.289368 29931 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:39217
I20260807 08:43:48.289409 30061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:39217 every 8 connection(s)
I20260807 08:43:48.290154 29931 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:43:48.293893 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 29931
I20260807 08:43:48.294049 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:43:48.294313 9027 external_mini_cluster.cc:1428] Setting key ce3b623006bf6a6129892c1fa2e643ce
Aug 07 08:43:48 dist-test-slave-6nmv krb5kdc[29682](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092228, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.194@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:43:48.302721 29769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:48.291783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:40591 (local address 127.8.208.254:35689)
0807 08:43:48.291930 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:48.291935 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:48.292648 (+ 713us) server_negotiation.cc:407] Connection header received
0807 08:43:48.293457 (+ 809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:48.293460 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:48.293516 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:48.293588 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:48.294793 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.295458 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.296578 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.296833 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.296933 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:48.299421 (+ 2488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:48.299425 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:48.299427 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:48.299457 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:48.300841 (+ 1384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:48.301308 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:48.301312 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:48.301313 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:48.301389 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:48.301705 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:48.301708 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:48.301710 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:48.301935 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:48.302030 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:48.302456 (+ 426us) server_negotiation.cc:299] Negotiation successful
0807 08:43:48.302568 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 08:43:48.303370 30064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:48.292108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35689 (local address 127.8.208.194:40591)
0807 08:43:48.292515 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:48.292552 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:48.293272 (+ 720us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:48.293744 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:48.293749 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:48.294173 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:43:48.294648 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:48.294661 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.295605 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.295611 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:48.296450 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:48.296459 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.296967 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.296971 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:48.297124 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:48.297663 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:43:48.297686 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:43:48.299266 (+ 1580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:43:48.300964 (+ 1698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:48.300969 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:48.300981 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:48.301210 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:48.301479 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:48.301482 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:48.301484 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:48.301606 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:48.302029 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:43:48.302034 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:43:48.302236 (+ 202us) client_negotiation.cc:769] Sending connection context
0807 08:43:48.302408 (+ 172us) client_negotiation.cc:240] Negotiation successful
0807 08:43:48.302668 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":107,"threads_started":1}
WARNING: no policy specified for kudu/127.8.208.195@KRBTEST.COM; defaulting to no policy
I20260807 08:43:48.304437 30062 heartbeater.cc:347] Connected to a master server at 127.8.208.254:35689
I20260807 08:43:48.304623 30062 heartbeater.cc:464] Registering TS with master...
I20260807 08:43:48.305107 30062 heartbeater.cc:511] Master 127.8.208.254:35689 requested a full tablet report, sending...
I20260807 08:43:48.306061 29729 ts_manager.cc:194] Registered new tserver with Master: 19a1a91d76954fd8aa2c5ca01f76c04e (127.8.208.194:39217)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.195@KRBTEST.COM" created.
I20260807 08:43:48.306565 29729 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.194@KRBTEST.COM'} at 127.8.208.194:40591
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
Entry for principal kudu/127.8.208.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab.
I20260807 08:43:48.320307 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:35689
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:34737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:43:48.423413 30067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:48.423619 30067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:48.423655 30067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:48.427611 30067 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:48.427659 30067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:48.427707 30067 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:43:48.432236 30067 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:34737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.195.keytab
--principal=kudu/127.8.208.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:35689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30067
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:48.433024 30067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:48.433840 30067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:48.442366 30072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:48.442360 30075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:48.442413 30073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:48.442667 30067 server_base.cc:1034] running on GCE node
I20260807 08:43:48.443060 30067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:48.443645 30067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:48.444814 30067 hybrid_clock.cc:648] HybridClock initialized: now 1786092228444797 us; error 27 us; skew 500 ppm
Aug 07 08:43:48 dist-test-slave-6nmv krb5kdc[29682](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092228, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:48.447752 30067 init.cc:377] Logged in from keytab as kudu/127.8.208.195@KRBTEST.COM (short username kudu)
I20260807 08:43:48.448550 30067 webserver.cc:460] Webserver started at http://127.8.208.195:38933/ using document root <none> and password file <none>
I20260807 08:43:48.449052 30067 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:48.449148 30067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:48.449359 30067 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:48.451180 30067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "ea078a120fdd4884bfd05d6ee61d95bc"
format_stamp: "Formatted at 2026-08-07 08:43:48 on dist-test-slave-6nmv"
server_key: "8d043eaa5f5bdef7c6e481ec19449aa6"
server_key_iv: "0ca71074a6c3eea5ec79cb0f26ef65ae"
server_key_version: "encryptionkey@0"
I20260807 08:43:48.451735 30067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "ea078a120fdd4884bfd05d6ee61d95bc"
format_stamp: "Formatted at 2026-08-07 08:43:48 on dist-test-slave-6nmv"
server_key: "8d043eaa5f5bdef7c6e481ec19449aa6"
server_key_iv: "0ca71074a6c3eea5ec79cb0f26ef65ae"
server_key_version: "encryptionkey@0"
I20260807 08:43:48.455241 30067 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 08:43:48.457506 30082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:48.458703 30067 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:43:48.458841 30067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "ea078a120fdd4884bfd05d6ee61d95bc"
format_stamp: "Formatted at 2026-08-07 08:43:48 on dist-test-slave-6nmv"
server_key: "8d043eaa5f5bdef7c6e481ec19449aa6"
server_key_iv: "0ca71074a6c3eea5ec79cb0f26ef65ae"
server_key_version: "encryptionkey@0"
I20260807 08:43:48.458945 30067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:48.476727 30067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:48.479393 30067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:48.479573 30067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:48.480109 30067 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:43:48.480862 30067 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:43:48.480931 30067 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:48.480994 30067 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:43:48.481045 30067 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:48.491935 30067 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:46255
I20260807 08:43:48.492055 30202 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:46255 every 8 connection(s)
I20260807 08:43:48.493074 30067 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:43:48.495452 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 30067
I20260807 08:43:48.495605 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:43:48.495954 9027 external_mini_cluster.cc:1428] Setting key a72e14807571f4ddecceabc6336eb08c
Aug 07 08:43:48 dist-test-slave-6nmv krb5kdc[29682](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092228, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.195@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:43:48.505627 29769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:48.494930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:40797 (local address 127.8.208.254:35689)
0807 08:43:48.495048 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:48.495054 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:48.496253 (+ 1199us) server_negotiation.cc:407] Connection header received
0807 08:43:48.497141 (+ 888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:48.497143 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:48.497203 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:48.497279 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:48.498452 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.498964 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.499970 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.500162 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.500231 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:48.502431 (+ 2200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:48.502434 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:48.502437 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:48.502468 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:48.503612 (+ 1144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:48.504125 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:48.504129 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:48.504131 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:48.504213 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:48.504553 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:48.504556 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:48.504558 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:48.504744 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:48.504863 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:48.505309 (+ 446us) server_negotiation.cc:299] Negotiation successful
0807 08:43:48.505423 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 08:43:48.506374 30205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:48.495276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:35689 (local address 127.8.208.195:40797)
0807 08:43:48.496065 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:48.496120 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:48.496911 (+ 791us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:48.497461 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:48.497467 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:48.497765 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:43:48.498307 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:48.498319 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.499064 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.499066 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:48.499875 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:48.499883 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.500272 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.500274 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:48.500394 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:48.500908 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:43:48.500923 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:43:48.502279 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:43:48.503734 (+ 1455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:48.503740 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:48.503752 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:48.504002 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:48.504315 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:43:48.504318 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:43:48.504320 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:43:48.504453 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:43:48.504860 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:43:48.504866 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:43:48.505091 (+ 225us) client_negotiation.cc:769] Sending connection context
0807 08:43:48.505268 (+ 177us) client_negotiation.cc:240] Negotiation successful
0807 08:43:48.505575 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":112,"threads_started":1}
I20260807 08:43:48.507332 30203 heartbeater.cc:347] Connected to a master server at 127.8.208.254:35689
I20260807 08:43:48.507548 30203 heartbeater.cc:464] Registering TS with master...
I20260807 08:43:48.507984 30203 heartbeater.cc:511] Master 127.8.208.254:35689 requested a full tablet report, sending...
I20260807 08:43:48.508980 29729 ts_manager.cc:194] Registered new tserver with Master: ea078a120fdd4884bfd05d6ee61d95bc (127.8.208.195:46255)
I20260807 08:43:48.509545 29729 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.208.195@KRBTEST.COM'} at 127.8.208.195:40797
I20260807 08:43:48.509635 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 08:43:48.517799 29769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:48.511560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50022 (local address 127.8.208.254:35689)
0807 08:43:48.511704 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:48.511708 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:48.511851 (+ 143us) server_negotiation.cc:407] Connection header received
0807 08:43:48.511935 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:48.511937 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:48.511970 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:48.512031 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:48.512613 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.513098 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.513882 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.514078 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.514155 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:48.515316 (+ 1161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:48.515319 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:48.515320 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:48.515340 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:48.516471 (+ 1131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:48.516835 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:48.516837 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:48.516838 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:48.516906 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:48.517120 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:48.517122 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:48.517123 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:48.517302 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:48.517391 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:48.517532 (+ 141us) server_negotiation.cc:299] Negotiation successful
0807 08:43:48.517613 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 08:43:48.520350 29729 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50022:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 08:43:48.523195 29729 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:43:48.536826 30215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:48.531348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:46255 (local address 127.0.0.1:46206)
0807 08:43:48.532442 (+ 1094us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:48.532453 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:48.532559 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:48.533043 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:48.533046 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:48.533069 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:48.533172 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:48.533178 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.534158 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.534161 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:48.535439 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:48.535447 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.536223 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.536226 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:48.536395 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:48.536441 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 08:43:48.536560 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 08:43:48.536682 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1038,"mutex_wait_us":30,"thread_start_us":112,"threads_started":1}
I20260807 08:43:48.536942 30220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:48.531792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46206 (local address 127.8.208.195:46255)
0807 08:43:48.532188 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:48.532202 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:48.532535 (+ 333us) server_negotiation.cc:407] Connection header received
0807 08:43:48.532661 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:48.532667 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:48.532836 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:48.532999 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:48.533287 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.534037 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.535571 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.536099 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.536219 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:48.536352 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:48.536713 (+ 361us) server_negotiation.cc:299] Negotiation successful
0807 08:43:48.536806 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":120,"threads_started":1}
I20260807 08:43:48.537073 30216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:48.530918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:35013 (local address 127.0.0.1:52094)
0807 08:43:48.531533 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:48.531577 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:48.531731 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:48.532853 (+ 1122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:48.532860 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:48.532881 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:48.533056 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:48.533062 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.534498 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.534504 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:48.535467 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:48.535476 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.536573 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.536576 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:48.536756 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:48.536776 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 08:43:48.536868 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 08:43:48.536950 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"mutex_wait_us":38,"thread_start_us":65,"threads_started":1}
I20260807 08:43:48.537490 30217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:48.531081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52094 (local address 127.8.208.193:35013)
0807 08:43:48.532411 (+ 1330us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:48.532423 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:48.532442 (+ 19us) server_negotiation.cc:407] Connection header received
0807 08:43:48.532503 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:48.532507 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:48.532682 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:48.532851 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:48.533188 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.534315 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.535616 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.536453 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.536555 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:48.536707 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:48.537265 (+ 558us) server_negotiation.cc:299] Negotiation successful
0807 08:43:48.537367 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1209,"thread_start_us":110,"threads_started":1}
I20260807 08:43:48.539341 30218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:48.531091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:39217 (local address 127.0.0.1:60742)
0807 08:43:48.532180 (+ 1089us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:48.532194 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:48.532293 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:48.533174 (+ 881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:48.533176 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:48.533189 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:48.533273 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:48.533278 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.534579 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.534582 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:48.537929 (+ 3347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:48.537939 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.538950 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.538953 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:48.539039 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:48.539062 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 08:43:48.539168 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 08:43:48.539229 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"mutex_wait_us":68,"thread_start_us":88,"threads_started":1}
I20260807 08:43:48.539422 30219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:48.531641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60742 (local address 127.8.208.194:39217)
0807 08:43:48.532020 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:48.532029 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:48.532397 (+ 368us) server_negotiation.cc:407] Connection header received
0807 08:43:48.532486 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:48.532492 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:48.532682 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:48.532851 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:48.533400 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.534451 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.538063 (+ 3612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.538814 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.538929 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:48.539050 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:48.539198 (+ 148us) server_negotiation.cc:299] Negotiation successful
0807 08:43:48.539277 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":159,"threads_started":1}
I20260807 08:43:48.539916 30129 tablet_service.cc:1467] Processing CreateTablet for tablet 863d934a0f9f44b1bb8954f304fd0231 (DEFAULT_TABLE table=test-table [id=5cd1f9a6df9643eb863c6329c071deba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:43:48.540294 29858 tablet_service.cc:1467] Processing CreateTablet for tablet 863d934a0f9f44b1bb8954f304fd0231 (DEFAULT_TABLE table=test-table [id=5cd1f9a6df9643eb863c6329c071deba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:43:48.541018 30129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 863d934a0f9f44b1bb8954f304fd0231. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:48.541234 29858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 863d934a0f9f44b1bb8954f304fd0231. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:48.542034 29994 tablet_service.cc:1467] Processing CreateTablet for tablet 863d934a0f9f44b1bb8954f304fd0231 (DEFAULT_TABLE table=test-table [id=5cd1f9a6df9643eb863c6329c071deba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:43:48.542891 29994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 863d934a0f9f44b1bb8954f304fd0231. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:48.547048 30221 tablet_bootstrap.cc:492] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7: Bootstrap starting.
I20260807 08:43:48.548343 30222 tablet_bootstrap.cc:492] T 863d934a0f9f44b1bb8954f304fd0231 P ea078a120fdd4884bfd05d6ee61d95bc: Bootstrap starting.
I20260807 08:43:48.549082 30223 tablet_bootstrap.cc:492] T 863d934a0f9f44b1bb8954f304fd0231 P 19a1a91d76954fd8aa2c5ca01f76c04e: Bootstrap starting.
I20260807 08:43:48.549510 30221 tablet_bootstrap.cc:654] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:48.550127 30222 tablet_bootstrap.cc:654] T 863d934a0f9f44b1bb8954f304fd0231 P ea078a120fdd4884bfd05d6ee61d95bc: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:48.550576 30221 log.cc:824] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:48.551119 30223 tablet_bootstrap.cc:654] T 863d934a0f9f44b1bb8954f304fd0231 P 19a1a91d76954fd8aa2c5ca01f76c04e: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:48.551195 30222 log.cc:824] T 863d934a0f9f44b1bb8954f304fd0231 P ea078a120fdd4884bfd05d6ee61d95bc: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:48.552260 30223 log.cc:824] T 863d934a0f9f44b1bb8954f304fd0231 P 19a1a91d76954fd8aa2c5ca01f76c04e: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:48.552654 30221 tablet_bootstrap.cc:492] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7: No bootstrap required, opened a new log
I20260807 08:43:48.552767 30222 tablet_bootstrap.cc:492] T 863d934a0f9f44b1bb8954f304fd0231 P ea078a120fdd4884bfd05d6ee61d95bc: No bootstrap required, opened a new log
I20260807 08:43:48.552838 30221 ts_tablet_manager.cc:1397] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 08:43:48.552970 30222 ts_tablet_manager.cc:1397] T 863d934a0f9f44b1bb8954f304fd0231 P ea078a120fdd4884bfd05d6ee61d95bc: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 08:43:48.554196 30223 tablet_bootstrap.cc:492] T 863d934a0f9f44b1bb8954f304fd0231 P 19a1a91d76954fd8aa2c5ca01f76c04e: No bootstrap required, opened a new log
I20260807 08:43:48.554368 30223 ts_tablet_manager.cc:1397] T 863d934a0f9f44b1bb8954f304fd0231 P 19a1a91d76954fd8aa2c5ca01f76c04e: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 08:43:48.555591 30222 raft_consensus.cc:348] T 863d934a0f9f44b1bb8954f304fd0231 P ea078a120fdd4884bfd05d6ee61d95bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c831bb26084f6796cc7b0d78aab6e7" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35013 } } peers { permanent_uuid: "19a1a91d76954fd8aa2c5ca01f76c04e" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39217 } } peers { permanent_uuid: "ea078a120fdd4884bfd05d6ee61d95bc" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 46255 } }
I20260807 08:43:48.555821 30222 raft_consensus.cc:374] T 863d934a0f9f44b1bb8954f304fd0231 P ea078a120fdd4884bfd05d6ee61d95bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:48.555876 30222 raft_consensus.cc:729] T 863d934a0f9f44b1bb8954f304fd0231 P ea078a120fdd4884bfd05d6ee61d95bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea078a120fdd4884bfd05d6ee61d95bc, State: Initialized, Role: FOLLOWER
I20260807 08:43:48.556406 30222 consensus_queue.cc:260] T 863d934a0f9f44b1bb8954f304fd0231 P ea078a120fdd4884bfd05d6ee61d95bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c831bb26084f6796cc7b0d78aab6e7" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35013 } } peers { permanent_uuid: "19a1a91d76954fd8aa2c5ca01f76c04e" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39217 } } peers { permanent_uuid: "ea078a120fdd4884bfd05d6ee61d95bc" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 46255 } }
I20260807 08:43:48.556833 30221 raft_consensus.cc:348] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c831bb26084f6796cc7b0d78aab6e7" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35013 } } peers { permanent_uuid: "19a1a91d76954fd8aa2c5ca01f76c04e" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39217 } } peers { permanent_uuid: "ea078a120fdd4884bfd05d6ee61d95bc" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 46255 } }
I20260807 08:43:48.557027 30203 heartbeater.cc:503] Master 127.8.208.254:35689 was elected leader, sending a full tablet report...
I20260807 08:43:48.557073 30221 raft_consensus.cc:374] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:48.557130 30221 raft_consensus.cc:729] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c831bb26084f6796cc7b0d78aab6e7, State: Initialized, Role: FOLLOWER
I20260807 08:43:48.557336 30222 ts_tablet_manager.cc:1428] T 863d934a0f9f44b1bb8954f304fd0231 P ea078a120fdd4884bfd05d6ee61d95bc: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260807 08:43:48.557525 30221 consensus_queue.cc:260] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c831bb26084f6796cc7b0d78aab6e7" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35013 } } peers { permanent_uuid: "19a1a91d76954fd8aa2c5ca01f76c04e" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39217 } } peers { permanent_uuid: "ea078a120fdd4884bfd05d6ee61d95bc" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 46255 } }
I20260807 08:43:48.558167 29926 heartbeater.cc:503] Master 127.8.208.254:35689 was elected leader, sending a full tablet report...
I20260807 08:43:48.558410 30221 ts_tablet_manager.cc:1428] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 08:43:48.558873 30223 raft_consensus.cc:348] T 863d934a0f9f44b1bb8954f304fd0231 P 19a1a91d76954fd8aa2c5ca01f76c04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c831bb26084f6796cc7b0d78aab6e7" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35013 } } peers { permanent_uuid: "19a1a91d76954fd8aa2c5ca01f76c04e" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39217 } } peers { permanent_uuid: "ea078a120fdd4884bfd05d6ee61d95bc" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 46255 } }
I20260807 08:43:48.559087 30223 raft_consensus.cc:374] T 863d934a0f9f44b1bb8954f304fd0231 P 19a1a91d76954fd8aa2c5ca01f76c04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:48.559128 30223 raft_consensus.cc:729] T 863d934a0f9f44b1bb8954f304fd0231 P 19a1a91d76954fd8aa2c5ca01f76c04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a1a91d76954fd8aa2c5ca01f76c04e, State: Initialized, Role: FOLLOWER
I20260807 08:43:48.559443 30223 consensus_queue.cc:260] T 863d934a0f9f44b1bb8954f304fd0231 P 19a1a91d76954fd8aa2c5ca01f76c04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c831bb26084f6796cc7b0d78aab6e7" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35013 } } peers { permanent_uuid: "19a1a91d76954fd8aa2c5ca01f76c04e" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39217 } } peers { permanent_uuid: "ea078a120fdd4884bfd05d6ee61d95bc" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 46255 } }
I20260807 08:43:48.560057 30062 heartbeater.cc:503] Master 127.8.208.254:35689 was elected leader, sending a full tablet report...
I20260807 08:43:48.560326 30223 ts_tablet_manager.cc:1428] T 863d934a0f9f44b1bb8954f304fd0231 P 19a1a91d76954fd8aa2c5ca01f76c04e: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 08:43:48.575814 30229 raft_consensus.cc:482] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:43:48.575937 30229 raft_consensus.cc:504] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c831bb26084f6796cc7b0d78aab6e7" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35013 } } peers { permanent_uuid: "19a1a91d76954fd8aa2c5ca01f76c04e" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39217 } } peers { permanent_uuid: "ea078a120fdd4884bfd05d6ee61d95bc" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 46255 } }
I20260807 08:43:48.576736 30229 leader_election.cc:288] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19a1a91d76954fd8aa2c5ca01f76c04e (127.8.208.194:39217), ea078a120fdd4884bfd05d6ee61d95bc (127.8.208.195:46255)
I20260807 08:43:48.579911 30220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:48.577053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:38019 (local address 127.8.208.195:46255)
0807 08:43:48.577171 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:48.577175 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:48.577190 (+ 15us) server_negotiation.cc:407] Connection header received
0807 08:43:48.577313 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:48.577316 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:48.577360 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:48.577445 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:48.577676 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.578188 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.579071 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.579413 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.579521 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:48.579563 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:48.579750 (+ 187us) server_negotiation.cc:299] Negotiation successful
0807 08:43:48.579804 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 08:43:48.579914 29928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:48.576966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:46255 (local address 127.8.208.193:38019)
0807 08:43:48.577100 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:48.577113 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:48.577206 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:48.577453 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:48.577456 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:48.577471 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:48.577576 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:48.577581 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.578301 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.578304 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:48.578960 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:48.578968 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.579519 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.579522 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:48.579619 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:48.579634 (+ 15us) client_negotiation.cc:769] Sending connection context
0807 08:43:48.579735 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 08:43:48.579802 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 08:43:48.580160 30219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:48.577126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:57007 (local address 127.8.208.194:39217)
0807 08:43:48.577239 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:48.577244 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:48.577497 (+ 253us) server_negotiation.cc:407] Connection header received
0807 08:43:48.577621 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:48.577624 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:48.577663 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:48.577733 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:48.577986 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.578409 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.579282 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.579625 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.579751 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:48.579795 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:48.579975 (+ 180us) server_negotiation.cc:299] Negotiation successful
0807 08:43:48.580063 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 08:43:48.580374 30231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:48.576966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:39217 (local address 127.8.208.193:57007)
0807 08:43:48.577415 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:48.577425 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:48.577528 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:48.577741 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:48.577744 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:48.577758 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:48.577889 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:48.577895 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.578506 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.578509 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:48.579179 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:48.579186 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.579749 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.579752 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:48.579846 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:48.579872 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 08:43:48.579948 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 08:43:48.580230 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"mutex_wait_us":199,"thread_start_us":106,"threads_started":1}
I20260807 08:43:48.580533 30136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "863d934a0f9f44b1bb8954f304fd0231" candidate_uuid: "c8c831bb26084f6796cc7b0d78aab6e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea078a120fdd4884bfd05d6ee61d95bc" is_pre_election: true
I20260807 08:43:48.580796 30136 raft_consensus.cc:2454] T 863d934a0f9f44b1bb8954f304fd0231 P ea078a120fdd4884bfd05d6ee61d95bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8c831bb26084f6796cc7b0d78aab6e7 in term 0.
I20260807 08:43:48.581001 30015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "863d934a0f9f44b1bb8954f304fd0231" candidate_uuid: "c8c831bb26084f6796cc7b0d78aab6e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a1a91d76954fd8aa2c5ca01f76c04e" is_pre_election: true
I20260807 08:43:48.581219 30015 raft_consensus.cc:2454] T 863d934a0f9f44b1bb8954f304fd0231 P 19a1a91d76954fd8aa2c5ca01f76c04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8c831bb26084f6796cc7b0d78aab6e7 in term 0.
I20260807 08:43:48.581265 29811 leader_election.cc:302] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8c831bb26084f6796cc7b0d78aab6e7, ea078a120fdd4884bfd05d6ee61d95bc; no voters:
I20260807 08:43:48.581511 30229 raft_consensus.cc:2781] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:43:48.581599 30229 raft_consensus.cc:482] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:43:48.581652 30229 raft_consensus.cc:3037] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:48.582576 30229 raft_consensus.cc:504] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c831bb26084f6796cc7b0d78aab6e7" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35013 } } peers { permanent_uuid: "19a1a91d76954fd8aa2c5ca01f76c04e" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39217 } } peers { permanent_uuid: "ea078a120fdd4884bfd05d6ee61d95bc" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 46255 } }
I20260807 08:43:48.582873 30229 leader_election.cc:288] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7 [CANDIDATE]: Term 1 election: Requested vote from peers 19a1a91d76954fd8aa2c5ca01f76c04e (127.8.208.194:39217), ea078a120fdd4884bfd05d6ee61d95bc (127.8.208.195:46255)
I20260807 08:43:48.583297 30015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "863d934a0f9f44b1bb8954f304fd0231" candidate_uuid: "c8c831bb26084f6796cc7b0d78aab6e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a1a91d76954fd8aa2c5ca01f76c04e"
I20260807 08:43:48.583389 30015 raft_consensus.cc:3037] T 863d934a0f9f44b1bb8954f304fd0231 P 19a1a91d76954fd8aa2c5ca01f76c04e [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:48.584213 30015 raft_consensus.cc:2454] T 863d934a0f9f44b1bb8954f304fd0231 P 19a1a91d76954fd8aa2c5ca01f76c04e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c831bb26084f6796cc7b0d78aab6e7 in term 1.
I20260807 08:43:48.584455 30136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "863d934a0f9f44b1bb8954f304fd0231" candidate_uuid: "c8c831bb26084f6796cc7b0d78aab6e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea078a120fdd4884bfd05d6ee61d95bc"
I20260807 08:43:48.584503 29812 leader_election.cc:302] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19a1a91d76954fd8aa2c5ca01f76c04e, c8c831bb26084f6796cc7b0d78aab6e7; no voters:
I20260807 08:43:48.584687 30229 raft_consensus.cc:2781] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:43:48.584563 30136 raft_consensus.cc:3037] T 863d934a0f9f44b1bb8954f304fd0231 P ea078a120fdd4884bfd05d6ee61d95bc [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:48.584892 30229 raft_consensus.cc:686] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7 [term 1 LEADER]: Becoming Leader. State: Replica: c8c831bb26084f6796cc7b0d78aab6e7, State: Running, Role: LEADER
I20260807 08:43:48.585207 30229 consensus_queue.cc:237] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c831bb26084f6796cc7b0d78aab6e7" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35013 } } peers { permanent_uuid: "19a1a91d76954fd8aa2c5ca01f76c04e" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39217 } } peers { permanent_uuid: "ea078a120fdd4884bfd05d6ee61d95bc" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 46255 } }
I20260807 08:43:48.585769 30136 raft_consensus.cc:2454] T 863d934a0f9f44b1bb8954f304fd0231 P ea078a120fdd4884bfd05d6ee61d95bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8c831bb26084f6796cc7b0d78aab6e7 in term 1.
I20260807 08:43:48.587929 29728 catalog_manager.cc:5495] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8c831bb26084f6796cc7b0d78aab6e7 (127.8.208.193). New cstate: current_term: 1 leader_uuid: "c8c831bb26084f6796cc7b0d78aab6e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8c831bb26084f6796cc7b0d78aab6e7" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 35013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19a1a91d76954fd8aa2c5ca01f76c04e" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea078a120fdd4884bfd05d6ee61d95bc" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 46255 } health_report { overall_health: UNKNOWN } } }
W20260807 08:43:48.599907 29927 tablet.cc:2369] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 08:43:48.601081 30217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:48.598006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52102 (local address 127.8.208.193:35013)
0807 08:43:48.598108 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:48.598110 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:48.598150 (+ 40us) server_negotiation.cc:407] Connection header received
0807 08:43:48.598286 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:48.598288 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:48.598327 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:48.598399 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:43:48.598585 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.598981 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.599712 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.599901 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.600004 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:48.600422 (+ 418us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:43:48.600748 (+ 326us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:43:48.600864 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:48.600928 (+ 64us) server_negotiation.cc:299] Negotiation successful
0807 08:43:48.600972 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 08:43:48.608198 30136 raft_consensus.cc:1261] T 863d934a0f9f44b1bb8954f304fd0231 P ea078a120fdd4884bfd05d6ee61d95bc [term 1 FOLLOWER]: Refusing update from remote peer c8c831bb26084f6796cc7b0d78aab6e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:43:48.608855 30232 consensus_queue.cc:1035] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea078a120fdd4884bfd05d6ee61d95bc" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:43:48.608925 30015 raft_consensus.cc:1261] T 863d934a0f9f44b1bb8954f304fd0231 P 19a1a91d76954fd8aa2c5ca01f76c04e [term 1 FOLLOWER]: Refusing update from remote peer c8c831bb26084f6796cc7b0d78aab6e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:43:48.609416 30232 consensus_queue.cc:1035] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19a1a91d76954fd8aa2c5ca01f76c04e" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 39217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:43:48.616006 30235 mvcc.cc:205] Tried to move back new op lower bound from 7315833768371519488 to 7315833768287719424. Current Snapshot: MvccSnapshot[applied={T|T < 7315833768371519488}]
I20260807 08:43:48.616580 30236 mvcc.cc:205] Tried to move back new op lower bound from 7315833768371519488 to 7315833768287719424. Current Snapshot: MvccSnapshot[applied={T|T < 7315833768371519488}]
I20260807 08:43:48.618140 30237 mvcc.cc:205] Tried to move back new op lower bound from 7315833768371519488 to 7315833768287719424. Current Snapshot: MvccSnapshot[applied={T|T < 7315833768371519488}]
I20260807 08:43:48.623832 29727 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:43:48.623991 29727 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:43:48.626368 29727 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 62fa4187f4a94499aac49b82fb8347eb: Sending DeleteTablet for 3 replicas of tablet 863d934a0f9f44b1bb8954f304fd0231
I20260807 08:43:48.627053 29858 tablet_service.cc:1514] Processing DeleteTablet for tablet 863d934a0f9f44b1bb8954f304fd0231 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:43:48 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:52094
I20260807 08:43:48.627115 29994 tablet_service.cc:1514] Processing DeleteTablet for tablet 863d934a0f9f44b1bb8954f304fd0231 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:43:48 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:60742
I20260807 08:43:48.627508 30247 tablet_replica.cc:330] T 863d934a0f9f44b1bb8954f304fd0231 P 19a1a91d76954fd8aa2c5ca01f76c04e: stopping tablet replica
I20260807 08:43:48.627526 30129 tablet_service.cc:1514] Processing DeleteTablet for tablet 863d934a0f9f44b1bb8954f304fd0231 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:43:48 UTC) from {username='kudu', principal='kudu/127.8.208.254@KRBTEST.COM'} at 127.0.0.1:46206
I20260807 08:43:48.627805 30247 raft_consensus.cc:2229] T 863d934a0f9f44b1bb8954f304fd0231 P 19a1a91d76954fd8aa2c5ca01f76c04e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:43:48.627928 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 29793
I20260807 08:43:48.628077 30247 raft_consensus.cc:2258] T 863d934a0f9f44b1bb8954f304fd0231 P 19a1a91d76954fd8aa2c5ca01f76c04e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:43:48.628113 30246 tablet_replica.cc:330] T 863d934a0f9f44b1bb8954f304fd0231 P c8c831bb26084f6796cc7b0d78aab6e7: stopping tablet replica
I20260807 08:43:48.630627 30248 tablet_replica.cc:330] T 863d934a0f9f44b1bb8954f304fd0231 P ea078a120fdd4884bfd05d6ee61d95bc: stopping tablet replica
I20260807 08:43:48.630892 30248 raft_consensus.cc:2229] T 863d934a0f9f44b1bb8954f304fd0231 P ea078a120fdd4884bfd05d6ee61d95bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:43:48.631172 30248 raft_consensus.cc:2258] T 863d934a0f9f44b1bb8954f304fd0231 P ea078a120fdd4884bfd05d6ee61d95bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:43:48.632293 30247 ts_tablet_manager.cc:1905] T 863d934a0f9f44b1bb8954f304fd0231 P 19a1a91d76954fd8aa2c5ca01f76c04e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:43:48.634485 30248 ts_tablet_manager.cc:1905] T 863d934a0f9f44b1bb8954f304fd0231 P ea078a120fdd4884bfd05d6ee61d95bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:43:48.635635 30247 ts_tablet_manager.cc:1918] T 863d934a0f9f44b1bb8954f304fd0231 P 19a1a91d76954fd8aa2c5ca01f76c04e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:43:48.635751 30247 log.cc:1196] T 863d934a0f9f44b1bb8954f304fd0231 P 19a1a91d76954fd8aa2c5ca01f76c04e: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-1/wal/wals/863d934a0f9f44b1bb8954f304fd0231
I20260807 08:43:48.636118 30247 ts_tablet_manager.cc:1939] T 863d934a0f9f44b1bb8954f304fd0231 P 19a1a91d76954fd8aa2c5ca01f76c04e: Deleting consensus metadata
I20260807 08:43:48.636682 30248 ts_tablet_manager.cc:1918] T 863d934a0f9f44b1bb8954f304fd0231 P ea078a120fdd4884bfd05d6ee61d95bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:43:48.636798 30248 log.cc:1196] T 863d934a0f9f44b1bb8954f304fd0231 P ea078a120fdd4884bfd05d6ee61d95bc: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/863d934a0f9f44b1bb8954f304fd0231
I20260807 08:43:48.637141 30248 ts_tablet_manager.cc:1939] T 863d934a0f9f44b1bb8954f304fd0231 P ea078a120fdd4884bfd05d6ee61d95bc: Deleting consensus metadata
I20260807 08:43:48.637305 29715 catalog_manager.cc:4841] TS 19a1a91d76954fd8aa2c5ca01f76c04e (127.8.208.194:39217): tablet 863d934a0f9f44b1bb8954f304fd0231 (table test-table [id=5cd1f9a6df9643eb863c6329c071deba]) successfully deleted
I20260807 08:43:48.638134 29714 catalog_manager.cc:4841] TS ea078a120fdd4884bfd05d6ee61d95bc (127.8.208.195:46255): tablet 863d934a0f9f44b1bb8954f304fd0231 (table test-table [id=5cd1f9a6df9643eb863c6329c071deba]) successfully deleted
W20260807 08:43:48.638160 29712 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.208.193:35013 (error 108)
I20260807 08:43:48.638917 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 29931
I20260807 08:43:48.639124 30218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:48.638763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:35013 (local address 127.0.0.1:52106)
0807 08:43:48.638931 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:48.639037 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.193:35013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260807 08:43:48.640769 29712 catalog_manager.cc:4584] TS c8c831bb26084f6796cc7b0d78aab6e7 (127.8.208.193:35013): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 863d934a0f9f44b1bb8954f304fd0231: Network error: Client connection negotiation failed: client connection to 127.8.208.193:35013: connect: Connection refused (error 111)
I20260807 08:43:48.645249 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 30067
I20260807 08:43:48.651530 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 29696
2026-08-07T08:43:48Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2129 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-07T08:43:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:43:48Z Disabled control of system clock
I20260807 08:43:48.684062 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:46115
--webserver_interface=127.8.208.254
--webserver_port=0
--builtin_ntp_servers=127.8.208.212:45005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:46115
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 08:43:48.789022 30253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:48.789227 30253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:48.789279 30253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:48.793227 30253 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:43:48.793282 30253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:48.793303 30253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:48.793318 30253 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:43:48.793332 30253 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:43:48.797870 30253 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:45005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:46115
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:46115
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30253
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:48.798745 30253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:48.799919 30253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:48.807685 30258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:48.807715 30259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:48.807760 30253 server_base.cc:1034] running on GCE node
W20260807 08:43:48.807739 30261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:48.808398 30253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:48.809423 30253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:48.810600 30253 hybrid_clock.cc:648] HybridClock initialized: now 1786092228810579 us; error 36 us; skew 500 ppm
I20260807 08:43:48.812306 30253 webserver.cc:460] Webserver started at http://127.8.208.254:45461/ using document root <none> and password file <none>
I20260807 08:43:48.812855 30253 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:48.812953 30253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:48.813185 30253 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:48.815054 30253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "c528382bc15d411a846cea9337f2b50f"
format_stamp: "Formatted at 2026-08-07 08:43:48 on dist-test-slave-6nmv"
server_key: "0a15cd40d9a6ad0167f2aef96db0e432"
server_key_iv: "03e15cb468f24c7c39808222810f38c1"
server_key_version: "encryptionkey@0"
I20260807 08:43:48.815616 30253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "c528382bc15d411a846cea9337f2b50f"
format_stamp: "Formatted at 2026-08-07 08:43:48 on dist-test-slave-6nmv"
server_key: "0a15cd40d9a6ad0167f2aef96db0e432"
server_key_iv: "03e15cb468f24c7c39808222810f38c1"
server_key_version: "encryptionkey@0"
I20260807 08:43:48.819051 30253 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 08:43:48.821230 30267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:48.822422 30253 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:43:48.822556 30253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "c528382bc15d411a846cea9337f2b50f"
format_stamp: "Formatted at 2026-08-07 08:43:48 on dist-test-slave-6nmv"
server_key: "0a15cd40d9a6ad0167f2aef96db0e432"
server_key_iv: "03e15cb468f24c7c39808222810f38c1"
server_key_version: "encryptionkey@0"
I20260807 08:43:48.822671 30253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:48.878190 30253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:48.878856 30253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:48.879036 30253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:48.885779 30253 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:46115
I20260807 08:43:48.885802 30323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:46115 every 8 connection(s)
I20260807 08:43:48.886734 30253 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:43:48.889621 30324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:48.890053 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 30253
I20260807 08:43:48.890183 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:43:48.890503 9027 external_mini_cluster.cc:1428] Setting key 203fe76af38c872b4dd884d3479ace18
I20260807 08:43:48.895924 30324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c528382bc15d411a846cea9337f2b50f: Bootstrap starting.
I20260807 08:43:48.898037 30324 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c528382bc15d411a846cea9337f2b50f: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:48.898815 30324 log.cc:824] T 00000000000000000000000000000000 P c528382bc15d411a846cea9337f2b50f: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:48.898957 30327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:48.891834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60472 (local address 127.8.208.254:46115)
0807 08:43:48.892407 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:48.892420 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:48.892452 (+ 32us) server_negotiation.cc:407] Connection header received
0807 08:43:48.893059 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:48.893074 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:48.893395 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:48.893731 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:48.894151 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.894988 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.895871 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:48.896382 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:48.896554 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:48.897395 (+ 841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:48.897399 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:48.897408 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:43:48.897770 (+ 362us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:48.897888 (+ 118us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:43:48.897911 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:48.898005 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:48.898108 (+ 103us) server_negotiation.cc:299] Negotiation successful
0807 08:43:48.898330 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":128,"threads_started":1}
I20260807 08:43:48.900730 30324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c528382bc15d411a846cea9337f2b50f: No bootstrap required, opened a new log
I20260807 08:43:48.904175 30324 raft_consensus.cc:348] T 00000000000000000000000000000000 P c528382bc15d411a846cea9337f2b50f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c528382bc15d411a846cea9337f2b50f" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 46115 } }
I20260807 08:43:48.904382 30324 raft_consensus.cc:374] T 00000000000000000000000000000000 P c528382bc15d411a846cea9337f2b50f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:48.904429 30324 raft_consensus.cc:729] T 00000000000000000000000000000000 P c528382bc15d411a846cea9337f2b50f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c528382bc15d411a846cea9337f2b50f, State: Initialized, Role: FOLLOWER
I20260807 08:43:48.904765 30324 consensus_queue.cc:260] T 00000000000000000000000000000000 P c528382bc15d411a846cea9337f2b50f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c528382bc15d411a846cea9337f2b50f" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 46115 } }
I20260807 08:43:48.904863 30324 raft_consensus.cc:388] T 00000000000000000000000000000000 P c528382bc15d411a846cea9337f2b50f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:43:48.904906 30324 raft_consensus.cc:482] T 00000000000000000000000000000000 P c528382bc15d411a846cea9337f2b50f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:43:48.904969 30324 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c528382bc15d411a846cea9337f2b50f [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:48.905710 30324 raft_consensus.cc:504] T 00000000000000000000000000000000 P c528382bc15d411a846cea9337f2b50f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c528382bc15d411a846cea9337f2b50f" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 46115 } }
I20260807 08:43:48.906100 30324 leader_election.cc:302] T 00000000000000000000000000000000 P c528382bc15d411a846cea9337f2b50f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c528382bc15d411a846cea9337f2b50f; no voters:
I20260807 08:43:48.906347 30324 leader_election.cc:288] T 00000000000000000000000000000000 P c528382bc15d411a846cea9337f2b50f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:43:48.906479 30329 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c528382bc15d411a846cea9337f2b50f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:43:48.906721 30329 raft_consensus.cc:686] T 00000000000000000000000000000000 P c528382bc15d411a846cea9337f2b50f [term 1 LEADER]: Becoming Leader. State: Replica: c528382bc15d411a846cea9337f2b50f, State: Running, Role: LEADER
I20260807 08:43:48.906989 30329 consensus_queue.cc:237] T 00000000000000000000000000000000 P c528382bc15d411a846cea9337f2b50f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c528382bc15d411a846cea9337f2b50f" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 46115 } }
I20260807 08:43:48.907522 30324 sys_catalog.cc:564] T 00000000000000000000000000000000 P c528382bc15d411a846cea9337f2b50f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:43:48.908473 30331 sys_catalog.cc:455] T 00000000000000000000000000000000 P c528382bc15d411a846cea9337f2b50f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c528382bc15d411a846cea9337f2b50f. Latest consensus state: current_term: 1 leader_uuid: "c528382bc15d411a846cea9337f2b50f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c528382bc15d411a846cea9337f2b50f" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 46115 } } }
I20260807 08:43:48.908607 30331 sys_catalog.cc:458] T 00000000000000000000000000000000 P c528382bc15d411a846cea9337f2b50f [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:48.908954 30330 sys_catalog.cc:455] T 00000000000000000000000000000000 P c528382bc15d411a846cea9337f2b50f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c528382bc15d411a846cea9337f2b50f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c528382bc15d411a846cea9337f2b50f" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 46115 } } }
I20260807 08:43:48.909045 30330 sys_catalog.cc:458] T 00000000000000000000000000000000 P c528382bc15d411a846cea9337f2b50f [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:48.909143 30338 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:43:48.911469 30338 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:43:48.916406 30338 catalog_manager.cc:1347] Generated new cluster ID: 25c81f99ad7346cbb64d4de12cb53608
I20260807 08:43:48.916476 30338 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:43:48.924703 30338 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:43:48.925449 30338 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:43:48.934104 30338 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c528382bc15d411a846cea9337f2b50f: Generated new TSK 0
I20260807 08:43:48.934655 30338 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:43:48.938721 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.193:0
--local_ip_for_outbound_sockets=127.8.208.193
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:46115
--builtin_ntp_servers=127.8.208.212:45005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 08:43:49.046277 30349 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:49.046496 30349 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:49.046532 30349 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:49.050668 30349 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:49.050715 30349 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:49.050765 30349 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.193
I20260807 08:43:49.055287 30349 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:45005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.208.193
--webserver_port=0
--tserver_master_addrs=127.8.208.254:46115
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30349
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.193
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:49.056252 30349 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:49.057525 30349 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:49.066541 30355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:49.066551 30354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:49.066592 30357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:49.066829 30349 server_base.cc:1034] running on GCE node
I20260807 08:43:49.067238 30349 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:49.067801 30349 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:49.068953 30349 hybrid_clock.cc:648] HybridClock initialized: now 1786092229068928 us; error 39 us; skew 500 ppm
I20260807 08:43:49.070632 30349 webserver.cc:460] Webserver started at http://127.8.208.193:32999/ using document root <none> and password file <none>
I20260807 08:43:49.071153 30349 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:49.071223 30349 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:49.071471 30349 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:49.073406 30349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-0/data/instance:
uuid: "ff798db01ff643648882619575cc6721"
format_stamp: "Formatted at 2026-08-07 08:43:49 on dist-test-slave-6nmv"
server_key: "6903e4d17a3151b1998df701f99d02cc"
server_key_iv: "0395bb49b4a8f8e0b7f469799511a145"
server_key_version: "encryptionkey@0"
I20260807 08:43:49.074034 30349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance:
uuid: "ff798db01ff643648882619575cc6721"
format_stamp: "Formatted at 2026-08-07 08:43:49 on dist-test-slave-6nmv"
server_key: "6903e4d17a3151b1998df701f99d02cc"
server_key_iv: "0395bb49b4a8f8e0b7f469799511a145"
server_key_version: "encryptionkey@0"
I20260807 08:43:49.077523 30349 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 08:43:49.079762 30363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:49.080880 30349 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:43:49.081007 30349 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-0/wal
uuid: "ff798db01ff643648882619575cc6721"
format_stamp: "Formatted at 2026-08-07 08:43:49 on dist-test-slave-6nmv"
server_key: "6903e4d17a3151b1998df701f99d02cc"
server_key_iv: "0395bb49b4a8f8e0b7f469799511a145"
server_key_version: "encryptionkey@0"
I20260807 08:43:49.081112 30349 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:49.092859 30349 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:49.093415 30349 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:49.093600 30349 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:49.094170 30349 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:43:49.094964 30349 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:43:49.095031 30349 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:49.095089 30349 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:43:49.095121 30349 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:49.103643 30349 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.193:39837
I20260807 08:43:49.103677 30481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.193:39837 every 8 connection(s)
I20260807 08:43:49.104424 30349 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-0/data/info.pb
I20260807 08:43:49.105026 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 30349
I20260807 08:43:49.105171 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-0/wal/instance
I20260807 08:43:49.105513 9027 external_mini_cluster.cc:1428] Setting key 4329cefb501b7b9bb3a7dd2bd3b728e6
I20260807 08:43:49.107914 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.194:0
--local_ip_for_outbound_sockets=127.8.208.194
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:46115
--builtin_ntp_servers=127.8.208.212:45005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 08:43:49.114382 30327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:49.106374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.193:45575 (local address 127.8.208.254:46115)
0807 08:43:49.106522 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:49.106527 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:49.107670 (+ 1143us) server_negotiation.cc:407] Connection header received
0807 08:43:49.109894 (+ 2224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:49.109899 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:49.109959 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:49.110039 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:49.110840 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.111416 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.112554 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.112799 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.112917 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:49.113937 (+ 1020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:49.113940 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:49.113942 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:43:49.113952 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:49.113968 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:43:49.113976 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:49.114049 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:49.114196 (+ 147us) server_negotiation.cc:299] Negotiation successful
0807 08:43:49.114253 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 08:43:49.115118 30484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:49.106733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:46115 (local address 127.8.208.193:45575)
0807 08:43:49.107527 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:49.107579 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:49.109633 (+ 2054us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:49.110182 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:49.110188 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:49.110275 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:43:49.110703 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:49.110715 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.111550 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.111553 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:49.112427 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:49.112437 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.112953 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.112956 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:49.113100 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:49.113680 (+ 580us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 08:43:49.113682 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:43:49.113715 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 08:43:49.113767 (+ 52us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:43:49.114051 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:43:49.114063 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:43:49.114069 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 08:43:49.114196 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 08:43:49.114424 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":134,"threads_started":1}
I20260807 08:43:49.116422 30482 heartbeater.cc:347] Connected to a master server at 127.8.208.254:46115
I20260807 08:43:49.116636 30482 heartbeater.cc:464] Registering TS with master...
I20260807 08:43:49.117105 30482 heartbeater.cc:511] Master 127.8.208.254:46115 requested a full tablet report, sending...
I20260807 08:43:49.118708 30285 ts_manager.cc:194] Registered new tserver with Master: ff798db01ff643648882619575cc6721 (127.8.208.193:39837)
I20260807 08:43:49.120281 30285 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.208.193:45575
W20260807 08:43:49.217106 30485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:49.217332 30485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:49.217377 30485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:49.221246 30485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:49.221297 30485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:49.221354 30485 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.194
I20260807 08:43:49.225948 30485 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:45005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.208.194
--webserver_port=0
--tserver_master_addrs=127.8.208.254:46115
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30485
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.194
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:49.226886 30485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:49.228119 30485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:49.236922 30490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:49.236917 30491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:49.236917 30493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:49.237283 30485 server_base.cc:1034] running on GCE node
I20260807 08:43:49.237733 30485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:49.238315 30485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:49.239491 30485 hybrid_clock.cc:648] HybridClock initialized: now 1786092229239481 us; error 35 us; skew 500 ppm
I20260807 08:43:49.241031 30485 webserver.cc:460] Webserver started at http://127.8.208.194:35473/ using document root <none> and password file <none>
I20260807 08:43:49.241556 30485 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:49.241650 30485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:49.241909 30485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:49.243755 30485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-1/data/instance:
uuid: "50d033b4c3854e7ca4ba1ad7772c632a"
format_stamp: "Formatted at 2026-08-07 08:43:49 on dist-test-slave-6nmv"
server_key: "8c052a3439fc16eff9664d0f77c8190a"
server_key_iv: "65371099ec5cd3026d44e84a44f4f60a"
server_key_version: "encryptionkey@0"
I20260807 08:43:49.244313 30485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance:
uuid: "50d033b4c3854e7ca4ba1ad7772c632a"
format_stamp: "Formatted at 2026-08-07 08:43:49 on dist-test-slave-6nmv"
server_key: "8c052a3439fc16eff9664d0f77c8190a"
server_key_iv: "65371099ec5cd3026d44e84a44f4f60a"
server_key_version: "encryptionkey@0"
I20260807 08:43:49.248219 30485 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 08:43:49.250414 30499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:49.251519 30485 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:43:49.251675 30485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-1/wal
uuid: "50d033b4c3854e7ca4ba1ad7772c632a"
format_stamp: "Formatted at 2026-08-07 08:43:49 on dist-test-slave-6nmv"
server_key: "8c052a3439fc16eff9664d0f77c8190a"
server_key_iv: "65371099ec5cd3026d44e84a44f4f60a"
server_key_version: "encryptionkey@0"
I20260807 08:43:49.251780 30485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:49.269152 30485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:49.269704 30485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:49.269915 30485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:49.270447 30485 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:43:49.271243 30485 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:43:49.271308 30485 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:49.271363 30485 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:43:49.271423 30485 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:49.279919 30485 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.194:40023
I20260807 08:43:49.279947 30616 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.194:40023 every 8 connection(s)
I20260807 08:43:49.280658 30485 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-1/data/info.pb
I20260807 08:43:49.284754 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 30485
I20260807 08:43:49.284899 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-1/wal/instance
I20260807 08:43:49.285213 9027 external_mini_cluster.cc:1428] Setting key a62f001e13d63cc5d34c67255de23320
I20260807 08:43:49.287494 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.208.195:0
--local_ip_for_outbound_sockets=127.8.208.195
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:46115
--builtin_ntp_servers=127.8.208.212:45005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 08:43:49.289630 30327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:49.282265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:39537 (local address 127.8.208.254:46115)
0807 08:43:49.282426 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:49.282430 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:49.283311 (+ 881us) server_negotiation.cc:407] Connection header received
0807 08:43:49.284621 (+ 1310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:49.284624 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:49.284667 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:49.284734 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:49.285865 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.286632 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.287778 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.287958 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.288082 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:49.289141 (+ 1059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:49.289144 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:49.289147 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:43:49.289165 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:49.289184 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:43:49.289192 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:49.289270 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:49.289425 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 08:43:49.289486 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 08:43:49.290393 30619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:49.282579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:46115 (local address 127.8.208.194:39537)
0807 08:43:49.283171 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:49.283208 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:49.284389 (+ 1181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:49.284933 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:49.284941 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:49.285035 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:43:49.285674 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:49.285700 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.286765 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.286769 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:49.287597 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:49.287610 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.288125 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.288130 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:49.288307 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:49.288884 (+ 577us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 08:43:49.288886 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:43:49.288921 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 08:43:49.288976 (+ 55us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:43:49.289271 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:43:49.289282 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:43:49.289289 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 08:43:49.289414 (+ 125us) client_negotiation.cc:240] Negotiation successful
0807 08:43:49.289656 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":97,"threads_started":1}
I20260807 08:43:49.291460 30617 heartbeater.cc:347] Connected to a master server at 127.8.208.254:46115
I20260807 08:43:49.291745 30617 heartbeater.cc:464] Registering TS with master...
I20260807 08:43:49.292339 30617 heartbeater.cc:511] Master 127.8.208.254:46115 requested a full tablet report, sending...
I20260807 08:43:49.293453 30285 ts_manager.cc:194] Registered new tserver with Master: 50d033b4c3854e7ca4ba1ad7772c632a (127.8.208.194:40023)
I20260807 08:43:49.294051 30285 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.208.194:39537
W20260807 08:43:49.394390 30620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:49.394634 30620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:49.394670 30620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:49.398592 30620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:49.398640 30620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:49.398692 30620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.208.195
I20260807 08:43:49.403450 30620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:45005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.208.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.208.195
--webserver_port=0
--tserver_master_addrs=127.8.208.254:46115
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.208.195
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:49.404507 30620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:49.405936 30620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:49.415285 30628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:49.415378 30626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:49.415294 30625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:49.415518 30620 server_base.cc:1034] running on GCE node
I20260807 08:43:49.415980 30620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:49.416602 30620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:49.417759 30620 hybrid_clock.cc:648] HybridClock initialized: now 1786092229417745 us; error 27 us; skew 500 ppm
I20260807 08:43:49.419492 30620 webserver.cc:460] Webserver started at http://127.8.208.195:34719/ using document root <none> and password file <none>
I20260807 08:43:49.420050 30620 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:49.420106 30620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:49.420360 30620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:49.422358 30620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-2/data/instance:
uuid: "badbdd915ad14779b91de3d8434d8848"
format_stamp: "Formatted at 2026-08-07 08:43:49 on dist-test-slave-6nmv"
server_key: "46081faca965f40006521600fe65d015"
server_key_iv: "f20d696d97985cfc0992a7c3f4aae6d5"
server_key_version: "encryptionkey@0"
I20260807 08:43:49.422869 30620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance:
uuid: "badbdd915ad14779b91de3d8434d8848"
format_stamp: "Formatted at 2026-08-07 08:43:49 on dist-test-slave-6nmv"
server_key: "46081faca965f40006521600fe65d015"
server_key_iv: "f20d696d97985cfc0992a7c3f4aae6d5"
server_key_version: "encryptionkey@0"
I20260807 08:43:49.426415 30620 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 08:43:49.428781 30634 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:49.430032 30620 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:43:49.430159 30620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-2/wal
uuid: "badbdd915ad14779b91de3d8434d8848"
format_stamp: "Formatted at 2026-08-07 08:43:49 on dist-test-slave-6nmv"
server_key: "46081faca965f40006521600fe65d015"
server_key_iv: "f20d696d97985cfc0992a7c3f4aae6d5"
server_key_version: "encryptionkey@0"
I20260807 08:43:49.430258 30620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:49.452477 30620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:49.453171 30620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:49.453375 30620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:49.454012 30620 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 08:43:49.454973 30620 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 08:43:49.455024 30620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:49.455118 30620 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 08:43:49.455156 30620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:49.463589 30620 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.195:42703
I20260807 08:43:49.463634 30750 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.195:42703 every 8 connection(s)
I20260807 08:43:49.464553 30620 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-2/data/info.pb
I20260807 08:43:49.473625 30327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:49.466330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.195:39489 (local address 127.8.208.254:46115)
0807 08:43:49.466462 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:49.466465 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:49.467455 (+ 990us) server_negotiation.cc:407] Connection header received
0807 08:43:49.468988 (+ 1533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:49.468991 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:49.469052 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:49.469154 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:49.470068 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.470586 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.471764 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.471990 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.472110 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:49.473168 (+ 1058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:49.473171 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:49.473175 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:43:49.473192 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:49.473211 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:43:49.473219 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:49.473288 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:49.473434 (+ 146us) server_negotiation.cc:299] Negotiation successful
0807 08:43:49.473490 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 08:43:49.474491 30753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:49.466703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:46115 (local address 127.8.208.195:39489)
0807 08:43:49.467313 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:49.467350 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:49.468752 (+ 1402us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:49.469334 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:49.469340 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:49.469413 (+ 73us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:43:49.469933 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:49.469948 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.470712 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.470715 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:49.471615 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:49.471625 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.472140 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.472145 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:49.472313 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:49.472884 (+ 571us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 08:43:49.472885 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:43:49.472933 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 08:43:49.473007 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:43:49.473301 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:43:49.473312 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:43:49.473321 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 08:43:49.473433 (+ 112us) client_negotiation.cc:240] Negotiation successful
0807 08:43:49.473689 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":134,"threads_started":1}
I20260807 08:43:49.474593 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 30620
I20260807 08:43:49.474732 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-2/wal/instance
I20260807 08:43:49.475129 9027 external_mini_cluster.cc:1428] Setting key 6c223586834fde2a2c783c2ad44ffa3f
I20260807 08:43:49.475831 30751 heartbeater.cc:347] Connected to a master server at 127.8.208.254:46115
I20260807 08:43:49.476070 30751 heartbeater.cc:464] Registering TS with master...
I20260807 08:43:49.476598 30751 heartbeater.cc:511] Master 127.8.208.254:46115 requested a full tablet report, sending...
I20260807 08:43:49.477604 30285 ts_manager.cc:194] Registered new tserver with Master: badbdd915ad14779b91de3d8434d8848 (127.8.208.195:42703)
I20260807 08:43:49.478194 30285 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.208.195:39489
I20260807 08:43:49.489080 9027 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 08:43:49.494424 30327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:49.490933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60488 (local address 127.8.208.254:46115)
0807 08:43:49.491066 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:49.491070 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:49.491238 (+ 168us) server_negotiation.cc:407] Connection header received
0807 08:43:49.491307 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:49.491309 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:49.491344 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:49.491402 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:49.491703 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.492178 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.492949 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.493150 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.493222 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:49.494043 (+ 821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:49.494045 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:49.494047 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:43:49.494057 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:49.494080 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:43:49.494087 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:49.494143 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:49.494218 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 08:43:49.494261 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 08:43:49.497010 30285 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60488:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 08:43:49.499992 30285 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 08:43:49.513918 30767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:49.508468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55774 (local address 127.8.208.194:40023)
0807 08:43:49.509080 (+ 612us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:49.509093 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:49.509117 (+ 24us) server_negotiation.cc:407] Connection header received
0807 08:43:49.509196 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:49.509240 (+ 44us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:49.509398 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:49.509560 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:49.510219 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.511305 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.512647 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.513180 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.513296 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:49.513507 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:49.513621 (+ 114us) server_negotiation.cc:299] Negotiation successful
0807 08:43:49.513731 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":502,"thread_start_us":128,"threads_started":1}
I20260807 08:43:49.513921 30764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:49.507785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.194:40023 (local address 127.0.0.1:55774)
0807 08:43:49.508608 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:49.508622 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:49.508734 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:49.509893 (+ 1159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:49.509897 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:49.509920 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:49.510082 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:49.510089 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.511415 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.511418 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:49.512532 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:49.512539 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.513297 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.513300 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:49.513446 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:49.513485 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 08:43:49.513585 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 08:43:49.513746 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":751,"mutex_wait_us":132,"thread_start_us":95,"threads_started":1}
I20260807 08:43:49.513936 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:49.508478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:39837 (local address 127.0.0.1:35686)
0807 08:43:49.508885 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:49.508898 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:49.508986 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:49.509755 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:49.509758 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:49.509794 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:49.509964 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:49.509969 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.510914 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.510920 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:49.512277 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:49.512287 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.513369 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.513373 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:49.513507 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:49.513529 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 08:43:49.513593 (+ 64us) client_negotiation.cc:240] Negotiation successful
0807 08:43:49.513743 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"mutex_wait_us":74,"thread_start_us":95,"threads_started":1}
I20260807 08:43:49.514348 30763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:49.507708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:42703 (local address 127.0.0.1:33180)
0807 08:43:49.508033 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:49.508075 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:49.508220 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:49.509569 (+ 1349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:49.509575 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:49.509598 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:49.509753 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:49.509761 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.511292 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.511295 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:49.512313 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:49.512322 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.513369 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.513373 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:49.513751 (+ 378us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:49.513774 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 08:43:49.513873 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 08:43:49.513936 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":309,"thread_start_us":84,"threads_started":1}
I20260807 08:43:49.514765 30765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:49.507779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33180 (local address 127.8.208.195:42703)
0807 08:43:49.508443 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:49.508456 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:49.508481 (+ 25us) server_negotiation.cc:407] Connection header received
0807 08:43:49.509202 (+ 721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:49.509207 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:49.509410 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:49.509559 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:49.509948 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.511148 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.512468 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.513214 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.513442 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:49.513628 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:49.514486 (+ 858us) server_negotiation.cc:299] Negotiation successful
0807 08:43:49.514607 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":107,"threads_started":1}
I20260807 08:43:49.515149 30768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:49.508905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35686 (local address 127.8.208.193:39837)
0807 08:43:49.509298 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:49.509307 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:49.509327 (+ 20us) server_negotiation.cc:407] Connection header received
0807 08:43:49.509387 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:49.509390 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:49.509558 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:49.509757 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:49.510081 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.510801 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.512410 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.513214 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.514472 (+ 1258us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:49.514665 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:49.514715 (+ 50us) server_negotiation.cc:299] Negotiation successful
0807 08:43:49.514984 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":171,"threads_started":1}
I20260807 08:43:49.517242 30414 tablet_service.cc:1467] Processing CreateTablet for tablet 10a913d045fa441c9b8c565335126ffe (DEFAULT_TABLE table=test-table [id=2289a581307c448aa55a912636dba6e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:43:49.517163 30683 tablet_service.cc:1467] Processing CreateTablet for tablet 10a913d045fa441c9b8c565335126ffe (DEFAULT_TABLE table=test-table [id=2289a581307c448aa55a912636dba6e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:43:49.517138 30548 tablet_service.cc:1467] Processing CreateTablet for tablet 10a913d045fa441c9b8c565335126ffe (DEFAULT_TABLE table=test-table [id=2289a581307c448aa55a912636dba6e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 08:43:49.518215 30414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10a913d045fa441c9b8c565335126ffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:49.518239 30548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10a913d045fa441c9b8c565335126ffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:49.518239 30683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10a913d045fa441c9b8c565335126ffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:49.524394 30769 tablet_bootstrap.cc:492] T 10a913d045fa441c9b8c565335126ffe P ff798db01ff643648882619575cc6721: Bootstrap starting.
I20260807 08:43:49.525707 30771 tablet_bootstrap.cc:492] T 10a913d045fa441c9b8c565335126ffe P badbdd915ad14779b91de3d8434d8848: Bootstrap starting.
I20260807 08:43:49.525902 30770 tablet_bootstrap.cc:492] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a: Bootstrap starting.
I20260807 08:43:49.526839 30769 tablet_bootstrap.cc:654] T 10a913d045fa441c9b8c565335126ffe P ff798db01ff643648882619575cc6721: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:49.527678 30769 log.cc:824] T 10a913d045fa441c9b8c565335126ffe P ff798db01ff643648882619575cc6721: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:49.527781 30771 tablet_bootstrap.cc:654] T 10a913d045fa441c9b8c565335126ffe P badbdd915ad14779b91de3d8434d8848: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:49.527832 30770 tablet_bootstrap.cc:654] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:49.528517 30771 log.cc:824] T 10a913d045fa441c9b8c565335126ffe P badbdd915ad14779b91de3d8434d8848: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:49.528699 30770 log.cc:824] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:49.530267 30769 tablet_bootstrap.cc:492] T 10a913d045fa441c9b8c565335126ffe P ff798db01ff643648882619575cc6721: No bootstrap required, opened a new log
I20260807 08:43:49.530476 30769 ts_tablet_manager.cc:1397] T 10a913d045fa441c9b8c565335126ffe P ff798db01ff643648882619575cc6721: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 08:43:49.530535 30771 tablet_bootstrap.cc:492] T 10a913d045fa441c9b8c565335126ffe P badbdd915ad14779b91de3d8434d8848: No bootstrap required, opened a new log
I20260807 08:43:49.530536 30770 tablet_bootstrap.cc:492] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a: No bootstrap required, opened a new log
I20260807 08:43:49.530721 30770 ts_tablet_manager.cc:1397] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 08:43:49.530721 30771 ts_tablet_manager.cc:1397] T 10a913d045fa441c9b8c565335126ffe P badbdd915ad14779b91de3d8434d8848: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 08:43:49.533653 30769 raft_consensus.cc:348] T 10a913d045fa441c9b8c565335126ffe P ff798db01ff643648882619575cc6721 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "badbdd915ad14779b91de3d8434d8848" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 42703 } } peers { permanent_uuid: "50d033b4c3854e7ca4ba1ad7772c632a" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 40023 } } peers { permanent_uuid: "ff798db01ff643648882619575cc6721" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39837 } }
I20260807 08:43:49.534009 30769 raft_consensus.cc:374] T 10a913d045fa441c9b8c565335126ffe P ff798db01ff643648882619575cc6721 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:49.534067 30769 raft_consensus.cc:729] T 10a913d045fa441c9b8c565335126ffe P ff798db01ff643648882619575cc6721 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff798db01ff643648882619575cc6721, State: Initialized, Role: FOLLOWER
I20260807 08:43:49.534500 30769 consensus_queue.cc:260] T 10a913d045fa441c9b8c565335126ffe P ff798db01ff643648882619575cc6721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "badbdd915ad14779b91de3d8434d8848" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 42703 } } peers { permanent_uuid: "50d033b4c3854e7ca4ba1ad7772c632a" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 40023 } } peers { permanent_uuid: "ff798db01ff643648882619575cc6721" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39837 } }
I20260807 08:43:49.534881 30771 raft_consensus.cc:348] T 10a913d045fa441c9b8c565335126ffe P badbdd915ad14779b91de3d8434d8848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "badbdd915ad14779b91de3d8434d8848" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 42703 } } peers { permanent_uuid: "50d033b4c3854e7ca4ba1ad7772c632a" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 40023 } } peers { permanent_uuid: "ff798db01ff643648882619575cc6721" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39837 } }
I20260807 08:43:49.534883 30770 raft_consensus.cc:348] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "badbdd915ad14779b91de3d8434d8848" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 42703 } } peers { permanent_uuid: "50d033b4c3854e7ca4ba1ad7772c632a" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 40023 } } peers { permanent_uuid: "ff798db01ff643648882619575cc6721" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39837 } }
I20260807 08:43:49.535145 30770 raft_consensus.cc:374] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:49.535145 30771 raft_consensus.cc:374] T 10a913d045fa441c9b8c565335126ffe P badbdd915ad14779b91de3d8434d8848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:49.535203 30770 raft_consensus.cc:729] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50d033b4c3854e7ca4ba1ad7772c632a, State: Initialized, Role: FOLLOWER
I20260807 08:43:49.535203 30771 raft_consensus.cc:729] T 10a913d045fa441c9b8c565335126ffe P badbdd915ad14779b91de3d8434d8848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: badbdd915ad14779b91de3d8434d8848, State: Initialized, Role: FOLLOWER
I20260807 08:43:49.535539 30769 ts_tablet_manager.cc:1428] T 10a913d045fa441c9b8c565335126ffe P ff798db01ff643648882619575cc6721: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 08:43:49.535596 30771 consensus_queue.cc:260] T 10a913d045fa441c9b8c565335126ffe P badbdd915ad14779b91de3d8434d8848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "badbdd915ad14779b91de3d8434d8848" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 42703 } } peers { permanent_uuid: "50d033b4c3854e7ca4ba1ad7772c632a" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 40023 } } peers { permanent_uuid: "ff798db01ff643648882619575cc6721" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39837 } }
I20260807 08:43:49.535599 30770 consensus_queue.cc:260] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "badbdd915ad14779b91de3d8434d8848" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 42703 } } peers { permanent_uuid: "50d033b4c3854e7ca4ba1ad7772c632a" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 40023 } } peers { permanent_uuid: "ff798db01ff643648882619575cc6721" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39837 } }
I20260807 08:43:49.535898 30482 heartbeater.cc:503] Master 127.8.208.254:46115 was elected leader, sending a full tablet report...
I20260807 08:43:49.536477 30771 ts_tablet_manager.cc:1428] T 10a913d045fa441c9b8c565335126ffe P badbdd915ad14779b91de3d8434d8848: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 08:43:49.536491 30770 ts_tablet_manager.cc:1428] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 08:43:49.536808 30751 heartbeater.cc:503] Master 127.8.208.254:46115 was elected leader, sending a full tablet report...
I20260807 08:43:49.537158 30617 heartbeater.cc:503] Master 127.8.208.254:46115 was elected leader, sending a full tablet report...
I20260807 08:43:49.556865 30776 raft_consensus.cc:482] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 08:43:49.557016 30776 raft_consensus.cc:504] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "badbdd915ad14779b91de3d8434d8848" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 42703 } } peers { permanent_uuid: "50d033b4c3854e7ca4ba1ad7772c632a" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 40023 } } peers { permanent_uuid: "ff798db01ff643648882619575cc6721" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39837 } }
I20260807 08:43:49.558003 30776 leader_election.cc:288] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers badbdd915ad14779b91de3d8434d8848 (127.8.208.195:42703), ff798db01ff643648882619575cc6721 (127.8.208.193:39837)
I20260807 08:43:49.561648 30778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:49.558231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:39837 (local address 127.8.208.194:42815)
0807 08:43:49.558572 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:49.558586 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:49.558686 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:49.558942 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:49.558944 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:49.558959 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:49.559097 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:49.559104 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.559802 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.559804 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:49.560560 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:49.560568 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.561248 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.561251 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:49.561380 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:49.561397 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 08:43:49.561455 (+ 58us) client_negotiation.cc:240] Negotiation successful
0807 08:43:49.561503 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":24,"thread_start_us":113,"threads_started":1}
I20260807 08:43:49.561836 30619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:49.558177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.195:42703 (local address 127.8.208.194:34299)
0807 08:43:49.558348 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:49.558362 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:43:49.558443 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:43:49.558771 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:43:49.558775 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:43:49.558796 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 08:43:49.558960 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:49.558970 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.559724 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.559729 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:49.560551 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:43:49.560561 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.561205 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.561209 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:43:49.561337 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:49.561425 (+ 88us) client_negotiation.cc:769] Sending connection context
0807 08:43:49.561630 (+ 205us) client_negotiation.cc:240] Negotiation successful
0807 08:43:49.561696 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"mutex_wait_us":54}
I20260807 08:43:49.561800 30768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:49.558297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:42815 (local address 127.8.208.193:39837)
0807 08:43:49.558406 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:49.558411 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:49.558696 (+ 285us) server_negotiation.cc:407] Connection header received
0807 08:43:49.558778 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:49.558781 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:49.558826 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:49.558916 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:49.559232 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.559694 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.560701 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.561090 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.561242 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:49.561311 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:49.561601 (+ 290us) server_negotiation.cc:299] Negotiation successful
0807 08:43:49.561679 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 08:43:49.561884 30765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:49.558259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.208.194:34299 (local address 127.8.208.195:42703)
0807 08:43:49.558392 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:49.558396 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:49.558411 (+ 15us) server_negotiation.cc:407] Connection header received
0807 08:43:49.558547 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:49.558550 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:49.558615 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:49.558679 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 08:43:49.559094 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.559616 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.560688 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.561080 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.561195 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:49.561253 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:49.561671 (+ 418us) server_negotiation.cc:299] Negotiation successful
0807 08:43:49.561760 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 08:43:49.562407 30705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10a913d045fa441c9b8c565335126ffe" candidate_uuid: "50d033b4c3854e7ca4ba1ad7772c632a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "badbdd915ad14779b91de3d8434d8848" is_pre_election: true
I20260807 08:43:49.562486 30434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10a913d045fa441c9b8c565335126ffe" candidate_uuid: "50d033b4c3854e7ca4ba1ad7772c632a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff798db01ff643648882619575cc6721" is_pre_election: true
I20260807 08:43:49.562682 30705 raft_consensus.cc:2454] T 10a913d045fa441c9b8c565335126ffe P badbdd915ad14779b91de3d8434d8848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50d033b4c3854e7ca4ba1ad7772c632a in term 0.
I20260807 08:43:49.562783 30434 raft_consensus.cc:2454] T 10a913d045fa441c9b8c565335126ffe P ff798db01ff643648882619575cc6721 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50d033b4c3854e7ca4ba1ad7772c632a in term 0.
I20260807 08:43:49.563176 30500 leader_election.cc:302] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 50d033b4c3854e7ca4ba1ad7772c632a, badbdd915ad14779b91de3d8434d8848, ff798db01ff643648882619575cc6721; no voters:
I20260807 08:43:49.563433 30776 raft_consensus.cc:2781] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 08:43:49.563520 30776 raft_consensus.cc:482] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 08:43:49.563572 30776 raft_consensus.cc:3037] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:49.564445 30776 raft_consensus.cc:504] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "badbdd915ad14779b91de3d8434d8848" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 42703 } } peers { permanent_uuid: "50d033b4c3854e7ca4ba1ad7772c632a" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 40023 } } peers { permanent_uuid: "ff798db01ff643648882619575cc6721" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39837 } }
I20260807 08:43:49.564757 30776 leader_election.cc:288] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a [CANDIDATE]: Term 1 election: Requested vote from peers badbdd915ad14779b91de3d8434d8848 (127.8.208.195:42703), ff798db01ff643648882619575cc6721 (127.8.208.193:39837)
I20260807 08:43:49.565068 30705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10a913d045fa441c9b8c565335126ffe" candidate_uuid: "50d033b4c3854e7ca4ba1ad7772c632a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "badbdd915ad14779b91de3d8434d8848"
I20260807 08:43:49.565107 30434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10a913d045fa441c9b8c565335126ffe" candidate_uuid: "50d033b4c3854e7ca4ba1ad7772c632a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff798db01ff643648882619575cc6721"
I20260807 08:43:49.565187 30705 raft_consensus.cc:3037] T 10a913d045fa441c9b8c565335126ffe P badbdd915ad14779b91de3d8434d8848 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:49.565220 30434 raft_consensus.cc:3037] T 10a913d045fa441c9b8c565335126ffe P ff798db01ff643648882619575cc6721 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:49.566217 30705 raft_consensus.cc:2454] T 10a913d045fa441c9b8c565335126ffe P badbdd915ad14779b91de3d8434d8848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50d033b4c3854e7ca4ba1ad7772c632a in term 1.
I20260807 08:43:49.566362 30434 raft_consensus.cc:2454] T 10a913d045fa441c9b8c565335126ffe P ff798db01ff643648882619575cc6721 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50d033b4c3854e7ca4ba1ad7772c632a in term 1.
I20260807 08:43:49.566537 30500 leader_election.cc:302] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50d033b4c3854e7ca4ba1ad7772c632a, badbdd915ad14779b91de3d8434d8848; no voters:
I20260807 08:43:49.566708 30776 raft_consensus.cc:2781] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:43:49.566900 30776 raft_consensus.cc:686] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a [term 1 LEADER]: Becoming Leader. State: Replica: 50d033b4c3854e7ca4ba1ad7772c632a, State: Running, Role: LEADER
I20260807 08:43:49.567215 30776 consensus_queue.cc:237] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "badbdd915ad14779b91de3d8434d8848" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 42703 } } peers { permanent_uuid: "50d033b4c3854e7ca4ba1ad7772c632a" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 40023 } } peers { permanent_uuid: "ff798db01ff643648882619575cc6721" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39837 } }
I20260807 08:43:49.570017 30285 catalog_manager.cc:5495] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a reported cstate change: term changed from 0 to 1, leader changed from <none> to 50d033b4c3854e7ca4ba1ad7772c632a (127.8.208.194). New cstate: current_term: 1 leader_uuid: "50d033b4c3854e7ca4ba1ad7772c632a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "badbdd915ad14779b91de3d8434d8848" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 42703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50d033b4c3854e7ca4ba1ad7772c632a" member_type: VOTER last_known_addr { host: "127.8.208.194" port: 40023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff798db01ff643648882619575cc6721" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39837 } health_report { overall_health: UNKNOWN } } }
I20260807 08:43:49.590834 30767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:49.587641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55780 (local address 127.8.208.194:40023)
0807 08:43:49.587761 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:49.587764 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:49.587776 (+ 12us) server_negotiation.cc:407] Connection header received
0807 08:43:49.587943 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:49.587945 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:49.587990 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:49.588079 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:43:49.588275 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.588692 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.589473 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:49.589660 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:49.589731 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:49.590156 (+ 425us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:43:49.590523 (+ 367us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:43:49.590611 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:49.590705 (+ 94us) server_negotiation.cc:299] Negotiation successful
0807 08:43:49.590743 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 08:43:49.595901 30434 raft_consensus.cc:1261] T 10a913d045fa441c9b8c565335126ffe P ff798db01ff643648882619575cc6721 [term 1 FOLLOWER]: Refusing update from remote peer 50d033b4c3854e7ca4ba1ad7772c632a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:43:49.595903 30705 raft_consensus.cc:1261] T 10a913d045fa441c9b8c565335126ffe P badbdd915ad14779b91de3d8434d8848 [term 1 FOLLOWER]: Refusing update from remote peer 50d033b4c3854e7ca4ba1ad7772c632a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:43:49.596565 30779 consensus_queue.cc:1035] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a [LEADER]: Connected to new peer: Peer: permanent_uuid: "badbdd915ad14779b91de3d8434d8848" member_type: VOTER last_known_addr { host: "127.8.208.195" port: 42703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:43:49.596766 30776 consensus_queue.cc:1035] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff798db01ff643648882619575cc6721" member_type: VOTER last_known_addr { host: "127.8.208.193" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:43:49.602427 30782 mvcc.cc:205] Tried to move back new op lower bound from 7315833772418469888 to 7315833772309889024. Current Snapshot: MvccSnapshot[applied={T|T < 7315833772418469888}]
I20260807 08:43:49.603559 30784 mvcc.cc:205] Tried to move back new op lower bound from 7315833772418469888 to 7315833772309889024. Current Snapshot: MvccSnapshot[applied={T|T < 7315833772418469888}]
I20260807 08:43:49.604867 30783 mvcc.cc:205] Tried to move back new op lower bound from 7315833772418469888 to 7315833772309889024. Current Snapshot: MvccSnapshot[applied={T|T < 7315833772418469888}]
I20260807 08:43:49.612938 30285 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60488:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:43:49.613061 30285 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60488:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 08:43:49.615298 30285 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c528382bc15d411a846cea9337f2b50f: Sending DeleteTablet for 3 replicas of tablet 10a913d045fa441c9b8c565335126ffe
I20260807 08:43:49.615989 30683 tablet_service.cc:1514] Processing DeleteTablet for tablet 10a913d045fa441c9b8c565335126ffe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:43:49 UTC) from {username='slave'} at 127.0.0.1:33180
I20260807 08:43:49.616065 30548 tablet_service.cc:1514] Processing DeleteTablet for tablet 10a913d045fa441c9b8c565335126ffe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:43:49 UTC) from {username='slave'} at 127.0.0.1:55774
I20260807 08:43:49.616413 30414 tablet_service.cc:1514] Processing DeleteTablet for tablet 10a913d045fa441c9b8c565335126ffe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 08:43:49 UTC) from {username='slave'} at 127.0.0.1:35686
I20260807 08:43:49.616597 30792 tablet_replica.cc:330] T 10a913d045fa441c9b8c565335126ffe P badbdd915ad14779b91de3d8434d8848: stopping tablet replica
I20260807 08:43:49.616889 30793 tablet_replica.cc:330] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a: stopping tablet replica
I20260807 08:43:49.616902 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 30349
I20260807 08:43:49.618546 30792 raft_consensus.cc:2229] T 10a913d045fa441c9b8c565335126ffe P badbdd915ad14779b91de3d8434d8848 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 08:43:49.618837 30793 raft_consensus.cc:2229] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a [term 1 LEADER]: Raft consensus shutting down.
I20260807 08:43:49.618901 30792 raft_consensus.cc:2258] T 10a913d045fa441c9b8c565335126ffe P badbdd915ad14779b91de3d8434d8848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:43:49.619284 30793 raft_consensus.cc:2258] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 08:43:49.620415 30792 ts_tablet_manager.cc:1905] T 10a913d045fa441c9b8c565335126ffe P badbdd915ad14779b91de3d8434d8848: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:43:49.620664 30793 ts_tablet_manager.cc:1905] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 08:43:49.623286 30792 ts_tablet_manager.cc:1918] T 10a913d045fa441c9b8c565335126ffe P badbdd915ad14779b91de3d8434d8848: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:43:49.623446 30792 log.cc:1196] T 10a913d045fa441c9b8c565335126ffe P badbdd915ad14779b91de3d8434d8848: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-2/wal/wals/10a913d045fa441c9b8c565335126ffe
I20260807 08:43:49.623785 30792 ts_tablet_manager.cc:1939] T 10a913d045fa441c9b8c565335126ffe P badbdd915ad14779b91de3d8434d8848: Deleting consensus metadata
I20260807 08:43:49.624127 30793 ts_tablet_manager.cc:1918] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 08:43:49.624284 30793 log.cc:1196] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a: Deleting WAL directory at /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786091987266300-9027-0/minicluster-data/ts-1/wal/wals/10a913d045fa441c9b8c565335126ffe
I20260807 08:43:49.624650 30793 ts_tablet_manager.cc:1939] T 10a913d045fa441c9b8c565335126ffe P 50d033b4c3854e7ca4ba1ad7772c632a: Deleting consensus metadata
I20260807 08:43:49.624979 30268 catalog_manager.cc:4841] TS badbdd915ad14779b91de3d8434d8848 (127.8.208.195:42703): tablet 10a913d045fa441c9b8c565335126ffe (table test-table [id=2289a581307c448aa55a912636dba6e6]) successfully deleted
I20260807 08:43:49.626251 30269 catalog_manager.cc:4841] TS 50d033b4c3854e7ca4ba1ad7772c632a (127.8.208.194:40023): tablet 10a913d045fa441c9b8c565335126ffe (table test-table [id=2289a581307c448aa55a912636dba6e6]) successfully deleted
W20260807 08:43:49.626821 30271 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.208.193:39837 (error 108)
I20260807 08:43:49.627056 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 30485
I20260807 08:43:49.628311 30763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:49.628012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.193:39837 (local address 127.0.0.1:35690)
0807 08:43:49.628141 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 08:43:49.628218 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.193:39837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260807 08:43:49.628471 30271 catalog_manager.cc:4584] TS ff798db01ff643648882619575cc6721 (127.8.208.193:39837): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 10a913d045fa441c9b8c565335126ffe: Network error: Client connection negotiation failed: client connection to 127.8.208.193:39837: connect: Connection refused (error 111)
I20260807 08:43:49.633797 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 30620
I20260807 08:43:49.639778 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 30253
2026-08-07T08:43:49Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (985 ms)
[----------] 6 tests from EncryptionPolicyTest (9960 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:43:49 dist-test-slave-6nmv krb5kdc[30798](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:43:49 dist-test-slave-6nmv krb5kdc[30798](info): set up 2 sockets
Aug 07 08:43:49 dist-test-slave-6nmv krb5kdc[30798](info): commencing operation
krb5kdc: starting...
W20260807 08:43:50.694701 9027 mini_kdc.cc:121] Time spent starting KDC: real 1.033s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:43:50 dist-test-slave-6nmv krb5kdc[30798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092230, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:43:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:43:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 08:43:50.810938 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39637
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39637
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:43:50.916405 30811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:50.916630 30811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:50.916671 30811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:50.920455 30811 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:43:50.920504 30811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:50.920521 30811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:50.920536 30811 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:43:50.920588 30811 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:43:50.925120 30811 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39637
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39637
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30811
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:50.926124 30811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:50.927114 30811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:50.935038 30819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:50.935017 30816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:50.935115 30811 server_base.cc:1034] running on GCE node
W20260807 08:43:50.935034 30817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:50.935860 30811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:50.936908 30811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:50.938097 30811 hybrid_clock.cc:648] HybridClock initialized: now 1786092230938080 us; error 29 us; skew 500 ppm
Aug 07 08:43:50 dist-test-slave-6nmv krb5kdc[30798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092230, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:50.940686 30811 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 08:43:50.941498 30811 webserver.cc:460] Webserver started at http://127.0.0.1:40841/ using document root <none> and password file <none>
I20260807 08:43:50.942106 30811 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:50.942198 30811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:50.942426 30811 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:50.944303 30811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "c5194b6600d140bf8e3dacb6aba95dcd"
format_stamp: "Formatted at 2026-08-07 08:43:50 on dist-test-slave-6nmv"
server_key: "baebbc00f7d0bdf62812e6dc31909c97"
server_key_iv: "d226412b76fa6b1feda1f6c17c86ce9b"
server_key_version: "encryptionkey@0"
I20260807 08:43:50.944849 30811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "c5194b6600d140bf8e3dacb6aba95dcd"
format_stamp: "Formatted at 2026-08-07 08:43:50 on dist-test-slave-6nmv"
server_key: "baebbc00f7d0bdf62812e6dc31909c97"
server_key_iv: "d226412b76fa6b1feda1f6c17c86ce9b"
server_key_version: "encryptionkey@0"
I20260807 08:43:50.948441 30811 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260807 08:43:50.950901 30826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:50.952049 30811 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:43:50.952183 30811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "c5194b6600d140bf8e3dacb6aba95dcd"
format_stamp: "Formatted at 2026-08-07 08:43:50 on dist-test-slave-6nmv"
server_key: "baebbc00f7d0bdf62812e6dc31909c97"
server_key_iv: "d226412b76fa6b1feda1f6c17c86ce9b"
server_key_version: "encryptionkey@0"
I20260807 08:43:50.952288 30811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:50.971171 30811 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:50.973888 30811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:50.974071 30811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:50.980535 30811 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39637
I20260807 08:43:50.980602 30881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39637 every 8 connection(s)
I20260807 08:43:50.981351 30811 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:43:50.983899 30882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:50.986158 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 30811
I20260807 08:43:50.986331 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:43:50.986639 9027 external_mini_cluster.cc:1428] Setting key 90c1962addfa97dc0238ccf61bbab6bd
I20260807 08:43:50.989248 30882 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5194b6600d140bf8e3dacb6aba95dcd: Bootstrap starting.
I20260807 08:43:50.991573 30882 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5194b6600d140bf8e3dacb6aba95dcd: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:50.992456 30882 log.cc:824] T 00000000000000000000000000000000 P c5194b6600d140bf8e3dacb6aba95dcd: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:50.994280 30882 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5194b6600d140bf8e3dacb6aba95dcd: No bootstrap required, opened a new log
Aug 07 08:43:50 dist-test-slave-6nmv krb5kdc[30798](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092230, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 08:43:50.997057 30882 raft_consensus.cc:348] T 00000000000000000000000000000000 P c5194b6600d140bf8e3dacb6aba95dcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5194b6600d140bf8e3dacb6aba95dcd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39637 } }
I20260807 08:43:50.997300 30882 raft_consensus.cc:374] T 00000000000000000000000000000000 P c5194b6600d140bf8e3dacb6aba95dcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:50.997413 30882 raft_consensus.cc:729] T 00000000000000000000000000000000 P c5194b6600d140bf8e3dacb6aba95dcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5194b6600d140bf8e3dacb6aba95dcd, State: Initialized, Role: FOLLOWER
I20260807 08:43:50.997951 30882 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5194b6600d140bf8e3dacb6aba95dcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5194b6600d140bf8e3dacb6aba95dcd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39637 } }
I20260807 08:43:50.998124 30882 raft_consensus.cc:388] T 00000000000000000000000000000000 P c5194b6600d140bf8e3dacb6aba95dcd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:43:50.998206 30882 raft_consensus.cc:482] T 00000000000000000000000000000000 P c5194b6600d140bf8e3dacb6aba95dcd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:43:50.998318 30882 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c5194b6600d140bf8e3dacb6aba95dcd [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:50.999033 30882 raft_consensus.cc:504] T 00000000000000000000000000000000 P c5194b6600d140bf8e3dacb6aba95dcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5194b6600d140bf8e3dacb6aba95dcd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39637 } }
I20260807 08:43:50.999353 30882 leader_election.cc:302] T 00000000000000000000000000000000 P c5194b6600d140bf8e3dacb6aba95dcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5194b6600d140bf8e3dacb6aba95dcd; no voters:
I20260807 08:43:50.999655 30882 leader_election.cc:288] T 00000000000000000000000000000000 P c5194b6600d140bf8e3dacb6aba95dcd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:43:50.999717 30887 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c5194b6600d140bf8e3dacb6aba95dcd [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:43:50.999904 30887 raft_consensus.cc:686] T 00000000000000000000000000000000 P c5194b6600d140bf8e3dacb6aba95dcd [term 1 LEADER]: Becoming Leader. State: Replica: c5194b6600d140bf8e3dacb6aba95dcd, State: Running, Role: LEADER
I20260807 08:43:51.000213 30887 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5194b6600d140bf8e3dacb6aba95dcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5194b6600d140bf8e3dacb6aba95dcd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39637 } }
I20260807 08:43:51.000762 30882 sys_catalog.cc:564] T 00000000000000000000000000000000 P c5194b6600d140bf8e3dacb6aba95dcd [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:43:51.001906 30888 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5194b6600d140bf8e3dacb6aba95dcd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c5194b6600d140bf8e3dacb6aba95dcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5194b6600d140bf8e3dacb6aba95dcd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39637 } } }
I20260807 08:43:51.002017 30888 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5194b6600d140bf8e3dacb6aba95dcd [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:51.002169 30885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:50.987936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58201 (local address 127.0.0.1:39637)
0807 08:43:50.988321 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:50.988336 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:50.988376 (+ 40us) server_negotiation.cc:407] Connection header received
0807 08:43:50.988960 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:50.988973 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:50.989262 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:50.989559 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:50.990446 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:50.991315 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:50.992610 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:50.993112 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:50.993292 (+ 180us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:50.995918 (+ 2626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:50.995924 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:50.995935 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:50.995962 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:50.998469 (+ 2507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:50.999001 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:50.999007 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:50.999013 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:50.999152 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:50.999515 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:50.999519 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:50.999521 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:51.000017 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:51.000809 (+ 792us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:51.001003 (+ 194us) server_negotiation.cc:299] Negotiation successful
0807 08:43:51.001227 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":132,"threads_started":1}
I20260807 08:43:51.001793 30889 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5194b6600d140bf8e3dacb6aba95dcd [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5194b6600d140bf8e3dacb6aba95dcd. Latest consensus state: current_term: 1 leader_uuid: "c5194b6600d140bf8e3dacb6aba95dcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5194b6600d140bf8e3dacb6aba95dcd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39637 } } }
I20260807 08:43:51.002514 30889 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5194b6600d140bf8e3dacb6aba95dcd [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:51.005183 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260807 08:43:51.005522 30902 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c5194b6600d140bf8e3dacb6aba95dcd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:43:51.005625 30902 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:43:51.005743 30896 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:43:51.006542 30896 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:43:51.014243 30896 catalog_manager.cc:1347] Generated new cluster ID: 05b9bcc019e9477f8400a840878c0c3c
I20260807 08:43:51.014340 30896 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:43:51.016439 30885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:51.007490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34025 (local address 127.0.0.1:39637)
0807 08:43:51.007595 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:51.007599 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:51.007875 (+ 276us) server_negotiation.cc:407] Connection header received
0807 08:43:51.007976 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:51.007979 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:51.008018 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:51.008106 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:51.008848 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:51.009702 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:51.010548 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:51.010787 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:51.010917 (+ 130us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:51.012593 (+ 1676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:51.012597 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:51.012602 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:51.012629 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:51.014474 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:51.015006 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:51.015010 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:51.015012 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:51.015104 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:51.015466 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:51.015469 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:51.015471 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:51.015663 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:51.015844 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:51.016142 (+ 298us) server_negotiation.cc:299] Negotiation successful
0807 08:43:51.016247 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 08:43:51.023818 30896 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:43:51.024699 30896 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:43:51.032760 30896 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c5194b6600d140bf8e3dacb6aba95dcd: Generated new TSK 0
I20260807 08:43:51.033375 30896 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:43:51.039383 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 30811
W20260807 08:43:51.046773 30796 connection.cc:535] client connection to 127.0.0.1:39637 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39637): Connection reset by peer (error 104)
2026-08-07T08:43:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1399 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:43:51 dist-test-slave-6nmv krb5kdc[30913](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:43:51 dist-test-slave-6nmv krb5kdc[30913](info): set up 2 sockets
Aug 07 08:43:51 dist-test-slave-6nmv krb5kdc[30913](info): commencing operation
krb5kdc: starting...
W20260807 08:43:52.054893 9027 mini_kdc.cc:121] Time spent starting KDC: real 0.994s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:43:52 dist-test-slave-6nmv krb5kdc[30913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092232, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:43:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:43:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 08:43:52.178839 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44341
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44341
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:43:52.288697 30926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:52.288942 30926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:52.289034 30926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:52.292769 30926 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:43:52.292855 30926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:52.292902 30926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:52.292939 30926 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:43:52.292995 30926 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:43:52.298059 30926 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44341
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44341
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30926
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:52.299049 30926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:52.299984 30926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:52.308372 30931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:52.308434 30934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:52.308502 30926 server_base.cc:1034] running on GCE node
W20260807 08:43:52.308435 30932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:52.309158 30926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:52.310201 30926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:52.311400 30926 hybrid_clock.cc:648] HybridClock initialized: now 1786092232311389 us; error 40 us; skew 500 ppm
Aug 07 08:43:52 dist-test-slave-6nmv krb5kdc[30913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092232, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:52.314455 30926 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 08:43:52.315266 30926 webserver.cc:460] Webserver started at http://127.0.0.1:40283/ using document root <none> and password file <none>
I20260807 08:43:52.315794 30926 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:52.315860 30926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:52.316133 30926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:52.318173 30926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "b05674e61b18417bbe658781fa5a339f"
format_stamp: "Formatted at 2026-08-07 08:43:52 on dist-test-slave-6nmv"
server_key: "6764720117083f3b83a8df3c3311878e"
server_key_iv: "2ab2dae934c2b959215c7b239333b4d9"
server_key_version: "encryptionkey@0"
I20260807 08:43:52.318742 30926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "b05674e61b18417bbe658781fa5a339f"
format_stamp: "Formatted at 2026-08-07 08:43:52 on dist-test-slave-6nmv"
server_key: "6764720117083f3b83a8df3c3311878e"
server_key_iv: "2ab2dae934c2b959215c7b239333b4d9"
server_key_version: "encryptionkey@0"
I20260807 08:43:52.322268 30926 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 08:43:52.324539 30942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:52.325713 30926 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:43:52.325850 30926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "b05674e61b18417bbe658781fa5a339f"
format_stamp: "Formatted at 2026-08-07 08:43:52 on dist-test-slave-6nmv"
server_key: "6764720117083f3b83a8df3c3311878e"
server_key_iv: "2ab2dae934c2b959215c7b239333b4d9"
server_key_version: "encryptionkey@0"
I20260807 08:43:52.325989 30926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:52.349736 30926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:52.352490 30926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:52.352690 30926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:52.359416 30926 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44341
I20260807 08:43:52.359447 30995 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44341 every 8 connection(s)
I20260807 08:43:52.360301 30926 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:43:52.362905 30996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:52.366917 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 30926
I20260807 08:43:52.367070 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:43:52.367360 9027 external_mini_cluster.cc:1428] Setting key 4d4e582b3d221511a982f516193bada4
I20260807 08:43:52.368557 30996 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b05674e61b18417bbe658781fa5a339f: Bootstrap starting.
I20260807 08:43:52.370591 30996 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b05674e61b18417bbe658781fa5a339f: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:52.371248 30996 log.cc:824] T 00000000000000000000000000000000 P b05674e61b18417bbe658781fa5a339f: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:52.372977 30996 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b05674e61b18417bbe658781fa5a339f: No bootstrap required, opened a new log
I20260807 08:43:52.375626 30999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:52.368665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38769 (local address 127.0.0.1:44341)
0807 08:43:52.369042 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:52.369055 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:52.369088 (+ 33us) server_negotiation.cc:407] Connection header received
0807 08:43:52.369640 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:52.369654 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:52.370000 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:52.370285 (+ 285us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:52.370668 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:52.371701 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:52.372568 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:52.373022 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:52.373208 (+ 186us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:52.374086 (+ 878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:52.374091 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:52.374101 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:43:52.374501 (+ 400us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:52.374549 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:43:52.374570 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:52.374709 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:52.374853 (+ 144us) server_negotiation.cc:299] Negotiation successful
0807 08:43:52.374987 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":107,"threads_started":1}
I20260807 08:43:52.376421 30996 raft_consensus.cc:348] T 00000000000000000000000000000000 P b05674e61b18417bbe658781fa5a339f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b05674e61b18417bbe658781fa5a339f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44341 } }
I20260807 08:43:52.376689 30996 raft_consensus.cc:374] T 00000000000000000000000000000000 P b05674e61b18417bbe658781fa5a339f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:52.376747 30996 raft_consensus.cc:729] T 00000000000000000000000000000000 P b05674e61b18417bbe658781fa5a339f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b05674e61b18417bbe658781fa5a339f, State: Initialized, Role: FOLLOWER
I20260807 08:43:52.377192 30996 consensus_queue.cc:260] T 00000000000000000000000000000000 P b05674e61b18417bbe658781fa5a339f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b05674e61b18417bbe658781fa5a339f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44341 } }
I20260807 08:43:52.377354 30996 raft_consensus.cc:388] T 00000000000000000000000000000000 P b05674e61b18417bbe658781fa5a339f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:43:52.377425 30996 raft_consensus.cc:482] T 00000000000000000000000000000000 P b05674e61b18417bbe658781fa5a339f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:43:52.377508 30996 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b05674e61b18417bbe658781fa5a339f [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:52.378417 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 08:43:52.378473 30996 raft_consensus.cc:504] T 00000000000000000000000000000000 P b05674e61b18417bbe658781fa5a339f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b05674e61b18417bbe658781fa5a339f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44341 } }
I20260807 08:43:52.378767 30996 leader_election.cc:302] T 00000000000000000000000000000000 P b05674e61b18417bbe658781fa5a339f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b05674e61b18417bbe658781fa5a339f; no voters:
I20260807 08:43:52.379076 30996 leader_election.cc:288] T 00000000000000000000000000000000 P b05674e61b18417bbe658781fa5a339f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:43:52.379181 31001 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b05674e61b18417bbe658781fa5a339f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:43:52.379400 31001 raft_consensus.cc:686] T 00000000000000000000000000000000 P b05674e61b18417bbe658781fa5a339f [term 1 LEADER]: Becoming Leader. State: Replica: b05674e61b18417bbe658781fa5a339f, State: Running, Role: LEADER
I20260807 08:43:52.379693 31001 consensus_queue.cc:237] T 00000000000000000000000000000000 P b05674e61b18417bbe658781fa5a339f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b05674e61b18417bbe658781fa5a339f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44341 } }
I20260807 08:43:52.380224 30996 sys_catalog.cc:564] T 00000000000000000000000000000000 P b05674e61b18417bbe658781fa5a339f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:43:52.381423 31002 sys_catalog.cc:455] T 00000000000000000000000000000000 P b05674e61b18417bbe658781fa5a339f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b05674e61b18417bbe658781fa5a339f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b05674e61b18417bbe658781fa5a339f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44341 } } }
I20260807 08:43:52.381423 31003 sys_catalog.cc:455] T 00000000000000000000000000000000 P b05674e61b18417bbe658781fa5a339f [sys.catalog]: SysCatalogTable state changed. Reason: New leader b05674e61b18417bbe658781fa5a339f. Latest consensus state: current_term: 1 leader_uuid: "b05674e61b18417bbe658781fa5a339f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b05674e61b18417bbe658781fa5a339f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44341 } } }
I20260807 08:43:52.381574 31002 sys_catalog.cc:458] T 00000000000000000000000000000000 P b05674e61b18417bbe658781fa5a339f [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:52.381575 31003 sys_catalog.cc:458] T 00000000000000000000000000000000 P b05674e61b18417bbe658781fa5a339f [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:52.381947 31015 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:43:52.384613 31015 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:43:52.386583 30999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:52.380512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57771 (local address 127.0.0.1:44341)
0807 08:43:52.380599 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:52.380602 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:52.380867 (+ 265us) server_negotiation.cc:407] Connection header received
0807 08:43:52.382474 (+ 1607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:52.382480 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:52.382532 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:52.382619 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:52.383045 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:52.383720 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:52.384737 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:52.385023 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:52.385116 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:52.386091 (+ 975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:52.386096 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:52.386099 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:43:52.386111 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:52.386138 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:43:52.386151 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:52.386247 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:52.386423 (+ 176us) server_negotiation.cc:299] Negotiation successful
0807 08:43:52.386457 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 08:43:52.390130 31015 catalog_manager.cc:1347] Generated new cluster ID: 3c97f9125e474272a949524e5811674d
I20260807 08:43:52.390187 31015 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:43:52.416596 31015 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:43:52.417598 31015 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:43:52.426783 31015 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b05674e61b18417bbe658781fa5a339f: Generated new TSK 0
I20260807 08:43:52.427428 31015 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:43:52.439595 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 30926
W20260807 08:43:52.445960 30911 connection.cc:535] client connection to 127.0.0.1:44341 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44341): Connection reset by peer (error 104)
2026-08-07T08:43:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1399 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:43:52 dist-test-slave-6nmv krb5kdc[31027](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:43:52 dist-test-slave-6nmv krb5kdc[31027](info): set up 2 sockets
Aug 07 08:43:52 dist-test-slave-6nmv krb5kdc[31027](info): commencing operation
krb5kdc: starting...
W20260807 08:43:53.462782 9027 mini_kdc.cc:121] Time spent starting KDC: real 1.003s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:43:53 dist-test-slave-6nmv krb5kdc[31027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092233, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:43:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:43:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 08:43:53.578498 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45707
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45707
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:43:53.678506 31041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:53.678720 31041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:53.678781 31041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:53.682209 31041 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:43:53.682272 31041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:53.682313 31041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:53.682361 31041 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:43:53.682394 31041 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:43:53.686877 31041 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45707
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31041
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:53.687726 31041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:53.688583 31041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 08:43:53.696476 31041 server_base.cc:1034] running on GCE node
W20260807 08:43:53.696421 31049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:53.696421 31046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:53.696386 31047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:53.697156 31041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:53.698243 31041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:53.699415 31041 hybrid_clock.cc:648] HybridClock initialized: now 1786092233699397 us; error 37 us; skew 500 ppm
Aug 07 08:43:53 dist-test-slave-6nmv krb5kdc[31027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092233, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:53.701926 31041 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 08:43:53.702714 31041 webserver.cc:460] Webserver started at http://127.0.0.1:44691/ using document root <none> and password file <none>
I20260807 08:43:53.703187 31041 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:53.703274 31041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:53.703505 31041 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:53.705355 31041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "e4d0805e23fc462782498fcc681aee28"
format_stamp: "Formatted at 2026-08-07 08:43:53 on dist-test-slave-6nmv"
server_key: "736bacdfc07cac231b934a5ee8b8062f"
server_key_iv: "bf703bf79ff01722b18b4b42625414e5"
server_key_version: "encryptionkey@0"
I20260807 08:43:53.705926 31041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "e4d0805e23fc462782498fcc681aee28"
format_stamp: "Formatted at 2026-08-07 08:43:53 on dist-test-slave-6nmv"
server_key: "736bacdfc07cac231b934a5ee8b8062f"
server_key_iv: "bf703bf79ff01722b18b4b42625414e5"
server_key_version: "encryptionkey@0"
I20260807 08:43:53.709321 31041 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 08:43:53.711548 31056 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:53.712662 31041 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 08:43:53.712797 31041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "e4d0805e23fc462782498fcc681aee28"
format_stamp: "Formatted at 2026-08-07 08:43:53 on dist-test-slave-6nmv"
server_key: "736bacdfc07cac231b934a5ee8b8062f"
server_key_iv: "bf703bf79ff01722b18b4b42625414e5"
server_key_version: "encryptionkey@0"
I20260807 08:43:53.712910 31041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:53.717048 31041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:53.719830 31041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:53.720016 31041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:53.726629 31041 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45707
I20260807 08:43:53.726634 31110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45707 every 8 connection(s)
I20260807 08:43:53.727464 31041 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:43:53.730057 31111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:53.733505 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 31041
I20260807 08:43:53.733644 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:43:53.733953 9027 external_mini_cluster.cc:1428] Setting key 594186f5ea56860931b96074c2922c05
I20260807 08:43:53.735369 31111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4d0805e23fc462782498fcc681aee28: Bootstrap starting.
I20260807 08:43:53.738095 31111 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e4d0805e23fc462782498fcc681aee28: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:53.738942 31111 log.cc:824] T 00000000000000000000000000000000 P e4d0805e23fc462782498fcc681aee28: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:53.739385 31114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:53.735321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48049 (local address 127.0.0.1:45707)
0807 08:43:53.735753 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:53.735770 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:53.735810 (+ 40us) server_negotiation.cc:407] Connection header received
0807 08:43:53.736640 (+ 830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:53.736664 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:53.737001 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:53.737338 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:53.738055 (+ 717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:53.738062 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:53.738077 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:43:53.738089 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:53.738150 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:43:53.738176 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:53.738294 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:53.738431 (+ 137us) server_negotiation.cc:299] Negotiation successful
0807 08:43:53.738567 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":140,"threads_started":1}
I20260807 08:43:53.741873 31111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4d0805e23fc462782498fcc681aee28: No bootstrap required, opened a new log
I20260807 08:43:53.742233 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 08:43:53.745761 31114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:53.744196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57201 (local address 127.0.0.1:45707)
0807 08:43:53.744310 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:53.744315 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:53.744499 (+ 184us) server_negotiation.cc:407] Connection header received
0807 08:43:53.744605 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:53.744608 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:53.744640 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:53.744719 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:53.745380 (+ 661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:53.745383 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:53.745386 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:43:53.745397 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:53.745421 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:43:53.745433 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:53.745523 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:53.745606 (+ 83us) server_negotiation.cc:299] Negotiation successful
0807 08:43:53.745639 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 08:43:53.745564 31111 raft_consensus.cc:348] T 00000000000000000000000000000000 P e4d0805e23fc462782498fcc681aee28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d0805e23fc462782498fcc681aee28" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45707 } }
I20260807 08:43:53.745914 31111 raft_consensus.cc:374] T 00000000000000000000000000000000 P e4d0805e23fc462782498fcc681aee28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:53.745995 31111 raft_consensus.cc:729] T 00000000000000000000000000000000 P e4d0805e23fc462782498fcc681aee28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4d0805e23fc462782498fcc681aee28, State: Initialized, Role: FOLLOWER
I20260807 08:43:53.746428 31111 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4d0805e23fc462782498fcc681aee28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d0805e23fc462782498fcc681aee28" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45707 } }
I20260807 08:43:53.746558 31111 raft_consensus.cc:388] T 00000000000000000000000000000000 P e4d0805e23fc462782498fcc681aee28 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:43:53.746654 31111 raft_consensus.cc:482] T 00000000000000000000000000000000 P e4d0805e23fc462782498fcc681aee28 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:43:53.746793 31111 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e4d0805e23fc462782498fcc681aee28 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:53.747627 31111 raft_consensus.cc:504] T 00000000000000000000000000000000 P e4d0805e23fc462782498fcc681aee28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d0805e23fc462782498fcc681aee28" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45707 } }
I20260807 08:43:53.747915 31111 leader_election.cc:302] T 00000000000000000000000000000000 P e4d0805e23fc462782498fcc681aee28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4d0805e23fc462782498fcc681aee28; no voters:
I20260807 08:43:53.748154 31111 leader_election.cc:288] T 00000000000000000000000000000000 P e4d0805e23fc462782498fcc681aee28 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:43:53.748260 31121 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e4d0805e23fc462782498fcc681aee28 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:43:53.748468 31121 raft_consensus.cc:686] T 00000000000000000000000000000000 P e4d0805e23fc462782498fcc681aee28 [term 1 LEADER]: Becoming Leader. State: Replica: e4d0805e23fc462782498fcc681aee28, State: Running, Role: LEADER
I20260807 08:43:53.748780 31121 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4d0805e23fc462782498fcc681aee28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d0805e23fc462782498fcc681aee28" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45707 } }
I20260807 08:43:53.749289 31111 sys_catalog.cc:564] T 00000000000000000000000000000000 P e4d0805e23fc462782498fcc681aee28 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:43:53.750391 31124 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4d0805e23fc462782498fcc681aee28 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4d0805e23fc462782498fcc681aee28. Latest consensus state: current_term: 1 leader_uuid: "e4d0805e23fc462782498fcc681aee28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d0805e23fc462782498fcc681aee28" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45707 } } }
I20260807 08:43:53.750447 31122 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4d0805e23fc462782498fcc681aee28 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e4d0805e23fc462782498fcc681aee28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d0805e23fc462782498fcc681aee28" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45707 } } }
I20260807 08:43:53.750548 31124 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4d0805e23fc462782498fcc681aee28 [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:53.750595 31122 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4d0805e23fc462782498fcc681aee28 [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:53.750993 31131 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:43:53.753908 31131 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:43:53.759398 31131 catalog_manager.cc:1347] Generated new cluster ID: 5b12c227f45c4f6f9ac24ff1ca4761e5
I20260807 08:43:53.759474 31131 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:43:53.771593 31131 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:43:53.771915 31131 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:43:53.782565 31131 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e4d0805e23fc462782498fcc681aee28: Generated new TSK 0
I20260807 08:43:53.783177 31131 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:43:53.788272 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 31041
2026-08-07T08:43:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1349 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:43:53 dist-test-slave-6nmv krb5kdc[31143](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:43:53 dist-test-slave-6nmv krb5kdc[31143](info): set up 2 sockets
Aug 07 08:43:53 dist-test-slave-6nmv krb5kdc[31143](info): commencing operation
krb5kdc: starting...
W20260807 08:43:54.809167 9027 mini_kdc.cc:121] Time spent starting KDC: real 0.999s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:43:54 dist-test-slave-6nmv krb5kdc[31143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092234, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:43:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:43:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 08:43:54.929061 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34933
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34933
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:43:55.034817 31157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:55.035069 31157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:55.035140 31157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:55.038748 31157 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:43:55.038820 31157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:55.038853 31157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:55.038902 31157 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:43:55.038954 31157 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:43:55.043699 31157 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34933
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:55.044603 31157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:55.045507 31157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:55.053436 31165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:55.053428 31162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:55.053427 31163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:55.053460 31157 server_base.cc:1034] running on GCE node
I20260807 08:43:55.054256 31157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:55.055265 31157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:55.056458 31157 hybrid_clock.cc:648] HybridClock initialized: now 1786092235056444 us; error 31 us; skew 500 ppm
Aug 07 08:43:55 dist-test-slave-6nmv krb5kdc[31143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092235, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:55.059320 31157 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 08:43:55.060231 31157 webserver.cc:460] Webserver started at http://127.0.0.1:33247/ using document root <none> and password file <none>
I20260807 08:43:55.060760 31157 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:55.060849 31157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:55.061076 31157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:55.062983 31157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "a5cdd5b917cb487cb8173b547eab6809"
format_stamp: "Formatted at 2026-08-07 08:43:55 on dist-test-slave-6nmv"
server_key: "1052661cee22385803e1e524d530772e"
server_key_iv: "fa45f33dc14bfa97ad0378697626b9cc"
server_key_version: "encryptionkey@0"
I20260807 08:43:55.063500 31157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "a5cdd5b917cb487cb8173b547eab6809"
format_stamp: "Formatted at 2026-08-07 08:43:55 on dist-test-slave-6nmv"
server_key: "1052661cee22385803e1e524d530772e"
server_key_iv: "fa45f33dc14bfa97ad0378697626b9cc"
server_key_version: "encryptionkey@0"
I20260807 08:43:55.066993 31157 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260807 08:43:55.069304 31172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:55.070384 31157 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 08:43:55.070518 31157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "a5cdd5b917cb487cb8173b547eab6809"
format_stamp: "Formatted at 2026-08-07 08:43:55 on dist-test-slave-6nmv"
server_key: "1052661cee22385803e1e524d530772e"
server_key_iv: "fa45f33dc14bfa97ad0378697626b9cc"
server_key_version: "encryptionkey@0"
I20260807 08:43:55.070617 31157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:55.098225 31157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:55.101416 31157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:55.101620 31157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:55.108588 31157 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34933
I20260807 08:43:55.108668 31226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34933 every 8 connection(s)
I20260807 08:43:55.109536 31157 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:43:55.112289 31227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:55.114984 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 31157
I20260807 08:43:55.115160 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:43:55.115458 9027 external_mini_cluster.cc:1428] Setting key 3a784c36c408127229cbcf0eff1a5d04
I20260807 08:43:55.118254 31227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5cdd5b917cb487cb8173b547eab6809: Bootstrap starting.
I20260807 08:43:55.120865 31227 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a5cdd5b917cb487cb8173b547eab6809: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:55.121672 31227 log.cc:824] T 00000000000000000000000000000000 P a5cdd5b917cb487cb8173b547eab6809: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:55.123698 31227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5cdd5b917cb487cb8173b547eab6809: No bootstrap required, opened a new log
Aug 07 08:43:55 dist-test-slave-6nmv krb5kdc[31143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092234, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 08:43:55.127823 31227 raft_consensus.cc:348] T 00000000000000000000000000000000 P a5cdd5b917cb487cb8173b547eab6809 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5cdd5b917cb487cb8173b547eab6809" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34933 } }
I20260807 08:43:55.128103 31227 raft_consensus.cc:374] T 00000000000000000000000000000000 P a5cdd5b917cb487cb8173b547eab6809 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:55.128172 31227 raft_consensus.cc:729] T 00000000000000000000000000000000 P a5cdd5b917cb487cb8173b547eab6809 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5cdd5b917cb487cb8173b547eab6809, State: Initialized, Role: FOLLOWER
I20260807 08:43:55.128646 31227 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5cdd5b917cb487cb8173b547eab6809 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5cdd5b917cb487cb8173b547eab6809" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34933 } }
I20260807 08:43:55.128777 31227 raft_consensus.cc:388] T 00000000000000000000000000000000 P a5cdd5b917cb487cb8173b547eab6809 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:43:55.128916 31227 raft_consensus.cc:482] T 00000000000000000000000000000000 P a5cdd5b917cb487cb8173b547eab6809 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:43:55.129027 31227 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a5cdd5b917cb487cb8173b547eab6809 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:55.130232 31227 raft_consensus.cc:504] T 00000000000000000000000000000000 P a5cdd5b917cb487cb8173b547eab6809 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5cdd5b917cb487cb8173b547eab6809" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34933 } }
I20260807 08:43:55.130584 31227 leader_election.cc:302] T 00000000000000000000000000000000 P a5cdd5b917cb487cb8173b547eab6809 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a5cdd5b917cb487cb8173b547eab6809; no voters:
I20260807 08:43:55.130913 31227 leader_election.cc:288] T 00000000000000000000000000000000 P a5cdd5b917cb487cb8173b547eab6809 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:43:55.131016 31233 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a5cdd5b917cb487cb8173b547eab6809 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:43:55.131309 31233 raft_consensus.cc:686] T 00000000000000000000000000000000 P a5cdd5b917cb487cb8173b547eab6809 [term 1 LEADER]: Becoming Leader. State: Replica: a5cdd5b917cb487cb8173b547eab6809, State: Running, Role: LEADER
I20260807 08:43:55.131665 31233 consensus_queue.cc:237] T 00000000000000000000000000000000 P a5cdd5b917cb487cb8173b547eab6809 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5cdd5b917cb487cb8173b547eab6809" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34933 } }
I20260807 08:43:55.131773 31231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:55.116906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37003 (local address 127.0.0.1:34933)
0807 08:43:55.117325 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:55.117344 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:55.117386 (+ 42us) server_negotiation.cc:407] Connection header received
0807 08:43:55.118200 (+ 814us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:55.118222 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:55.118649 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:55.118986 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:55.119730 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:55.121215 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:55.122194 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:55.122814 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:55.122974 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:55.125714 (+ 2740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:55.125720 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:55.125737 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:55.125767 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:55.128387 (+ 2620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:55.128866 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:55.128875 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:55.128881 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:55.129026 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:55.129337 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:55.129343 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:55.129348 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:55.129929 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:55.130156 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:55.130364 (+ 208us) server_negotiation.cc:299] Negotiation successful
0807 08:43:55.130674 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":116,"threads_started":1}
I20260807 08:43:55.132211 31227 sys_catalog.cc:564] T 00000000000000000000000000000000 P a5cdd5b917cb487cb8173b547eab6809 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:43:55.132999 31234 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5cdd5b917cb487cb8173b547eab6809 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5cdd5b917cb487cb8173b547eab6809. Latest consensus state: current_term: 1 leader_uuid: "a5cdd5b917cb487cb8173b547eab6809" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5cdd5b917cb487cb8173b547eab6809" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34933 } } }
I20260807 08:43:55.133117 31234 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5cdd5b917cb487cb8173b547eab6809 [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:55.134153 31235 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5cdd5b917cb487cb8173b547eab6809 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a5cdd5b917cb487cb8173b547eab6809" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5cdd5b917cb487cb8173b547eab6809" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34933 } } }
I20260807 08:43:55.134507 31235 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5cdd5b917cb487cb8173b547eab6809 [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:55.134907 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260807 08:43:55.137282 31249 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a5cdd5b917cb487cb8173b547eab6809: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:43:55.137383 31249 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:43:55.137463 31243 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:43:55.138345 31243 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:43:55.144179 31243 catalog_manager.cc:1347] Generated new cluster ID: c25c97413fa64704887c0dbf981d3188
I20260807 08:43:55.144243 31243 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:43:55.145315 31231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:55.136991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38869 (local address 127.0.0.1:34933)
0807 08:43:55.137102 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:55.137106 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:55.137700 (+ 594us) server_negotiation.cc:407] Connection header received
0807 08:43:55.137772 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:55.137775 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:55.137847 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:55.137942 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:55.138635 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:55.139146 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:55.139995 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:55.140312 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:55.140387 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:55.142095 (+ 1708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:55.142099 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:55.142101 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:55.142124 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:55.143641 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:55.144126 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:55.144129 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:55.144131 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:55.144209 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:55.144525 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:55.144528 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:55.144530 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:55.144744 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:55.144878 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:55.145071 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 08:43:55.145181 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 08:43:55.150079 31243 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:43:55.150906 31243 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:43:55.155488 31243 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a5cdd5b917cb487cb8173b547eab6809: Generated new TSK 0
I20260807 08:43:55.156093 31243 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:43:55.163319 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 31157
2026-08-07T08:43:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1374 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:43:55 dist-test-slave-6nmv krb5kdc[31260](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:43:55 dist-test-slave-6nmv krb5kdc[31260](info): set up 2 sockets
Aug 07 08:43:55 dist-test-slave-6nmv krb5kdc[31260](info): commencing operation
krb5kdc: starting...
W20260807 08:43:56.228982 9027 mini_kdc.cc:121] Time spent starting KDC: real 1.044s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:43:56 dist-test-slave-6nmv krb5kdc[31260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092236, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:43:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:43:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 08:43:56.348680 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44251
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44251
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:43:56.456027 31273 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:56.456310 31273 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:56.456352 31273 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:56.460268 31273 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:43:56.460322 31273 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:56.460343 31273 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:56.460400 31273 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:43:56.460434 31273 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:43:56.465744 31273 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44251
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31273
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:56.466822 31273 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:56.467849 31273 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:56.476555 31278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:56.476563 31281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:56.476614 31279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:56.476924 31273 server_base.cc:1034] running on GCE node
I20260807 08:43:56.477557 31273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:56.478740 31273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:56.479920 31273 hybrid_clock.cc:648] HybridClock initialized: now 1786092236479882 us; error 37 us; skew 500 ppm
Aug 07 08:43:56 dist-test-slave-6nmv krb5kdc[31260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092236, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:56.482851 31273 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 08:43:56.483879 31273 webserver.cc:460] Webserver started at http://127.0.0.1:34359/ using document root <none> and password file <none>
I20260807 08:43:56.484494 31273 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:56.484560 31273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:56.484809 31273 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:56.486971 31273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "6adbdad5b36d451e91f1844da4bf59a1"
format_stamp: "Formatted at 2026-08-07 08:43:56 on dist-test-slave-6nmv"
server_key: "9169796d0f692fabbb1080dfb15bdbe4"
server_key_iv: "e2807d51e127646ba3fe3913c6f87fbe"
server_key_version: "encryptionkey@0"
I20260807 08:43:56.487546 31273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "6adbdad5b36d451e91f1844da4bf59a1"
format_stamp: "Formatted at 2026-08-07 08:43:56 on dist-test-slave-6nmv"
server_key: "9169796d0f692fabbb1080dfb15bdbe4"
server_key_iv: "e2807d51e127646ba3fe3913c6f87fbe"
server_key_version: "encryptionkey@0"
I20260807 08:43:56.491333 31273 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 08:43:56.493922 31288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:56.495141 31273 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:43:56.495287 31273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "6adbdad5b36d451e91f1844da4bf59a1"
format_stamp: "Formatted at 2026-08-07 08:43:56 on dist-test-slave-6nmv"
server_key: "9169796d0f692fabbb1080dfb15bdbe4"
server_key_iv: "e2807d51e127646ba3fe3913c6f87fbe"
server_key_version: "encryptionkey@0"
I20260807 08:43:56.495405 31273 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:56.534051 31273 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:56.536967 31273 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:56.537173 31273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:56.544003 31273 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44251
I20260807 08:43:56.544019 31341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44251 every 8 connection(s)
I20260807 08:43:56.544871 31273 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:43:56.547472 31342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:56.552644 31342 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6adbdad5b36d451e91f1844da4bf59a1: Bootstrap starting.
I20260807 08:43:56.554772 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 31273
I20260807 08:43:56.554921 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:43:56.555001 31342 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6adbdad5b36d451e91f1844da4bf59a1: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:56.555228 9027 external_mini_cluster.cc:1428] Setting key bb43534725430581913aaaf59b71f1ce
I20260807 08:43:56.555811 31342 log.cc:824] T 00000000000000000000000000000000 P 6adbdad5b36d451e91f1844da4bf59a1: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:56.557660 31342 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6adbdad5b36d451e91f1844da4bf59a1: No bootstrap required, opened a new log
I20260807 08:43:56.561522 31342 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6adbdad5b36d451e91f1844da4bf59a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6adbdad5b36d451e91f1844da4bf59a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44251 } }
I20260807 08:43:56.561800 31342 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6adbdad5b36d451e91f1844da4bf59a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:56.561887 31342 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6adbdad5b36d451e91f1844da4bf59a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6adbdad5b36d451e91f1844da4bf59a1, State: Initialized, Role: FOLLOWER
I20260807 08:43:56.562280 31342 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6adbdad5b36d451e91f1844da4bf59a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6adbdad5b36d451e91f1844da4bf59a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44251 } }
I20260807 08:43:56.562429 31342 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6adbdad5b36d451e91f1844da4bf59a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:43:56.562510 31342 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6adbdad5b36d451e91f1844da4bf59a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:43:56.562667 31342 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6adbdad5b36d451e91f1844da4bf59a1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:56.563608 31342 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6adbdad5b36d451e91f1844da4bf59a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6adbdad5b36d451e91f1844da4bf59a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44251 } }
I20260807 08:43:56.563910 31346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:56.556277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35889 (local address 127.0.0.1:44251)
0807 08:43:56.556752 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:56.556767 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:56.556800 (+ 33us) server_negotiation.cc:407] Connection header received
0807 08:43:56.557393 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:56.557407 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:56.557714 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:56.558060 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:56.558398 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:56.559229 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:56.560537 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:56.560965 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:56.561069 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:56.561917 (+ 848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:56.561923 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:56.561937 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:43:56.562368 (+ 431us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:56.562438 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:43:56.562469 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:56.562591 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:56.563034 (+ 443us) server_negotiation.cc:299] Negotiation successful
0807 08:43:56.563186 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":174,"threads_started":1}
I20260807 08:43:56.563985 31342 leader_election.cc:302] T 00000000000000000000000000000000 P 6adbdad5b36d451e91f1844da4bf59a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6adbdad5b36d451e91f1844da4bf59a1; no voters:
I20260807 08:43:56.564332 31342 leader_election.cc:288] T 00000000000000000000000000000000 P 6adbdad5b36d451e91f1844da4bf59a1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:43:56.564422 31347 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6adbdad5b36d451e91f1844da4bf59a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:43:56.564656 31347 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6adbdad5b36d451e91f1844da4bf59a1 [term 1 LEADER]: Becoming Leader. State: Replica: 6adbdad5b36d451e91f1844da4bf59a1, State: Running, Role: LEADER
I20260807 08:43:56.564983 31347 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6adbdad5b36d451e91f1844da4bf59a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6adbdad5b36d451e91f1844da4bf59a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44251 } }
I20260807 08:43:56.566236 31342 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6adbdad5b36d451e91f1844da4bf59a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:43:56.566524 31348 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6adbdad5b36d451e91f1844da4bf59a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6adbdad5b36d451e91f1844da4bf59a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6adbdad5b36d451e91f1844da4bf59a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44251 } } }
I20260807 08:43:56.566645 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 08:43:56.566651 31348 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6adbdad5b36d451e91f1844da4bf59a1 [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:56.566994 31349 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6adbdad5b36d451e91f1844da4bf59a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6adbdad5b36d451e91f1844da4bf59a1. Latest consensus state: current_term: 1 leader_uuid: "6adbdad5b36d451e91f1844da4bf59a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6adbdad5b36d451e91f1844da4bf59a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44251 } } }
I20260807 08:43:56.567171 31349 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6adbdad5b36d451e91f1844da4bf59a1 [sys.catalog]: This master's current role is: LEADER
W20260807 08:43:56.571235 31367 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6adbdad5b36d451e91f1844da4bf59a1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:43:56.571329 31367 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:43:56.571437 31351 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:43:56.572113 31351 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:43:56.573450 31346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:56.568793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47521 (local address 127.0.0.1:44251)
0807 08:43:56.568883 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:56.568887 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:56.569105 (+ 218us) server_negotiation.cc:407] Connection header received
0807 08:43:56.569188 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:56.569190 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:56.569229 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:56.569301 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:56.569547 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:56.570392 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:56.571546 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:56.571874 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:56.571954 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:56.572968 (+ 1014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:56.572972 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:56.572974 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:43:56.572989 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:56.573015 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:43:56.573028 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:56.573076 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:56.573260 (+ 184us) server_negotiation.cc:299] Negotiation successful
0807 08:43:56.573311 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 08:43:56.577513 31351 catalog_manager.cc:1347] Generated new cluster ID: f277f1e01f2f4f5691cd034fe6eb3045
I20260807 08:43:56.577576 31351 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:43:56.587473 31351 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:43:56.588300 31351 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:43:56.594980 31351 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6adbdad5b36d451e91f1844da4bf59a1: Generated new TSK 0
I20260807 08:43:56.595556 31351 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:43:56.607085 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 31273
2026-08-07T08:43:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1444 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:43:56 dist-test-slave-6nmv krb5kdc[31373](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:43:56 dist-test-slave-6nmv krb5kdc[31373](info): set up 2 sockets
Aug 07 08:43:56 dist-test-slave-6nmv krb5kdc[31373](info): commencing operation
krb5kdc: starting...
W20260807 08:43:57.626601 9027 mini_kdc.cc:121] Time spent starting KDC: real 0.997s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:43:57 dist-test-slave-6nmv krb5kdc[31373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092237, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:43:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:43:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 08:43:57.745709 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39473
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39473
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:43:57.850723 31387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:57.850943 31387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:57.850991 31387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:57.854768 31387 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:43:57.854815 31387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:57.854833 31387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:57.854849 31387 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:43:57.854907 31387 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:43:57.859495 31387 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39473
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39473
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31387
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:57.860340 31387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:57.861220 31387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:57.869014 31395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:57.869050 31387 server_base.cc:1034] running on GCE node
W20260807 08:43:57.869024 31392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:57.869045 31393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:57.869787 31387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:57.870791 31387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:57.871974 31387 hybrid_clock.cc:648] HybridClock initialized: now 1786092237871943 us; error 43 us; skew 500 ppm
Aug 07 08:43:57 dist-test-slave-6nmv krb5kdc[31373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092237, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:57.874501 31387 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 08:43:57.875308 31387 webserver.cc:460] Webserver started at http://127.0.0.1:34301/ using document root <none> and password file <none>
I20260807 08:43:57.875809 31387 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:57.875900 31387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:57.876130 31387 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:57.878077 31387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "27f3d963e4864a43a086b2c7a41b7b11"
format_stamp: "Formatted at 2026-08-07 08:43:57 on dist-test-slave-6nmv"
server_key: "8dc2456a3e61f172f003e266020be527"
server_key_iv: "ed4ce859aed6f9e7c4107e07983284ba"
server_key_version: "encryptionkey@0"
I20260807 08:43:57.878618 31387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "27f3d963e4864a43a086b2c7a41b7b11"
format_stamp: "Formatted at 2026-08-07 08:43:57 on dist-test-slave-6nmv"
server_key: "8dc2456a3e61f172f003e266020be527"
server_key_iv: "ed4ce859aed6f9e7c4107e07983284ba"
server_key_version: "encryptionkey@0"
I20260807 08:43:57.882014 31387 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 08:43:57.884117 31402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:57.885251 31387 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:43:57.885393 31387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "27f3d963e4864a43a086b2c7a41b7b11"
format_stamp: "Formatted at 2026-08-07 08:43:57 on dist-test-slave-6nmv"
server_key: "8dc2456a3e61f172f003e266020be527"
server_key_iv: "ed4ce859aed6f9e7c4107e07983284ba"
server_key_version: "encryptionkey@0"
I20260807 08:43:57.885499 31387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:57.889531 31387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:57.892050 31387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:57.892231 31387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:57.898794 31387 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39473
I20260807 08:43:57.898813 31456 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39473 every 8 connection(s)
I20260807 08:43:57.899556 31387 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:43:57.900754 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 31387
I20260807 08:43:57.900911 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:43:57.901170 9027 external_mini_cluster.cc:1428] Setting key a7e86f40144bdb58da29c84c2821cf0d
I20260807 08:43:57.902379 31457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:57.906123 31460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:57.902412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32973 (local address 127.0.0.1:39473)
0807 08:43:57.902808 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:57.902825 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:57.902861 (+ 36us) server_negotiation.cc:407] Connection header received
0807 08:43:57.903616 (+ 755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:57.903635 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:57.903956 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:57.904299 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:57.904915 (+ 616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:57.904919 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:57.904932 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:43:57.904944 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:57.904993 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:43:57.905015 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:57.905143 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:57.905203 (+ 60us) server_negotiation.cc:299] Negotiation successful
0807 08:43:57.905327 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":111,"threads_started":1}
I20260807 08:43:57.908411 31457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27f3d963e4864a43a086b2c7a41b7b11: Bootstrap starting.
I20260807 08:43:57.908586 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 08:43:57.910915 31457 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 27f3d963e4864a43a086b2c7a41b7b11: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:57.911846 31457 log.cc:824] T 00000000000000000000000000000000 P 27f3d963e4864a43a086b2c7a41b7b11: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:57.912412 31460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:57.910738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45895 (local address 127.0.0.1:39473)
0807 08:43:57.910862 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:57.910866 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:57.911036 (+ 170us) server_negotiation.cc:407] Connection header received
0807 08:43:57.911166 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:57.911167 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:57.911191 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:57.911246 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:57.911919 (+ 673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:57.911922 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:57.911924 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:43:57.911964 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:57.912001 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:43:57.912018 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:57.912107 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:57.912232 (+ 125us) server_negotiation.cc:299] Negotiation successful
0807 08:43:57.912280 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 08:43:57.913875 31457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27f3d963e4864a43a086b2c7a41b7b11: No bootstrap required, opened a new log
I20260807 08:43:57.916814 31457 raft_consensus.cc:348] T 00000000000000000000000000000000 P 27f3d963e4864a43a086b2c7a41b7b11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27f3d963e4864a43a086b2c7a41b7b11" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39473 } }
I20260807 08:43:57.917001 31457 raft_consensus.cc:374] T 00000000000000000000000000000000 P 27f3d963e4864a43a086b2c7a41b7b11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:57.917075 31457 raft_consensus.cc:729] T 00000000000000000000000000000000 P 27f3d963e4864a43a086b2c7a41b7b11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27f3d963e4864a43a086b2c7a41b7b11, State: Initialized, Role: FOLLOWER
I20260807 08:43:57.917445 31457 consensus_queue.cc:260] T 00000000000000000000000000000000 P 27f3d963e4864a43a086b2c7a41b7b11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27f3d963e4864a43a086b2c7a41b7b11" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39473 } }
I20260807 08:43:57.917589 31457 raft_consensus.cc:388] T 00000000000000000000000000000000 P 27f3d963e4864a43a086b2c7a41b7b11 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:43:57.917665 31457 raft_consensus.cc:482] T 00000000000000000000000000000000 P 27f3d963e4864a43a086b2c7a41b7b11 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:43:57.917763 31457 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 27f3d963e4864a43a086b2c7a41b7b11 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:57.918501 31457 raft_consensus.cc:504] T 00000000000000000000000000000000 P 27f3d963e4864a43a086b2c7a41b7b11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27f3d963e4864a43a086b2c7a41b7b11" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39473 } }
I20260807 08:43:57.918787 31457 leader_election.cc:302] T 00000000000000000000000000000000 P 27f3d963e4864a43a086b2c7a41b7b11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 27f3d963e4864a43a086b2c7a41b7b11; no voters:
I20260807 08:43:57.919099 31457 leader_election.cc:288] T 00000000000000000000000000000000 P 27f3d963e4864a43a086b2c7a41b7b11 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:43:57.919261 31467 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 27f3d963e4864a43a086b2c7a41b7b11 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:43:57.919441 31467 raft_consensus.cc:686] T 00000000000000000000000000000000 P 27f3d963e4864a43a086b2c7a41b7b11 [term 1 LEADER]: Becoming Leader. State: Replica: 27f3d963e4864a43a086b2c7a41b7b11, State: Running, Role: LEADER
I20260807 08:43:57.919739 31467 consensus_queue.cc:237] T 00000000000000000000000000000000 P 27f3d963e4864a43a086b2c7a41b7b11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27f3d963e4864a43a086b2c7a41b7b11" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39473 } }
I20260807 08:43:57.920181 31457 sys_catalog.cc:564] T 00000000000000000000000000000000 P 27f3d963e4864a43a086b2c7a41b7b11 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:43:57.921312 31468 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27f3d963e4864a43a086b2c7a41b7b11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "27f3d963e4864a43a086b2c7a41b7b11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27f3d963e4864a43a086b2c7a41b7b11" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39473 } } }
I20260807 08:43:57.921325 31469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27f3d963e4864a43a086b2c7a41b7b11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 27f3d963e4864a43a086b2c7a41b7b11. Latest consensus state: current_term: 1 leader_uuid: "27f3d963e4864a43a086b2c7a41b7b11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27f3d963e4864a43a086b2c7a41b7b11" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39473 } } }
I20260807 08:43:57.921423 31468 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27f3d963e4864a43a086b2c7a41b7b11 [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:57.921434 31469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27f3d963e4864a43a086b2c7a41b7b11 [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:57.922896 31477 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:43:57.925451 31477 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:43:57.930127 31477 catalog_manager.cc:1347] Generated new cluster ID: 60bfbdff4eee4ce6a91db3066bbf24d4
I20260807 08:43:57.930191 31477 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:43:57.936883 31477 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:43:57.937131 31477 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:43:57.950541 31477 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 27f3d963e4864a43a086b2c7a41b7b11: Generated new TSK 0
I20260807 08:43:57.951130 31477 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:43:57.959189 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 31387
2026-08-07T08:43:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1351 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:43:58 dist-test-slave-6nmv krb5kdc[31489](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:43:58 dist-test-slave-6nmv krb5kdc[31489](info): set up 2 sockets
Aug 07 08:43:58 dist-test-slave-6nmv krb5kdc[31489](info): commencing operation
krb5kdc: starting...
W20260807 08:43:59.032410 9027 mini_kdc.cc:121] Time spent starting KDC: real 1.050s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:43:59 dist-test-slave-6nmv krb5kdc[31489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092239, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:43:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:43:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 08:43:59.150496 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35749
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35749
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:43:59.256943 31502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:43:59.257228 31502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:43:59.257311 31502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:43:59.261265 31502 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:43:59.261359 31502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:43:59.261401 31502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:43:59.261461 31502 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:43:59.261502 31502 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:43:59.266300 31502 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35749
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35749
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31502
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:43:59.267298 31502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:43:59.268299 31502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:43:59.276461 31508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:59.276465 31510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:43:59.276604 31507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:43:59.276873 31502 server_base.cc:1034] running on GCE node
I20260807 08:43:59.277462 31502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:43:59.278597 31502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:43:59.279795 31502 hybrid_clock.cc:648] HybridClock initialized: now 1786092239279776 us; error 41 us; skew 500 ppm
Aug 07 08:43:59 dist-test-slave-6nmv krb5kdc[31489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092239, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:43:59.282603 31502 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 08:43:59.283478 31502 webserver.cc:460] Webserver started at http://127.0.0.1:34075/ using document root <none> and password file <none>
I20260807 08:43:59.284013 31502 fs_manager.cc:359] Metadata directory not provided
I20260807 08:43:59.284104 31502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:43:59.284348 31502 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:43:59.286394 31502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "293ef5d5bb764fea811b6907c38c4c89"
format_stamp: "Formatted at 2026-08-07 08:43:59 on dist-test-slave-6nmv"
server_key: "6c28f3f7d1a4af3e87e4f1ee5b993601"
server_key_iv: "b71ed1a535520bc485e131904773572b"
server_key_version: "encryptionkey@0"
I20260807 08:43:59.286958 31502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "293ef5d5bb764fea811b6907c38c4c89"
format_stamp: "Formatted at 2026-08-07 08:43:59 on dist-test-slave-6nmv"
server_key: "6c28f3f7d1a4af3e87e4f1ee5b993601"
server_key_iv: "b71ed1a535520bc485e131904773572b"
server_key_version: "encryptionkey@0"
I20260807 08:43:59.290450 31502 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 08:43:59.292737 31517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:43:59.293915 31502 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260807 08:43:59.294042 31502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "293ef5d5bb764fea811b6907c38c4c89"
format_stamp: "Formatted at 2026-08-07 08:43:59 on dist-test-slave-6nmv"
server_key: "6c28f3f7d1a4af3e87e4f1ee5b993601"
server_key_iv: "b71ed1a535520bc485e131904773572b"
server_key_version: "encryptionkey@0"
I20260807 08:43:59.294142 31502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:43:59.315578 31502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:43:59.318245 31502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:43:59.318429 31502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:43:59.325161 31502 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35749
I20260807 08:43:59.325188 31572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35749 every 8 connection(s)
I20260807 08:43:59.326061 31502 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:43:59.326731 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 31502
I20260807 08:43:59.326890 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:43:59.327176 9027 external_mini_cluster.cc:1428] Setting key 4602d9ddfb8e8514adcedbc471b31c2b
I20260807 08:43:59.329214 31573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:43:59.335615 31573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 293ef5d5bb764fea811b6907c38c4c89: Bootstrap starting.
Aug 07 08:43:59 dist-test-slave-6nmv krb5kdc[31489](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092239, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 08:43:59.338106 31573 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 293ef5d5bb764fea811b6907c38c4c89: Neither blocks nor log segments found. Creating new log.
I20260807 08:43:59.338835 31573 log.cc:824] T 00000000000000000000000000000000 P 293ef5d5bb764fea811b6907c38c4c89: Log is configured to *not* fsync() on all Append() calls
I20260807 08:43:59.340772 31573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 293ef5d5bb764fea811b6907c38c4c89: No bootstrap required, opened a new log
I20260807 08:43:59.341979 31576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:59.328577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:44297 (local address 127.0.0.1:35749)
0807 08:43:59.329117 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:59.329134 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:59.329173 (+ 39us) server_negotiation.cc:407] Connection header received
0807 08:43:59.329991 (+ 818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:59.330012 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:59.330408 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:59.330751 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:59.331395 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:59.332914 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:59.333738 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:59.334445 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:59.334635 (+ 190us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:59.337392 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:59.337397 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:59.337408 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:59.337433 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:59.339394 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:59.339936 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:59.339940 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:59.339943 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:59.340039 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:59.340344 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:59.340345 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:59.340346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:59.340664 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:59.340800 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:59.341092 (+ 292us) server_negotiation.cc:299] Negotiation successful
0807 08:43:59.341301 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":133,"threads_started":1}
I20260807 08:43:59.344336 31573 raft_consensus.cc:348] T 00000000000000000000000000000000 P 293ef5d5bb764fea811b6907c38c4c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "293ef5d5bb764fea811b6907c38c4c89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35749 } }
I20260807 08:43:59.344605 31573 raft_consensus.cc:374] T 00000000000000000000000000000000 P 293ef5d5bb764fea811b6907c38c4c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:43:59.344658 31573 raft_consensus.cc:729] T 00000000000000000000000000000000 P 293ef5d5bb764fea811b6907c38c4c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293ef5d5bb764fea811b6907c38c4c89, State: Initialized, Role: FOLLOWER
I20260807 08:43:59.344686 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 08:43:59.345062 31573 consensus_queue.cc:260] T 00000000000000000000000000000000 P 293ef5d5bb764fea811b6907c38c4c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "293ef5d5bb764fea811b6907c38c4c89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35749 } }
I20260807 08:43:59.345222 31573 raft_consensus.cc:388] T 00000000000000000000000000000000 P 293ef5d5bb764fea811b6907c38c4c89 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:43:59.345278 31573 raft_consensus.cc:482] T 00000000000000000000000000000000 P 293ef5d5bb764fea811b6907c38c4c89 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:43:59.345360 31573 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 293ef5d5bb764fea811b6907c38c4c89 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:43:59.346436 31573 raft_consensus.cc:504] T 00000000000000000000000000000000 P 293ef5d5bb764fea811b6907c38c4c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "293ef5d5bb764fea811b6907c38c4c89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35749 } }
I20260807 08:43:59.346793 31573 leader_election.cc:302] T 00000000000000000000000000000000 P 293ef5d5bb764fea811b6907c38c4c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 293ef5d5bb764fea811b6907c38c4c89; no voters:
I20260807 08:43:59.347129 31573 leader_election.cc:288] T 00000000000000000000000000000000 P 293ef5d5bb764fea811b6907c38c4c89 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:43:59.347240 31584 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 293ef5d5bb764fea811b6907c38c4c89 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:43:59.347477 31584 raft_consensus.cc:686] T 00000000000000000000000000000000 P 293ef5d5bb764fea811b6907c38c4c89 [term 1 LEADER]: Becoming Leader. State: Replica: 293ef5d5bb764fea811b6907c38c4c89, State: Running, Role: LEADER
I20260807 08:43:59.347863 31584 consensus_queue.cc:237] T 00000000000000000000000000000000 P 293ef5d5bb764fea811b6907c38c4c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "293ef5d5bb764fea811b6907c38c4c89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35749 } }
I20260807 08:43:59.348263 31573 sys_catalog.cc:564] T 00000000000000000000000000000000 P 293ef5d5bb764fea811b6907c38c4c89 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:43:59.348968 31584 sys_catalog.cc:455] T 00000000000000000000000000000000 P 293ef5d5bb764fea811b6907c38c4c89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 293ef5d5bb764fea811b6907c38c4c89. Latest consensus state: current_term: 1 leader_uuid: "293ef5d5bb764fea811b6907c38c4c89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "293ef5d5bb764fea811b6907c38c4c89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35749 } } }
I20260807 08:43:59.349067 31584 sys_catalog.cc:458] T 00000000000000000000000000000000 P 293ef5d5bb764fea811b6907c38c4c89 [sys.catalog]: This master's current role is: LEADER
I20260807 08:43:59.349431 31585 sys_catalog.cc:455] T 00000000000000000000000000000000 P 293ef5d5bb764fea811b6907c38c4c89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "293ef5d5bb764fea811b6907c38c4c89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "293ef5d5bb764fea811b6907c38c4c89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35749 } } }
I20260807 08:43:59.349527 31585 sys_catalog.cc:458] T 00000000000000000000000000000000 P 293ef5d5bb764fea811b6907c38c4c89 [sys.catalog]: This master's current role is: LEADER
W20260807 08:43:59.352732 31599 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 293ef5d5bb764fea811b6907c38c4c89: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:43:59.352810 31599 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:43:59.352967 31593 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:43:59.353830 31593 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:43:59.355644 31576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:43:59.346847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:34887 (local address 127.0.0.1:35749)
0807 08:43:59.346971 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 08:43:59.346975 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:43:59.347269 (+ 294us) server_negotiation.cc:407] Connection header received
0807 08:43:59.347438 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:43:59.347444 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:43:59.347499 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:43:59.347553 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:43:59.348615 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:59.349238 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:59.350246 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:43:59.350596 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:43:59.350705 (+ 109us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:43:59.352235 (+ 1530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:43:59.352239 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:43:59.352241 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:43:59.352268 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:43:59.353839 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:59.354386 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:59.354389 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:59.354390 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:59.354466 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:43:59.354816 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:43:59.354819 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:43:59.354820 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:43:59.355024 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:43:59.355154 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 08:43:59.355431 (+ 277us) server_negotiation.cc:299] Negotiation successful
0807 08:43:59.355525 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 08:43:59.358788 31593 catalog_manager.cc:1347] Generated new cluster ID: 651bbb87e22744ddb5db1d626c605516
I20260807 08:43:59.358840 31593 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:43:59.373255 31593 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:43:59.374297 31593 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:43:59.379112 31593 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 293ef5d5bb764fea811b6907c38c4c89: Generated new TSK 0
I20260807 08:43:59.379760 31593 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:43:59.385295 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 31502
W20260807 08:43:59.393153 31487 connection.cc:535] client connection to 127.0.0.1:35749 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35749): Connection reset by peer (error 104)
2026-08-07T08:43:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1425 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:43:59 dist-test-slave-6nmv krb5kdc[31605](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:43:59 dist-test-slave-6nmv krb5kdc[31605](info): set up 2 sockets
Aug 07 08:43:59 dist-test-slave-6nmv krb5kdc[31605](info): commencing operation
krb5kdc: starting...
W20260807 08:44:00.436939 9027 mini_kdc.cc:121] Time spent starting KDC: real 1.029s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:44:00 dist-test-slave-6nmv krb5kdc[31605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092240, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:44:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:44:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 08:44:00.551064 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44329
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44329
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:44:00.662110 31618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:44:00.662402 31618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:44:00.662495 31618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:44:00.666404 31618 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:44:00.666481 31618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:44:00.666527 31618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:44:00.666582 31618 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:44:00.666620 31618 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:44:00.671739 31618 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44329
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31618
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:44:00.672813 31618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:44:00.673866 31618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:44:00.682096 31623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:00.682102 31626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:00.682106 31624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:44:00.682147 31618 server_base.cc:1034] running on GCE node
I20260807 08:44:00.682899 31618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:44:00.683935 31618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:44:00.685144 31618 hybrid_clock.cc:648] HybridClock initialized: now 1786092240685126 us; error 28 us; skew 500 ppm
Aug 07 08:44:00 dist-test-slave-6nmv krb5kdc[31605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092240, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:44:00.687950 31618 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 08:44:00.688750 31618 webserver.cc:460] Webserver started at http://127.0.0.1:35195/ using document root <none> and password file <none>
I20260807 08:44:00.689240 31618 fs_manager.cc:359] Metadata directory not provided
I20260807 08:44:00.689296 31618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:44:00.689479 31618 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:44:00.691486 31618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "b3f173028fab4496897dcfa6c98c660c"
format_stamp: "Formatted at 2026-08-07 08:44:00 on dist-test-slave-6nmv"
server_key: "9dde8c5f46d7b5df270efacf82a1699f"
server_key_iv: "87faaf040521c4a4b4aa58786c679928"
server_key_version: "encryptionkey@0"
I20260807 08:44:00.692008 31618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "b3f173028fab4496897dcfa6c98c660c"
format_stamp: "Formatted at 2026-08-07 08:44:00 on dist-test-slave-6nmv"
server_key: "9dde8c5f46d7b5df270efacf82a1699f"
server_key_iv: "87faaf040521c4a4b4aa58786c679928"
server_key_version: "encryptionkey@0"
I20260807 08:44:00.695454 31618 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260807 08:44:00.697672 31633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:44:00.698814 31618 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260807 08:44:00.698933 31618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "b3f173028fab4496897dcfa6c98c660c"
format_stamp: "Formatted at 2026-08-07 08:44:00 on dist-test-slave-6nmv"
server_key: "9dde8c5f46d7b5df270efacf82a1699f"
server_key_iv: "87faaf040521c4a4b4aa58786c679928"
server_key_version: "encryptionkey@0"
I20260807 08:44:00.699026 31618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:44:00.722353 31618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:44:00.725204 31618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:44:00.725330 31618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:44:00.731493 31618 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44329
I20260807 08:44:00.731506 31687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44329 every 8 connection(s)
I20260807 08:44:00.732390 31618 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:44:00.734830 31688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:44:00.736650 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 31618
I20260807 08:44:00.736829 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:44:00.737118 9027 external_mini_cluster.cc:1428] Setting key b7f4a6756cfd9ff50d24d0e5a88b43b5
I20260807 08:44:00.740965 31688 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3f173028fab4496897dcfa6c98c660c: Bootstrap starting.
I20260807 08:44:00.743420 31688 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3f173028fab4496897dcfa6c98c660c: Neither blocks nor log segments found. Creating new log.
I20260807 08:44:00.744235 31688 log.cc:824] T 00000000000000000000000000000000 P b3f173028fab4496897dcfa6c98c660c: Log is configured to *not* fsync() on all Append() calls
I20260807 08:44:00.745647 31691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:00.738459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:57905 (local address 127.0.0.1:44329)
0807 08:44:00.738869 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:00.738884 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:00.738918 (+ 34us) server_negotiation.cc:407] Connection header received
0807 08:44:00.739497 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:00.739511 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:00.739802 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:00.740058 (+ 256us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:00.740433 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:00.741434 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:00.742653 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:00.743137 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:00.743248 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:00.744067 (+ 819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:00.744072 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:00.744082 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:44:00.744467 (+ 385us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:00.744536 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:44:00.744568 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:00.744702 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:00.744867 (+ 165us) server_negotiation.cc:299] Negotiation successful
0807 08:44:00.745011 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":133,"threads_started":1}
I20260807 08:44:00.746129 31688 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3f173028fab4496897dcfa6c98c660c: No bootstrap required, opened a new log
I20260807 08:44:00.748461 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 08:44:00.749939 31688 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3f173028fab4496897dcfa6c98c660c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3f173028fab4496897dcfa6c98c660c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44329 } }
I20260807 08:44:00.750160 31688 raft_consensus.cc:374] T 00000000000000000000000000000000 P b3f173028fab4496897dcfa6c98c660c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:44:00.750248 31688 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3f173028fab4496897dcfa6c98c660c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3f173028fab4496897dcfa6c98c660c, State: Initialized, Role: FOLLOWER
I20260807 08:44:00.750691 31688 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3f173028fab4496897dcfa6c98c660c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3f173028fab4496897dcfa6c98c660c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44329 } }
I20260807 08:44:00.750836 31688 raft_consensus.cc:388] T 00000000000000000000000000000000 P b3f173028fab4496897dcfa6c98c660c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:44:00.750936 31688 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3f173028fab4496897dcfa6c98c660c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:44:00.751047 31688 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3f173028fab4496897dcfa6c98c660c [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:44:00.751849 31688 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3f173028fab4496897dcfa6c98c660c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3f173028fab4496897dcfa6c98c660c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44329 } }
I20260807 08:44:00.752167 31688 leader_election.cc:302] T 00000000000000000000000000000000 P b3f173028fab4496897dcfa6c98c660c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3f173028fab4496897dcfa6c98c660c; no voters:
I20260807 08:44:00.752498 31688 leader_election.cc:288] T 00000000000000000000000000000000 P b3f173028fab4496897dcfa6c98c660c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:44:00.752589 31698 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3f173028fab4496897dcfa6c98c660c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:44:00.752859 31698 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3f173028fab4496897dcfa6c98c660c [term 1 LEADER]: Becoming Leader. State: Replica: b3f173028fab4496897dcfa6c98c660c, State: Running, Role: LEADER
I20260807 08:44:00.753219 31698 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3f173028fab4496897dcfa6c98c660c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3f173028fab4496897dcfa6c98c660c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44329 } }
I20260807 08:44:00.753638 31688 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3f173028fab4496897dcfa6c98c660c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:44:00.754916 31691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:00.750443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:40653 (local address 127.0.0.1:44329)
0807 08:44:00.750613 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:00.750621 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:00.750817 (+ 196us) server_negotiation.cc:407] Connection header received
0807 08:44:00.750968 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:00.750970 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:00.751019 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:00.751086 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:00.751332 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:00.751841 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:00.752928 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:00.753256 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:00.753333 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:00.754291 (+ 958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:00.754295 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:00.754297 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:44:00.754309 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:00.754334 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:44:00.754345 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:00.754443 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:00.754785 (+ 342us) server_negotiation.cc:299] Negotiation successful
0807 08:44:00.754823 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260807 08:44:00.755560 31699 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3f173028fab4496897dcfa6c98c660c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3f173028fab4496897dcfa6c98c660c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3f173028fab4496897dcfa6c98c660c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44329 } } }
I20260807 08:44:00.755702 31699 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3f173028fab4496897dcfa6c98c660c [sys.catalog]: This master's current role is: LEADER
I20260807 08:44:00.755939 31700 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3f173028fab4496897dcfa6c98c660c [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3f173028fab4496897dcfa6c98c660c. Latest consensus state: current_term: 1 leader_uuid: "b3f173028fab4496897dcfa6c98c660c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3f173028fab4496897dcfa6c98c660c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44329 } } }
I20260807 08:44:00.756410 31700 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3f173028fab4496897dcfa6c98c660c [sys.catalog]: This master's current role is: LEADER
W20260807 08:44:00.758396 31712 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b3f173028fab4496897dcfa6c98c660c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:44:00.758486 31712 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:44:00.758584 31713 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:44:00.759191 31713 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:44:00.763679 31713 catalog_manager.cc:1347] Generated new cluster ID: 1225bb51fda6408d958f3efbef519f47
I20260807 08:44:00.763739 31713 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:44:00.769652 31713 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:44:00.770489 31713 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:44:00.778832 31713 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b3f173028fab4496897dcfa6c98c660c: Generated new TSK 0
I20260807 08:44:00.779434 31713 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:44:00.783224 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 31618
W20260807 08:44:00.789937 31603 connection.cc:535] client connection to 127.0.0.1:44329 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44329): Connection reset by peer (error 104)
2026-08-07T08:44:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1396 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:44:00 dist-test-slave-6nmv krb5kdc[31721](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:44:00 dist-test-slave-6nmv krb5kdc[31721](info): set up 2 sockets
Aug 07 08:44:00 dist-test-slave-6nmv krb5kdc[31721](info): commencing operation
krb5kdc: starting...
W20260807 08:44:01.798264 9027 mini_kdc.cc:121] Time spent starting KDC: real 0.994s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:44:01 dist-test-slave-6nmv krb5kdc[31721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092241, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:44:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:44:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 08:44:01.911156 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44953
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44953
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:44:02.016295 31734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:44:02.016556 31734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:44:02.016623 31734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:44:02.020403 31734 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:44:02.020475 31734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:44:02.020516 31734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:44:02.020551 31734 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:44:02.020581 31734 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:44:02.025004 31734 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44953
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44953
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:44:02.025933 31734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:44:02.026847 31734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:44:02.035046 31739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:02.035058 31740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:02.035089 31742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:44:02.035292 31734 server_base.cc:1034] running on GCE node
I20260807 08:44:02.035832 31734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:44:02.036805 31734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:44:02.038039 31734 hybrid_clock.cc:648] HybridClock initialized: now 1786092242038011 us; error 30 us; skew 500 ppm
Aug 07 08:44:02 dist-test-slave-6nmv krb5kdc[31721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092242, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:44:02.040587 31734 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 08:44:02.041379 31734 webserver.cc:460] Webserver started at http://127.0.0.1:44435/ using document root <none> and password file <none>
I20260807 08:44:02.041963 31734 fs_manager.cc:359] Metadata directory not provided
I20260807 08:44:02.042049 31734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:44:02.042261 31734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:44:02.044132 31734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "86f1b8363ab4473f87e59617a9169865"
format_stamp: "Formatted at 2026-08-07 08:44:02 on dist-test-slave-6nmv"
server_key: "76ba7108b451970d9ee09a4c91b38371"
server_key_iv: "b02469585f5ecd6b603bd518dd8d2d60"
server_key_version: "encryptionkey@0"
I20260807 08:44:02.044647 31734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "86f1b8363ab4473f87e59617a9169865"
format_stamp: "Formatted at 2026-08-07 08:44:02 on dist-test-slave-6nmv"
server_key: "76ba7108b451970d9ee09a4c91b38371"
server_key_iv: "b02469585f5ecd6b603bd518dd8d2d60"
server_key_version: "encryptionkey@0"
I20260807 08:44:02.047933 31734 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260807 08:44:02.050014 31750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:44:02.051049 31734 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:44:02.051183 31734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "86f1b8363ab4473f87e59617a9169865"
format_stamp: "Formatted at 2026-08-07 08:44:02 on dist-test-slave-6nmv"
server_key: "76ba7108b451970d9ee09a4c91b38371"
server_key_iv: "b02469585f5ecd6b603bd518dd8d2d60"
server_key_version: "encryptionkey@0"
I20260807 08:44:02.051278 31734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:44:02.055326 31734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:44:02.058367 31734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:44:02.058553 31734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:44:02.065330 31734 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44953
I20260807 08:44:02.065346 31804 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44953 every 8 connection(s)
I20260807 08:44:02.066184 31734 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:44:02.068713 31805 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:44:02.073621 31805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86f1b8363ab4473f87e59617a9169865: Bootstrap starting.
I20260807 08:44:02.076047 31805 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86f1b8363ab4473f87e59617a9169865: Neither blocks nor log segments found. Creating new log.
I20260807 08:44:02.076361 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 31734
I20260807 08:44:02.076521 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:44:02.076824 9027 external_mini_cluster.cc:1428] Setting key 5c905b229e7bbd27b4cab066bb99a95b
I20260807 08:44:02.076959 31805 log.cc:824] T 00000000000000000000000000000000 P 86f1b8363ab4473f87e59617a9169865: Log is configured to *not* fsync() on all Append() calls
I20260807 08:44:02.079005 31805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86f1b8363ab4473f87e59617a9169865: No bootstrap required, opened a new log
I20260807 08:44:02.081485 31809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:02.077902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:40835 (local address 127.0.0.1:44953)
0807 08:44:02.078338 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:02.078351 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:02.078399 (+ 48us) server_negotiation.cc:407] Connection header received
0807 08:44:02.078937 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:02.078950 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:02.079267 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:02.079604 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:02.080415 (+ 811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:02.080420 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:02.080431 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:44:02.080441 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:02.080487 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:44:02.080505 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:02.080624 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:02.080723 (+ 99us) server_negotiation.cc:299] Negotiation successful
0807 08:44:02.080868 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":123,"threads_started":1}
I20260807 08:44:02.082894 31805 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86f1b8363ab4473f87e59617a9169865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86f1b8363ab4473f87e59617a9169865" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44953 } }
I20260807 08:44:02.083163 31805 raft_consensus.cc:374] T 00000000000000000000000000000000 P 86f1b8363ab4473f87e59617a9169865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:44:02.083294 31805 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86f1b8363ab4473f87e59617a9169865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86f1b8363ab4473f87e59617a9169865, State: Initialized, Role: FOLLOWER
I20260807 08:44:02.083720 31805 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86f1b8363ab4473f87e59617a9169865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86f1b8363ab4473f87e59617a9169865" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44953 } }
I20260807 08:44:02.083884 31805 raft_consensus.cc:388] T 00000000000000000000000000000000 P 86f1b8363ab4473f87e59617a9169865 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:44:02.083961 31805 raft_consensus.cc:482] T 00000000000000000000000000000000 P 86f1b8363ab4473f87e59617a9169865 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:44:02.084052 31805 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86f1b8363ab4473f87e59617a9169865 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:44:02.084296 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 08:44:02.085103 31805 raft_consensus.cc:504] T 00000000000000000000000000000000 P 86f1b8363ab4473f87e59617a9169865 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86f1b8363ab4473f87e59617a9169865" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44953 } }
I20260807 08:44:02.085456 31805 leader_election.cc:302] T 00000000000000000000000000000000 P 86f1b8363ab4473f87e59617a9169865 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 86f1b8363ab4473f87e59617a9169865; no voters:
I20260807 08:44:02.085839 31805 leader_election.cc:288] T 00000000000000000000000000000000 P 86f1b8363ab4473f87e59617a9169865 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:44:02.085925 31814 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 86f1b8363ab4473f87e59617a9169865 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:44:02.086128 31814 raft_consensus.cc:686] T 00000000000000000000000000000000 P 86f1b8363ab4473f87e59617a9169865 [term 1 LEADER]: Becoming Leader. State: Replica: 86f1b8363ab4473f87e59617a9169865, State: Running, Role: LEADER
I20260807 08:44:02.086447 31814 consensus_queue.cc:237] T 00000000000000000000000000000000 P 86f1b8363ab4473f87e59617a9169865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86f1b8363ab4473f87e59617a9169865" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44953 } }
I20260807 08:44:02.087137 31805 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86f1b8363ab4473f87e59617a9169865 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:44:02.087787 31814 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86f1b8363ab4473f87e59617a9169865 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86f1b8363ab4473f87e59617a9169865. Latest consensus state: current_term: 1 leader_uuid: "86f1b8363ab4473f87e59617a9169865" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86f1b8363ab4473f87e59617a9169865" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44953 } } }
I20260807 08:44:02.087962 31814 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86f1b8363ab4473f87e59617a9169865 [sys.catalog]: This master's current role is: LEADER
I20260807 08:44:02.088413 31809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:02.086471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:47931 (local address 127.0.0.1:44953)
0807 08:44:02.086585 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:02.086589 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:02.086899 (+ 310us) server_negotiation.cc:407] Connection header received
0807 08:44:02.086998 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:02.087001 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:02.087034 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:02.087127 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:02.087942 (+ 815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:02.087946 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:02.087948 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:44:02.087959 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:02.087997 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:44:02.088010 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:02.088081 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:02.088267 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 08:44:02.088312 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 08:44:02.088407 31826 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:44:02.088996 31815 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86f1b8363ab4473f87e59617a9169865 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "86f1b8363ab4473f87e59617a9169865" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86f1b8363ab4473f87e59617a9169865" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44953 } } }
I20260807 08:44:02.089123 31815 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86f1b8363ab4473f87e59617a9169865 [sys.catalog]: This master's current role is: LEADER
I20260807 08:44:02.091836 31826 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:44:02.097379 31826 catalog_manager.cc:1347] Generated new cluster ID: 9e5479abfd4c4a0fbf712911bc2ac389
I20260807 08:44:02.097450 31826 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:44:02.108719 31826 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:44:02.109027 31826 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:44:02.116705 31826 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 86f1b8363ab4473f87e59617a9169865: Generated new TSK 0
I20260807 08:44:02.117465 31826 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:44:02.129943 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 31734
2026-08-07T08:44:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1347 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:44:02 dist-test-slave-6nmv krb5kdc[31839](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:44:02 dist-test-slave-6nmv krb5kdc[31839](info): set up 2 sockets
Aug 07 08:44:02 dist-test-slave-6nmv krb5kdc[31839](info): commencing operation
krb5kdc: starting...
W20260807 08:44:03.134235 9027 mini_kdc.cc:121] Time spent starting KDC: real 0.982s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:44:03 dist-test-slave-6nmv krb5kdc[31839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092243, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:44:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:44:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 08:44:03.252813 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32891
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32891
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:44:03.358263 31852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:44:03.358500 31852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:44:03.358572 31852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:44:03.362526 31852 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:44:03.362591 31852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:44:03.362608 31852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:44:03.362624 31852 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:44:03.362665 31852 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:44:03.367643 31852 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32891
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32891
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31852
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:44:03.368606 31852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:44:03.369580 31852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:44:03.378237 31857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:03.378242 31858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:44:03.378319 31852 server_base.cc:1034] running on GCE node
W20260807 08:44:03.378518 31860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:44:03.379061 31852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:44:03.380064 31852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:44:03.381255 31852 hybrid_clock.cc:648] HybridClock initialized: now 1786092243381238 us; error 29 us; skew 500 ppm
Aug 07 08:44:03 dist-test-slave-6nmv krb5kdc[31839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092243, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:44:03.383994 31852 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 08:44:03.384874 31852 webserver.cc:460] Webserver started at http://127.0.0.1:39939/ using document root <none> and password file <none>
I20260807 08:44:03.385432 31852 fs_manager.cc:359] Metadata directory not provided
I20260807 08:44:03.385525 31852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:44:03.385746 31852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:44:03.387775 31852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "4585c308cc9845e0a7b34e7f699bc669"
format_stamp: "Formatted at 2026-08-07 08:44:03 on dist-test-slave-6nmv"
server_key: "152f4bc8780a197ddedd020d14d3e5ff"
server_key_iv: "b8e56df572c57f3857685f2f1fe22c1c"
server_key_version: "encryptionkey@0"
I20260807 08:44:03.388360 31852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "4585c308cc9845e0a7b34e7f699bc669"
format_stamp: "Formatted at 2026-08-07 08:44:03 on dist-test-slave-6nmv"
server_key: "152f4bc8780a197ddedd020d14d3e5ff"
server_key_iv: "b8e56df572c57f3857685f2f1fe22c1c"
server_key_version: "encryptionkey@0"
I20260807 08:44:03.391902 31852 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 08:44:03.394217 31867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:44:03.395326 31852 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:44:03.395463 31852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "4585c308cc9845e0a7b34e7f699bc669"
format_stamp: "Formatted at 2026-08-07 08:44:03 on dist-test-slave-6nmv"
server_key: "152f4bc8780a197ddedd020d14d3e5ff"
server_key_iv: "b8e56df572c57f3857685f2f1fe22c1c"
server_key_version: "encryptionkey@0"
I20260807 08:44:03.395568 31852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:44:03.404949 31852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:44:03.407603 31852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:44:03.407795 31852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:44:03.414346 31852 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32891
I20260807 08:44:03.414357 31922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32891 every 8 connection(s)
I20260807 08:44:03.415172 31852 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:44:03.417610 31923 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:44:03.418875 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 31852
I20260807 08:44:03.419006 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:44:03.419309 9027 external_mini_cluster.cc:1428] Setting key 3f0561e252203357f4f728273ef9cfd5
I20260807 08:44:03.423136 31923 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4585c308cc9845e0a7b34e7f699bc669: Bootstrap starting.
I20260807 08:44:03.425102 31923 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4585c308cc9845e0a7b34e7f699bc669: Neither blocks nor log segments found. Creating new log.
I20260807 08:44:03.426020 31923 log.cc:824] T 00000000000000000000000000000000 P 4585c308cc9845e0a7b34e7f699bc669: Log is configured to *not* fsync() on all Append() calls
Aug 07 08:44:03 dist-test-slave-6nmv krb5kdc[31839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092243, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 08:44:03.428206 31923 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4585c308cc9845e0a7b34e7f699bc669: No bootstrap required, opened a new log
I20260807 08:44:03.431228 31923 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4585c308cc9845e0a7b34e7f699bc669 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4585c308cc9845e0a7b34e7f699bc669" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32891 } }
I20260807 08:44:03.431463 31923 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4585c308cc9845e0a7b34e7f699bc669 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:44:03.431525 31923 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4585c308cc9845e0a7b34e7f699bc669 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4585c308cc9845e0a7b34e7f699bc669, State: Initialized, Role: FOLLOWER
I20260807 08:44:03.431981 31923 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4585c308cc9845e0a7b34e7f699bc669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4585c308cc9845e0a7b34e7f699bc669" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32891 } }
I20260807 08:44:03.432106 31923 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4585c308cc9845e0a7b34e7f699bc669 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:44:03.432186 31923 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4585c308cc9845e0a7b34e7f699bc669 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:44:03.432312 31923 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4585c308cc9845e0a7b34e7f699bc669 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:44:03.433199 31923 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4585c308cc9845e0a7b34e7f699bc669 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4585c308cc9845e0a7b34e7f699bc669" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32891 } }
I20260807 08:44:03.433497 31923 leader_election.cc:302] T 00000000000000000000000000000000 P 4585c308cc9845e0a7b34e7f699bc669 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4585c308cc9845e0a7b34e7f699bc669; no voters:
I20260807 08:44:03.433799 31923 leader_election.cc:288] T 00000000000000000000000000000000 P 4585c308cc9845e0a7b34e7f699bc669 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:44:03.433887 31928 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4585c308cc9845e0a7b34e7f699bc669 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:44:03.433900 31926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:03.420614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:44367 (local address 127.0.0.1:32891)
0807 08:44:03.420993 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:03.421006 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:03.421038 (+ 32us) server_negotiation.cc:407] Connection header received
0807 08:44:03.421597 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:03.421611 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:03.421963 (+ 352us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:03.422253 (+ 290us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:03.423021 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:03.423906 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:03.424728 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:03.425168 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:03.425327 (+ 159us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:03.428455 (+ 3128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:03.428460 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:03.428474 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:03.428504 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:03.430676 (+ 2172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:03.431205 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:03.431211 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:03.431216 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:03.431351 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:03.431726 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:03.431730 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:03.431731 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:03.432283 (+ 552us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:03.432522 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:03.432865 (+ 343us) server_negotiation.cc:299] Negotiation successful
0807 08:44:03.433084 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":107,"threads_started":1}
I20260807 08:44:03.434065 31928 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4585c308cc9845e0a7b34e7f699bc669 [term 1 LEADER]: Becoming Leader. State: Replica: 4585c308cc9845e0a7b34e7f699bc669, State: Running, Role: LEADER
I20260807 08:44:03.434357 31928 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4585c308cc9845e0a7b34e7f699bc669 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4585c308cc9845e0a7b34e7f699bc669" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32891 } }
I20260807 08:44:03.434971 31923 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4585c308cc9845e0a7b34e7f699bc669 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:44:03.436729 31930 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4585c308cc9845e0a7b34e7f699bc669 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4585c308cc9845e0a7b34e7f699bc669. Latest consensus state: current_term: 1 leader_uuid: "4585c308cc9845e0a7b34e7f699bc669" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4585c308cc9845e0a7b34e7f699bc669" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32891 } } }
I20260807 08:44:03.436851 31930 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4585c308cc9845e0a7b34e7f699bc669 [sys.catalog]: This master's current role is: LEADER
I20260807 08:44:03.437144 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 08:44:03.437167 31929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4585c308cc9845e0a7b34e7f699bc669 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4585c308cc9845e0a7b34e7f699bc669" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4585c308cc9845e0a7b34e7f699bc669" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32891 } } }
I20260807 08:44:03.437474 31929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4585c308cc9845e0a7b34e7f699bc669 [sys.catalog]: This master's current role is: LEADER
W20260807 08:44:03.439608 31945 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4585c308cc9845e0a7b34e7f699bc669: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:44:03.439668 31945 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:44:03.439742 31944 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:44:03.440398 31944 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:44:03.445501 31944 catalog_manager.cc:1347] Generated new cluster ID: c00e77fa26a54bde9905b5fd06c1eaa7
I20260807 08:44:03.445603 31944 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:44:03.450189 31926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:03.439144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:37269 (local address 127.0.0.1:32891)
0807 08:44:03.439236 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:03.439240 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:03.442093 (+ 2853us) server_negotiation.cc:407] Connection header received
0807 08:44:03.442249 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:03.442254 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:03.442303 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:03.442387 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:03.443013 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:03.443799 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:03.444902 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:03.445228 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:03.445344 (+ 116us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:03.446908 (+ 1564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:03.446912 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:03.446915 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:03.446944 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:03.448398 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:03.448875 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:03.448879 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:03.448882 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:03.448952 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:03.449292 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:03.449295 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:03.449297 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:03.449456 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:03.449625 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:03.449907 (+ 282us) server_negotiation.cc:299] Negotiation successful
0807 08:44:03.449988 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 08:44:03.483227 31944 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:44:03.484330 31944 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:44:03.489305 31944 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4585c308cc9845e0a7b34e7f699bc669: Generated new TSK 0
I20260807 08:44:03.489943 31944 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:44:03.495832 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 31852
W20260807 08:44:03.504192 31837 connection.cc:535] client connection to 127.0.0.1:32891 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:32891): Connection reset by peer (error 104)
2026-08-07T08:44:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1366 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:44:03 dist-test-slave-6nmv krb5kdc[31956](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:44:03 dist-test-slave-6nmv krb5kdc[31956](info): set up 2 sockets
Aug 07 08:44:03 dist-test-slave-6nmv krb5kdc[31956](info): commencing operation
krb5kdc: starting...
W20260807 08:44:04.509887 9027 mini_kdc.cc:121] Time spent starting KDC: real 0.990s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:44:04 dist-test-slave-6nmv krb5kdc[31956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092244, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:44:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:44:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 08:44:04.624454 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43739
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43739
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:44:04.726038 31971 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:44:04.726227 31971 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:44:04.726365 31971 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:44:04.730108 31971 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:44:04.730170 31971 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:44:04.730201 31971 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:44:04.730234 31971 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:44:04.730261 31971 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:44:04.734746 31971 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43739
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31971
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:44:04.735510 31971 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:44:04.736344 31971 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:44:04.743750 31977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:44:04.743868 31971 server_base.cc:1034] running on GCE node
W20260807 08:44:04.743786 31978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:04.743779 31980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:44:04.744370 31971 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:44:04.745252 31971 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:44:04.746413 31971 hybrid_clock.cc:648] HybridClock initialized: now 1786092244746396 us; error 29 us; skew 500 ppm
Aug 07 08:44:04 dist-test-slave-6nmv krb5kdc[31956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092244, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:44:04.749131 31971 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 08:44:04.750000 31971 webserver.cc:460] Webserver started at http://127.0.0.1:45811/ using document root <none> and password file <none>
I20260807 08:44:04.750494 31971 fs_manager.cc:359] Metadata directory not provided
I20260807 08:44:04.750591 31971 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:44:04.750797 31971 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:44:04.752570 31971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "5c9f7c9c63234cafad1c6a946749f111"
format_stamp: "Formatted at 2026-08-07 08:44:04 on dist-test-slave-6nmv"
server_key: "10950aaa31b5f1cf5d572bacaf6661dc"
server_key_iv: "681a5da6d52cf8771f63e7f3b19df459"
server_key_version: "encryptionkey@0"
I20260807 08:44:04.753095 31971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "5c9f7c9c63234cafad1c6a946749f111"
format_stamp: "Formatted at 2026-08-07 08:44:04 on dist-test-slave-6nmv"
server_key: "10950aaa31b5f1cf5d572bacaf6661dc"
server_key_iv: "681a5da6d52cf8771f63e7f3b19df459"
server_key_version: "encryptionkey@0"
I20260807 08:44:04.756112 31971 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 08:44:04.758193 31987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:44:04.759316 31971 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:44:04.759428 31971 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "5c9f7c9c63234cafad1c6a946749f111"
format_stamp: "Formatted at 2026-08-07 08:44:04 on dist-test-slave-6nmv"
server_key: "10950aaa31b5f1cf5d572bacaf6661dc"
server_key_iv: "681a5da6d52cf8771f63e7f3b19df459"
server_key_version: "encryptionkey@0"
I20260807 08:44:04.759516 31971 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:44:04.780159 31971 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:44:04.782987 31971 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:44:04.783156 31971 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:44:04.789295 31971 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43739
I20260807 08:44:04.789322 32041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43739 every 8 connection(s)
I20260807 08:44:04.790134 31971 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:44:04.792563 32042 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:44:04.797565 32042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c9f7c9c63234cafad1c6a946749f111: Bootstrap starting.
I20260807 08:44:04.799778 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 31971
I20260807 08:44:04.799798 32042 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c9f7c9c63234cafad1c6a946749f111: Neither blocks nor log segments found. Creating new log.
I20260807 08:44:04.799885 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:44:04.800153 9027 external_mini_cluster.cc:1428] Setting key 3abf20801b9fdbe5777d0186854c4bf6
I20260807 08:44:04.800522 32042 log.cc:824] T 00000000000000000000000000000000 P 5c9f7c9c63234cafad1c6a946749f111: Log is configured to *not* fsync() on all Append() calls
I20260807 08:44:04.802608 32042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c9f7c9c63234cafad1c6a946749f111: No bootstrap required, opened a new log
I20260807 08:44:04.806483 32042 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c9f7c9c63234cafad1c6a946749f111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c9f7c9c63234cafad1c6a946749f111" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43739 } }
I20260807 08:44:04.806712 32042 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c9f7c9c63234cafad1c6a946749f111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:44:04.806763 32042 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c9f7c9c63234cafad1c6a946749f111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c9f7c9c63234cafad1c6a946749f111, State: Initialized, Role: FOLLOWER
I20260807 08:44:04.807235 32042 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c9f7c9c63234cafad1c6a946749f111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c9f7c9c63234cafad1c6a946749f111" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43739 } }
I20260807 08:44:04.807394 32042 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5c9f7c9c63234cafad1c6a946749f111 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:44:04.807461 32042 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c9f7c9c63234cafad1c6a946749f111 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:44:04.807554 32042 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c9f7c9c63234cafad1c6a946749f111 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:44:04.808594 32042 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c9f7c9c63234cafad1c6a946749f111 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c9f7c9c63234cafad1c6a946749f111" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43739 } }
I20260807 08:44:04.808935 32042 leader_election.cc:302] T 00000000000000000000000000000000 P 5c9f7c9c63234cafad1c6a946749f111 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c9f7c9c63234cafad1c6a946749f111; no voters:
I20260807 08:44:04.809187 32047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:04.801086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:44595 (local address 127.0.0.1:43739)
0807 08:44:04.801464 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:04.801480 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:04.801518 (+ 38us) server_negotiation.cc:407] Connection header received
0807 08:44:04.802320 (+ 802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:04.802342 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:04.802727 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:04.803046 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:04.803385 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:04.804804 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:04.805701 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:04.806345 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:04.806497 (+ 152us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:04.807337 (+ 840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:04.807346 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:04.807362 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:44:04.807847 (+ 485us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:04.807912 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:44:04.807938 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:04.808065 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:04.808219 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 08:44:04.808349 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":104,"threads_started":1}
I20260807 08:44:04.809250 32042 leader_election.cc:288] T 00000000000000000000000000000000 P 5c9f7c9c63234cafad1c6a946749f111 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:44:04.809357 32048 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c9f7c9c63234cafad1c6a946749f111 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:44:04.809574 32048 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c9f7c9c63234cafad1c6a946749f111 [term 1 LEADER]: Becoming Leader. State: Replica: 5c9f7c9c63234cafad1c6a946749f111, State: Running, Role: LEADER
I20260807 08:44:04.809899 32048 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c9f7c9c63234cafad1c6a946749f111 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c9f7c9c63234cafad1c6a946749f111" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43739 } }
I20260807 08:44:04.810317 32042 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c9f7c9c63234cafad1c6a946749f111 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:44:04.811512 32049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c9f7c9c63234cafad1c6a946749f111 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c9f7c9c63234cafad1c6a946749f111" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c9f7c9c63234cafad1c6a946749f111" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43739 } } }
I20260807 08:44:04.811666 32049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c9f7c9c63234cafad1c6a946749f111 [sys.catalog]: This master's current role is: LEADER
I20260807 08:44:04.812009 32050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c9f7c9c63234cafad1c6a946749f111 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c9f7c9c63234cafad1c6a946749f111. Latest consensus state: current_term: 1 leader_uuid: "5c9f7c9c63234cafad1c6a946749f111" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c9f7c9c63234cafad1c6a946749f111" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43739 } } }
I20260807 08:44:04.812093 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 08:44:04.812144 32050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c9f7c9c63234cafad1c6a946749f111 [sys.catalog]: This master's current role is: LEADER
W20260807 08:44:04.815006 32064 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5c9f7c9c63234cafad1c6a946749f111: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:44:04.815073 32064 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:44:04.815156 32059 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:44:04.815761 32059 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:44:04.818609 32047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:04.814283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:53005 (local address 127.0.0.1:43739)
0807 08:44:04.814366 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:04.814369 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:04.814566 (+ 197us) server_negotiation.cc:407] Connection header received
0807 08:44:04.814658 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:04.814661 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:04.814701 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:04.814774 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:04.815021 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:04.815665 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:04.816689 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:04.816986 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:04.817059 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:04.818147 (+ 1088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:04.818150 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:04.818153 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:44:04.818165 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:04.818190 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:44:04.818203 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:04.818304 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:04.818475 (+ 171us) server_negotiation.cc:299] Negotiation successful
0807 08:44:04.818505 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 08:44:04.820585 32059 catalog_manager.cc:1347] Generated new cluster ID: ff6c46b12a5647118bf410761e084bdd
I20260807 08:44:04.820637 32059 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:44:04.830493 32059 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:44:04.831578 32059 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:44:04.838474 32059 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5c9f7c9c63234cafad1c6a946749f111: Generated new TSK 0
I20260807 08:44:04.839154 32059 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:44:04.844990 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 31971
W20260807 08:44:04.852010 31954 connection.cc:535] client connection to 127.0.0.1:43739 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43739): Connection reset by peer (error 104)
2026-08-07T08:44:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1346 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:44:04 dist-test-slave-6nmv krb5kdc[32075](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:44:04 dist-test-slave-6nmv krb5kdc[32075](info): set up 2 sockets
Aug 07 08:44:04 dist-test-slave-6nmv krb5kdc[32075](info): commencing operation
krb5kdc: starting...
W20260807 08:44:05.876839 9027 mini_kdc.cc:121] Time spent starting KDC: real 1.011s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:44:05 dist-test-slave-6nmv krb5kdc[32075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092245, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:44:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:44:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 08:44:05.990549 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39135
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39135
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:44:06.092001 32089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:44:06.092216 32089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:44:06.092255 32089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:44:06.096120 32089 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:44:06.096165 32089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:44:06.096182 32089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:44:06.096196 32089 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:44:06.096210 32089 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:44:06.100884 32089 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39135
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39135
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32089
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:44:06.101718 32089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:44:06.102667 32089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:44:06.110682 32094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:06.110737 32095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:44:06.110808 32089 server_base.cc:1034] running on GCE node
W20260807 08:44:06.110689 32097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:44:06.111389 32089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:44:06.112385 32089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:44:06.113564 32089 hybrid_clock.cc:648] HybridClock initialized: now 1786092246113545 us; error 41 us; skew 500 ppm
Aug 07 08:44:06 dist-test-slave-6nmv krb5kdc[32075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092246, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:44:06.121347 32089 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 08:44:06.122257 32089 webserver.cc:460] Webserver started at http://127.0.0.1:33383/ using document root <none> and password file <none>
I20260807 08:44:06.122779 32089 fs_manager.cc:359] Metadata directory not provided
I20260807 08:44:06.122861 32089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:44:06.123076 32089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:44:06.124927 32089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "db63dae554024453b9ced4e07459bdcf"
format_stamp: "Formatted at 2026-08-07 08:44:06 on dist-test-slave-6nmv"
server_key: "2d64e97b5f2b8b08bd572b7009b54b75"
server_key_iv: "c21efbd632311ae1d79df6f8658f6782"
server_key_version: "encryptionkey@0"
I20260807 08:44:06.125487 32089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "db63dae554024453b9ced4e07459bdcf"
format_stamp: "Formatted at 2026-08-07 08:44:06 on dist-test-slave-6nmv"
server_key: "2d64e97b5f2b8b08bd572b7009b54b75"
server_key_iv: "c21efbd632311ae1d79df6f8658f6782"
server_key_version: "encryptionkey@0"
I20260807 08:44:06.128854 32089 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 08:44:06.131019 32104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:44:06.132093 32089 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 08:44:06.132238 32089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "db63dae554024453b9ced4e07459bdcf"
format_stamp: "Formatted at 2026-08-07 08:44:06 on dist-test-slave-6nmv"
server_key: "2d64e97b5f2b8b08bd572b7009b54b75"
server_key_iv: "c21efbd632311ae1d79df6f8658f6782"
server_key_version: "encryptionkey@0"
I20260807 08:44:06.132342 32089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:44:06.136485 32089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:44:06.139142 32089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:44:06.139315 32089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:44:06.146044 32089 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39135
I20260807 08:44:06.146087 32160 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39135 every 8 connection(s)
I20260807 08:44:06.146793 32089 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:44:06.149210 32161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:44:06.154035 32161 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db63dae554024453b9ced4e07459bdcf: Bootstrap starting.
I20260807 08:44:06.155478 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 32089
I20260807 08:44:06.155612 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:44:06.155882 9027 external_mini_cluster.cc:1428] Setting key 074ec3517501a122977d015a239f615f
I20260807 08:44:06.156577 32161 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db63dae554024453b9ced4e07459bdcf: Neither blocks nor log segments found. Creating new log.
I20260807 08:44:06.157447 32161 log.cc:824] T 00000000000000000000000000000000 P db63dae554024453b9ced4e07459bdcf: Log is configured to *not* fsync() on all Append() calls
I20260807 08:44:06.159495 32161 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db63dae554024453b9ced4e07459bdcf: No bootstrap required, opened a new log
I20260807 08:44:06.160728 32164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:06.156895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:41333 (local address 127.0.0.1:39135)
0807 08:44:06.157317 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:06.157331 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:06.157364 (+ 33us) server_negotiation.cc:407] Connection header received
0807 08:44:06.158226 (+ 862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:06.158254 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:06.158542 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:06.158814 (+ 272us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:06.159620 (+ 806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:06.159624 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:06.159634 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:44:06.159644 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:06.159693 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:44:06.159710 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:06.159789 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:06.159933 (+ 144us) server_negotiation.cc:299] Negotiation successful
0807 08:44:06.160088 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":139,"threads_started":1}
I20260807 08:44:06.163277 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 08:44:06.163151 32161 raft_consensus.cc:348] T 00000000000000000000000000000000 P db63dae554024453b9ced4e07459bdcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db63dae554024453b9ced4e07459bdcf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39135 } }
I20260807 08:44:06.163386 32161 raft_consensus.cc:374] T 00000000000000000000000000000000 P db63dae554024453b9ced4e07459bdcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:44:06.163472 32161 raft_consensus.cc:729] T 00000000000000000000000000000000 P db63dae554024453b9ced4e07459bdcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db63dae554024453b9ced4e07459bdcf, State: Initialized, Role: FOLLOWER
I20260807 08:44:06.163888 32161 consensus_queue.cc:260] T 00000000000000000000000000000000 P db63dae554024453b9ced4e07459bdcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db63dae554024453b9ced4e07459bdcf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39135 } }
I20260807 08:44:06.163993 32161 raft_consensus.cc:388] T 00000000000000000000000000000000 P db63dae554024453b9ced4e07459bdcf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:44:06.164072 32161 raft_consensus.cc:482] T 00000000000000000000000000000000 P db63dae554024453b9ced4e07459bdcf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:44:06.164175 32161 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db63dae554024453b9ced4e07459bdcf [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:44:06.165004 32161 raft_consensus.cc:504] T 00000000000000000000000000000000 P db63dae554024453b9ced4e07459bdcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db63dae554024453b9ced4e07459bdcf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39135 } }
I20260807 08:44:06.165356 32161 leader_election.cc:302] T 00000000000000000000000000000000 P db63dae554024453b9ced4e07459bdcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: db63dae554024453b9ced4e07459bdcf; no voters:
I20260807 08:44:06.165683 32161 leader_election.cc:288] T 00000000000000000000000000000000 P db63dae554024453b9ced4e07459bdcf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:44:06.165766 32171 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db63dae554024453b9ced4e07459bdcf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:44:06.166000 32171 raft_consensus.cc:686] T 00000000000000000000000000000000 P db63dae554024453b9ced4e07459bdcf [term 1 LEADER]: Becoming Leader. State: Replica: db63dae554024453b9ced4e07459bdcf, State: Running, Role: LEADER
I20260807 08:44:06.166347 32171 consensus_queue.cc:237] T 00000000000000000000000000000000 P db63dae554024453b9ced4e07459bdcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db63dae554024453b9ced4e07459bdcf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39135 } }
I20260807 08:44:06.166846 32161 sys_catalog.cc:564] T 00000000000000000000000000000000 P db63dae554024453b9ced4e07459bdcf [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:44:06.167342 32164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:06.165410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:34239 (local address 127.0.0.1:39135)
0807 08:44:06.165529 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:06.165533 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:06.165772 (+ 239us) server_negotiation.cc:407] Connection header received
0807 08:44:06.165969 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:06.165975 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:06.166021 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:06.166100 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:06.166888 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:06.166891 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:06.166894 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:44:06.166905 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:06.166929 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:44:06.166940 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:06.167005 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:06.167170 (+ 165us) server_negotiation.cc:299] Negotiation successful
0807 08:44:06.167213 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 08:44:06.168031 32174 sys_catalog.cc:455] T 00000000000000000000000000000000 P db63dae554024453b9ced4e07459bdcf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "db63dae554024453b9ced4e07459bdcf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db63dae554024453b9ced4e07459bdcf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39135 } } }
I20260807 08:44:06.168154 32174 sys_catalog.cc:458] T 00000000000000000000000000000000 P db63dae554024453b9ced4e07459bdcf [sys.catalog]: This master's current role is: LEADER
I20260807 08:44:06.168411 32174 sys_catalog.cc:455] T 00000000000000000000000000000000 P db63dae554024453b9ced4e07459bdcf [sys.catalog]: SysCatalogTable state changed. Reason: New leader db63dae554024453b9ced4e07459bdcf. Latest consensus state: current_term: 1 leader_uuid: "db63dae554024453b9ced4e07459bdcf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db63dae554024453b9ced4e07459bdcf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39135 } } }
I20260807 08:44:06.168502 32174 sys_catalog.cc:458] T 00000000000000000000000000000000 P db63dae554024453b9ced4e07459bdcf [sys.catalog]: This master's current role is: LEADER
I20260807 08:44:06.168537 32181 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:44:06.170971 32181 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:44:06.175489 32181 catalog_manager.cc:1347] Generated new cluster ID: 163613ed6b0b4be69852e47621b0123e
I20260807 08:44:06.175554 32181 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:44:06.181403 32181 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:44:06.181641 32181 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:44:06.186755 32181 catalog_manager.cc:5868] T 00000000000000000000000000000000 P db63dae554024453b9ced4e07459bdcf: Generated new TSK 0
I20260807 08:44:06.187333 32181 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:44:06.194288 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 32089
2026-08-07T08:44:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1349 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:44:06 dist-test-slave-6nmv krb5kdc[32195](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:44:06 dist-test-slave-6nmv krb5kdc[32195](info): set up 2 sockets
Aug 07 08:44:06 dist-test-slave-6nmv krb5kdc[32195](info): commencing operation
krb5kdc: starting...
W20260807 08:44:07.210116 9027 mini_kdc.cc:121] Time spent starting KDC: real 0.995s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:44:07 dist-test-slave-6nmv krb5kdc[32195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092247, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:44:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:44:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:44:07.328636 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:41239
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:34811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:41239
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:44:07.436636 32210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:44:07.436843 32210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:44:07.436878 32210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:44:07.440651 32210 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:44:07.440699 32210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:44:07.440717 32210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:44:07.440732 32210 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:44:07.440745 32210 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:44:07.445451 32210 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:34811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:41239
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:41239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32210
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:44:07.446427 32210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:44:07.447350 32210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:44:07.455154 32218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:07.455132 32216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:07.455163 32215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:44:07.455552 32210 server_base.cc:1034] running on GCE node
I20260807 08:44:07.456073 32210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:44:07.457049 32210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:44:07.458210 32210 hybrid_clock.cc:648] HybridClock initialized: now 1786092247458190 us; error 34 us; skew 500 ppm
Aug 07 08:44:07 dist-test-slave-6nmv krb5kdc[32195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092247, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:44:07.461284 32210 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:44:07.462203 32210 webserver.cc:460] Webserver started at http://127.8.208.254:39345/ using document root <none> and password file <none>
I20260807 08:44:07.462723 32210 fs_manager.cc:359] Metadata directory not provided
I20260807 08:44:07.462814 32210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:44:07.463032 32210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:44:07.464977 32210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "4848f91a9bb74229b21ebb2206c38159"
format_stamp: "Formatted at 2026-08-07 08:44:07 on dist-test-slave-6nmv"
server_key: "ea62b6cee96a8fe48b5944b15c37d994"
server_key_iv: "7f6265acfdb8a3a4e25a2d1592f274d8"
server_key_version: "encryptionkey@0"
I20260807 08:44:07.465517 32210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "4848f91a9bb74229b21ebb2206c38159"
format_stamp: "Formatted at 2026-08-07 08:44:07 on dist-test-slave-6nmv"
server_key: "ea62b6cee96a8fe48b5944b15c37d994"
server_key_iv: "7f6265acfdb8a3a4e25a2d1592f274d8"
server_key_version: "encryptionkey@0"
I20260807 08:44:07.469061 32210 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 08:44:07.471201 32225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:44:07.472278 32210 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 08:44:07.472424 32210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "4848f91a9bb74229b21ebb2206c38159"
format_stamp: "Formatted at 2026-08-07 08:44:07 on dist-test-slave-6nmv"
server_key: "ea62b6cee96a8fe48b5944b15c37d994"
server_key_iv: "7f6265acfdb8a3a4e25a2d1592f274d8"
server_key_version: "encryptionkey@0"
I20260807 08:44:07.472529 32210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:44:07.488821 32210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:44:07.491660 32210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:44:07.491858 32210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:44:07.499089 32210 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:41239
I20260807 08:44:07.499114 32280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:41239 every 8 connection(s)
I20260807 08:44:07.499984 32210 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:44:07.502737 32281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:44:07.505156 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 32210
I20260807 08:44:07.505266 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:44:07.505570 9027 external_mini_cluster.cc:1428] Setting key c0489ce4c340a5cea1736e9b761df3be
I20260807 08:44:07.508777 32281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4848f91a9bb74229b21ebb2206c38159: Bootstrap starting.
I20260807 08:44:07.510996 32281 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4848f91a9bb74229b21ebb2206c38159: Neither blocks nor log segments found. Creating new log.
I20260807 08:44:07.511788 32281 log.cc:824] T 00000000000000000000000000000000 P 4848f91a9bb74229b21ebb2206c38159: Log is configured to *not* fsync() on all Append() calls
I20260807 08:44:07.513633 32281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4848f91a9bb74229b21ebb2206c38159: No bootstrap required, opened a new log
Aug 07 08:44:07 dist-test-slave-6nmv krb5kdc[32195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092247, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:44:07.517103 32281 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4848f91a9bb74229b21ebb2206c38159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4848f91a9bb74229b21ebb2206c38159" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 41239 } }
I20260807 08:44:07.517292 32281 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4848f91a9bb74229b21ebb2206c38159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:44:07.517367 32281 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4848f91a9bb74229b21ebb2206c38159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4848f91a9bb74229b21ebb2206c38159, State: Initialized, Role: FOLLOWER
I20260807 08:44:07.517863 32281 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4848f91a9bb74229b21ebb2206c38159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4848f91a9bb74229b21ebb2206c38159" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 41239 } }
I20260807 08:44:07.517998 32281 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4848f91a9bb74229b21ebb2206c38159 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:44:07.518080 32281 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4848f91a9bb74229b21ebb2206c38159 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:44:07.518177 32281 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4848f91a9bb74229b21ebb2206c38159 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:44:07.519016 32281 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4848f91a9bb74229b21ebb2206c38159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4848f91a9bb74229b21ebb2206c38159" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 41239 } }
I20260807 08:44:07.519403 32281 leader_election.cc:302] T 00000000000000000000000000000000 P 4848f91a9bb74229b21ebb2206c38159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4848f91a9bb74229b21ebb2206c38159; no voters:
I20260807 08:44:07.519752 32281 leader_election.cc:288] T 00000000000000000000000000000000 P 4848f91a9bb74229b21ebb2206c38159 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:44:07.519862 32287 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4848f91a9bb74229b21ebb2206c38159 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:44:07.520102 32287 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4848f91a9bb74229b21ebb2206c38159 [term 1 LEADER]: Becoming Leader. State: Replica: 4848f91a9bb74229b21ebb2206c38159, State: Running, Role: LEADER
I20260807 08:44:07.520475 32287 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4848f91a9bb74229b21ebb2206c38159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4848f91a9bb74229b21ebb2206c38159" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 41239 } }
I20260807 08:44:07.520570 32285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:07.507004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36581 (local address 127.8.208.254:41239)
0807 08:44:07.507457 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:07.507472 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:07.507505 (+ 33us) server_negotiation.cc:407] Connection header received
0807 08:44:07.508119 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:07.508133 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:07.508459 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:07.508785 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:07.509548 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:07.510500 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:07.511386 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:07.511892 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:07.512061 (+ 169us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:07.515030 (+ 2969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:07.515035 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:07.515046 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:07.515071 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:07.516946 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:07.517573 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:07.517578 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:07.517582 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:07.517700 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:07.518198 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:07.518202 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:07.518206 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:07.518663 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:07.518912 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:07.519263 (+ 351us) server_negotiation.cc:299] Negotiation successful
0807 08:44:07.519512 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":142,"threads_started":1}
I20260807 08:44:07.520979 32281 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4848f91a9bb74229b21ebb2206c38159 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:44:07.521665 32287 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4848f91a9bb74229b21ebb2206c38159 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4848f91a9bb74229b21ebb2206c38159. Latest consensus state: current_term: 1 leader_uuid: "4848f91a9bb74229b21ebb2206c38159" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4848f91a9bb74229b21ebb2206c38159" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 41239 } } }
I20260807 08:44:07.521867 32287 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4848f91a9bb74229b21ebb2206c38159 [sys.catalog]: This master's current role is: LEADER
I20260807 08:44:07.522114 32288 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4848f91a9bb74229b21ebb2206c38159 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4848f91a9bb74229b21ebb2206c38159" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4848f91a9bb74229b21ebb2206c38159" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 41239 } } }
I20260807 08:44:07.522207 32288 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4848f91a9bb74229b21ebb2206c38159 [sys.catalog]: This master's current role is: LEADER
I20260807 08:44:07.522285 32295 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:44:07.523782 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 08:44:07.525520 32295 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:44:07.531210 32295 catalog_manager.cc:1347] Generated new cluster ID: 5b18508519d74953a8fe8364bb7970c9
I20260807 08:44:07.531278 32295 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:44:07.537326 32285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:07.526101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59435 (local address 127.8.208.254:41239)
0807 08:44:07.526192 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:07.526196 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:07.526597 (+ 401us) server_negotiation.cc:407] Connection header received
0807 08:44:07.526755 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:07.526757 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:07.526793 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:07.526871 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:07.527534 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:07.528264 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:07.529341 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:07.529584 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:07.529692 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:07.534388 (+ 4696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:07.534391 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:07.534392 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:07.534411 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:07.535732 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:07.536171 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:07.536179 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:07.536181 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:07.536247 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:07.536559 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:07.536562 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:07.536564 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:07.536716 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:07.536871 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:07.537108 (+ 237us) server_negotiation.cc:299] Negotiation successful
0807 08:44:07.537192 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 08:44:07.539512 32295 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:44:07.540514 32295 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:44:07.547895 32295 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4848f91a9bb74229b21ebb2206c38159: Generated new TSK 0
I20260807 08:44:07.548599 32295 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:44:07.554409 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 32210
W20260807 08:44:07.562992 32193 connection.cc:535] client connection to 127.8.208.254:41239 recv error: Network error: failed to read from TLS socket (remote: 127.8.208.254:41239): Connection reset by peer (error 104)
2026-08-07T08:44:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1362 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:44:07 dist-test-slave-6nmv krb5kdc[32315](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:44:07 dist-test-slave-6nmv krb5kdc[32315](info): set up 2 sockets
Aug 07 08:44:07 dist-test-slave-6nmv krb5kdc[32315](info): commencing operation
krb5kdc: starting...
W20260807 08:44:08.572577 9027 mini_kdc.cc:121] Time spent starting KDC: real 0.995s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:44:08 dist-test-slave-6nmv krb5kdc[32315](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:44:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:44:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:44:08.690421 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:45101
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:38493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:45101
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:44:08.791896 32328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:44:08.792115 32328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:44:08.792152 32328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:44:08.795799 32328 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:44:08.795846 32328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:44:08.795863 32328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:44:08.795885 32328 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:44:08.795899 32328 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:44:08.800760 32328 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:38493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:45101
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:45101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:44:08.801726 32328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:44:08.802695 32328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:44:08.811501 32338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:08.811497 32336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:08.811506 32333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:44:08.811997 32328 server_base.cc:1034] running on GCE node
I20260807 08:44:08.812902 32328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:44:08.814184 32328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:44:08.815411 32328 hybrid_clock.cc:648] HybridClock initialized: now 1786092248815465 us; error 165 us; skew 500 ppm
Aug 07 08:44:08 dist-test-slave-6nmv krb5kdc[32315](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092248, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:44:08.820083 32328 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:44:08.821357 32328 webserver.cc:460] Webserver started at http://127.8.208.254:35435/ using document root <none> and password file <none>
I20260807 08:44:08.822093 32328 fs_manager.cc:359] Metadata directory not provided
I20260807 08:44:08.822175 32328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:44:08.822427 32328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:44:08.825729 32328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "01127f3132bd4df2a4ae43b9140abd95"
format_stamp: "Formatted at 2026-08-07 08:44:08 on dist-test-slave-6nmv"
server_key: "c3dc7a87c6bf2909962e8baded2b4baa"
server_key_iv: "637a19f644eed74661e6ff51519f13f3"
server_key_version: "encryptionkey@0"
I20260807 08:44:08.826532 32328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "01127f3132bd4df2a4ae43b9140abd95"
format_stamp: "Formatted at 2026-08-07 08:44:08 on dist-test-slave-6nmv"
server_key: "c3dc7a87c6bf2909962e8baded2b4baa"
server_key_iv: "637a19f644eed74661e6ff51519f13f3"
server_key_version: "encryptionkey@0"
I20260807 08:44:08.832541 32328 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 08:44:08.835786 32346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:44:08.837445 32328 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 08:44:08.837586 32328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "01127f3132bd4df2a4ae43b9140abd95"
format_stamp: "Formatted at 2026-08-07 08:44:08 on dist-test-slave-6nmv"
server_key: "c3dc7a87c6bf2909962e8baded2b4baa"
server_key_iv: "637a19f644eed74661e6ff51519f13f3"
server_key_version: "encryptionkey@0"
I20260807 08:44:08.837764 32328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:44:08.852603 32328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:44:08.856119 32328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:44:08.856333 32328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:44:08.863541 32328 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:45101
I20260807 08:44:08.863586 32402 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:45101 every 8 connection(s)
I20260807 08:44:08.864436 32328 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:44:08.865778 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 32328
I20260807 08:44:08.865988 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:44:08.866324 9027 external_mini_cluster.cc:1428] Setting key e9f650adec950323bc04a187c7016180
I20260807 08:44:08.867595 32403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:44:08.873467 32403 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01127f3132bd4df2a4ae43b9140abd95: Bootstrap starting.
I20260807 08:44:08.874730 32406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:08.867707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42829 (local address 127.8.208.254:45101)
0807 08:44:08.868127 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:08.868142 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:08.868175 (+ 33us) server_negotiation.cc:407] Connection header received
0807 08:44:08.868795 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:08.868808 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:08.869120 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:08.869366 (+ 246us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:08.869723 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:08.870637 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:08.871782 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:08.872193 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:08.872316 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:08.873178 (+ 862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:08.873182 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:08.873193 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:44:08.873507 (+ 314us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:08.873555 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:44:08.873604 (+ 49us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:08.873716 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:08.873946 (+ 230us) server_negotiation.cc:299] Negotiation successful
0807 08:44:08.874078 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":135,"threads_started":1}
I20260807 08:44:08.875644 32403 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 01127f3132bd4df2a4ae43b9140abd95: Neither blocks nor log segments found. Creating new log.
I20260807 08:44:08.876310 32403 log.cc:824] T 00000000000000000000000000000000 P 01127f3132bd4df2a4ae43b9140abd95: Log is configured to *not* fsync() on all Append() calls
I20260807 08:44:08.877506 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 08:44:08.878599 32403 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01127f3132bd4df2a4ae43b9140abd95: No bootstrap required, opened a new log
I20260807 08:44:08.881939 32403 raft_consensus.cc:348] T 00000000000000000000000000000000 P 01127f3132bd4df2a4ae43b9140abd95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01127f3132bd4df2a4ae43b9140abd95" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45101 } }
I20260807 08:44:08.882189 32403 raft_consensus.cc:374] T 00000000000000000000000000000000 P 01127f3132bd4df2a4ae43b9140abd95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:44:08.882265 32403 raft_consensus.cc:729] T 00000000000000000000000000000000 P 01127f3132bd4df2a4ae43b9140abd95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01127f3132bd4df2a4ae43b9140abd95, State: Initialized, Role: FOLLOWER
I20260807 08:44:08.882683 32403 consensus_queue.cc:260] T 00000000000000000000000000000000 P 01127f3132bd4df2a4ae43b9140abd95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01127f3132bd4df2a4ae43b9140abd95" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45101 } }
I20260807 08:44:08.882851 32403 raft_consensus.cc:388] T 00000000000000000000000000000000 P 01127f3132bd4df2a4ae43b9140abd95 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:44:08.882923 32403 raft_consensus.cc:482] T 00000000000000000000000000000000 P 01127f3132bd4df2a4ae43b9140abd95 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:44:08.883016 32403 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 01127f3132bd4df2a4ae43b9140abd95 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:44:08.883654 32406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:08.879666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56685 (local address 127.8.208.254:45101)
0807 08:44:08.879773 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:08.879776 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:08.879956 (+ 180us) server_negotiation.cc:407] Connection header received
0807 08:44:08.880046 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:08.880048 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:08.880079 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:08.880137 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:08.880415 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:08.881142 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:08.882104 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:08.882384 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:08.882453 (+ 69us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:08.883228 (+ 775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:08.883231 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:08.883232 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:44:08.883241 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:08.883260 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:44:08.883268 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:08.883327 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:08.883489 (+ 162us) server_negotiation.cc:299] Negotiation successful
0807 08:44:08.883514 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 08:44:08.884052 32403 raft_consensus.cc:504] T 00000000000000000000000000000000 P 01127f3132bd4df2a4ae43b9140abd95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01127f3132bd4df2a4ae43b9140abd95" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45101 } }
I20260807 08:44:08.884368 32403 leader_election.cc:302] T 00000000000000000000000000000000 P 01127f3132bd4df2a4ae43b9140abd95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 01127f3132bd4df2a4ae43b9140abd95; no voters:
I20260807 08:44:08.884677 32403 leader_election.cc:288] T 00000000000000000000000000000000 P 01127f3132bd4df2a4ae43b9140abd95 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:44:08.884766 32414 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 01127f3132bd4df2a4ae43b9140abd95 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:44:08.884936 32414 raft_consensus.cc:686] T 00000000000000000000000000000000 P 01127f3132bd4df2a4ae43b9140abd95 [term 1 LEADER]: Becoming Leader. State: Replica: 01127f3132bd4df2a4ae43b9140abd95, State: Running, Role: LEADER
I20260807 08:44:08.885195 32414 consensus_queue.cc:237] T 00000000000000000000000000000000 P 01127f3132bd4df2a4ae43b9140abd95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01127f3132bd4df2a4ae43b9140abd95" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45101 } }
I20260807 08:44:08.885794 32403 sys_catalog.cc:564] T 00000000000000000000000000000000 P 01127f3132bd4df2a4ae43b9140abd95 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:44:08.886823 32415 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01127f3132bd4df2a4ae43b9140abd95 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "01127f3132bd4df2a4ae43b9140abd95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01127f3132bd4df2a4ae43b9140abd95" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45101 } } }
I20260807 08:44:08.886960 32415 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01127f3132bd4df2a4ae43b9140abd95 [sys.catalog]: This master's current role is: LEADER
I20260807 08:44:08.886865 32416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01127f3132bd4df2a4ae43b9140abd95 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 01127f3132bd4df2a4ae43b9140abd95. Latest consensus state: current_term: 1 leader_uuid: "01127f3132bd4df2a4ae43b9140abd95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01127f3132bd4df2a4ae43b9140abd95" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 45101 } } }
I20260807 08:44:08.887080 32416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01127f3132bd4df2a4ae43b9140abd95 [sys.catalog]: This master's current role is: LEADER
W20260807 08:44:08.890484 32430 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 01127f3132bd4df2a4ae43b9140abd95: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:44:08.890586 32430 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:44:08.890661 32423 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:44:08.891446 32423 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:44:08.895965 32423 catalog_manager.cc:1347] Generated new cluster ID: 70c3d431cb1444fabaa3d52b87ddf18c
I20260807 08:44:08.896024 32423 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:44:08.900795 32423 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:44:08.901489 32423 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:44:08.918815 32423 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 01127f3132bd4df2a4ae43b9140abd95: Generated new TSK 0
I20260807 08:44:08.919343 32423 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:44:08.931408 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 32328
W20260807 08:44:08.939133 32313 connection.cc:535] client connection to 127.8.208.254:45101 recv error: Network error: failed to read from TLS socket (remote: 127.8.208.254:45101): Connection reset by peer (error 104)
2026-08-07T08:44:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1377 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:44:08 dist-test-slave-6nmv krb5kdc[32436](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:44:08 dist-test-slave-6nmv krb5kdc[32436](info): set up 2 sockets
Aug 07 08:44:08 dist-test-slave-6nmv krb5kdc[32436](info): commencing operation
krb5kdc: starting...
W20260807 08:44:09.962240 9027 mini_kdc.cc:121] Time spent starting KDC: real 1.007s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:44:10 dist-test-slave-6nmv krb5kdc[32436](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092250, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:44:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:44:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:44:10.086591 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:40275
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:45329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:40275
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:44:10.193122 32450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:44:10.193380 32450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:44:10.193459 32450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:44:10.197400 32450 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:44:10.197487 32450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:44:10.197522 32450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:44:10.197558 32450 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:44:10.197593 32450 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:44:10.202206 32450 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:45329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:40275
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:40275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:44:10.203094 32450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:44:10.204031 32450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:44:10.212049 32458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:10.212055 32456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:10.212056 32455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:44:10.212409 32450 server_base.cc:1034] running on GCE node
I20260807 08:44:10.212976 32450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:44:10.214061 32450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:44:10.215220 32450 hybrid_clock.cc:648] HybridClock initialized: now 1786092250215204 us; error 29 us; skew 500 ppm
Aug 07 08:44:10 dist-test-slave-6nmv krb5kdc[32436](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092250, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:44:10.222214 32450 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:44:10.223002 32450 webserver.cc:460] Webserver started at http://127.8.208.254:42939/ using document root <none> and password file <none>
I20260807 08:44:10.223487 32450 fs_manager.cc:359] Metadata directory not provided
I20260807 08:44:10.223585 32450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:44:10.223819 32450 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:44:10.225666 32450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "e497c56f189a42c1ab0c96bdd301f3fe"
format_stamp: "Formatted at 2026-08-07 08:44:10 on dist-test-slave-6nmv"
server_key: "0ea89c622039be21c6e32638b4a2d5e4"
server_key_iv: "e103c0574085e4b56ab25b37b8b3b98f"
server_key_version: "encryptionkey@0"
I20260807 08:44:10.226218 32450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "e497c56f189a42c1ab0c96bdd301f3fe"
format_stamp: "Formatted at 2026-08-07 08:44:10 on dist-test-slave-6nmv"
server_key: "0ea89c622039be21c6e32638b4a2d5e4"
server_key_iv: "e103c0574085e4b56ab25b37b8b3b98f"
server_key_version: "encryptionkey@0"
I20260807 08:44:10.229677 32450 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 08:44:10.231936 32465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:44:10.233026 32450 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:44:10.233168 32450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "e497c56f189a42c1ab0c96bdd301f3fe"
format_stamp: "Formatted at 2026-08-07 08:44:10 on dist-test-slave-6nmv"
server_key: "0ea89c622039be21c6e32638b4a2d5e4"
server_key_iv: "e103c0574085e4b56ab25b37b8b3b98f"
server_key_version: "encryptionkey@0"
I20260807 08:44:10.233271 32450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:44:10.237188 32450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:44:10.239811 32450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:44:10.239982 32450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:44:10.246415 32450 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:40275
I20260807 08:44:10.246433 32522 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:40275 every 8 connection(s)
I20260807 08:44:10.247188 32450 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:44:10.249634 32523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:44:10.252187 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 32450
I20260807 08:44:10.252343 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:44:10.252629 9027 external_mini_cluster.cc:1428] Setting key 2482b6480a13940becc90c129e88ffce
I20260807 08:44:10.255081 32523 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e497c56f189a42c1ab0c96bdd301f3fe: Bootstrap starting.
I20260807 08:44:10.257507 32526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:10.253882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58769 (local address 127.8.208.254:40275)
0807 08:44:10.254264 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:10.254281 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:10.254317 (+ 36us) server_negotiation.cc:407] Connection header received
0807 08:44:10.255103 (+ 786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:10.255124 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:10.255428 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:10.255737 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:10.256336 (+ 599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:10.256341 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:10.256354 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:44:10.256365 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:10.256417 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:44:10.256440 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:10.256571 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:10.256629 (+ 58us) server_negotiation.cc:299] Negotiation successful
0807 08:44:10.256752 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":94,"threads_started":1}
I20260807 08:44:10.257516 32523 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e497c56f189a42c1ab0c96bdd301f3fe: Neither blocks nor log segments found. Creating new log.
I20260807 08:44:10.258327 32523 log.cc:824] T 00000000000000000000000000000000 P e497c56f189a42c1ab0c96bdd301f3fe: Log is configured to *not* fsync() on all Append() calls
I20260807 08:44:10.260174 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 08:44:10.260367 32523 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e497c56f189a42c1ab0c96bdd301f3fe: No bootstrap required, opened a new log
I20260807 08:44:10.263562 32526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:10.262064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44349 (local address 127.8.208.254:40275)
0807 08:44:10.262193 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:10.262197 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:10.262355 (+ 158us) server_negotiation.cc:407] Connection header received
0807 08:44:10.262463 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:10.262465 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:10.262489 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:10.262559 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:10.263187 (+ 628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:10.263190 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:10.263191 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:44:10.263200 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:10.263220 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:44:10.263229 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:10.263290 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:10.263403 (+ 113us) server_negotiation.cc:299] Negotiation successful
0807 08:44:10.263430 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 08:44:10.264302 32523 raft_consensus.cc:348] T 00000000000000000000000000000000 P e497c56f189a42c1ab0c96bdd301f3fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e497c56f189a42c1ab0c96bdd301f3fe" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40275 } }
I20260807 08:44:10.264549 32523 raft_consensus.cc:374] T 00000000000000000000000000000000 P e497c56f189a42c1ab0c96bdd301f3fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:44:10.264603 32523 raft_consensus.cc:729] T 00000000000000000000000000000000 P e497c56f189a42c1ab0c96bdd301f3fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e497c56f189a42c1ab0c96bdd301f3fe, State: Initialized, Role: FOLLOWER
I20260807 08:44:10.264952 32523 consensus_queue.cc:260] T 00000000000000000000000000000000 P e497c56f189a42c1ab0c96bdd301f3fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e497c56f189a42c1ab0c96bdd301f3fe" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40275 } }
I20260807 08:44:10.265095 32523 raft_consensus.cc:388] T 00000000000000000000000000000000 P e497c56f189a42c1ab0c96bdd301f3fe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:44:10.265183 32523 raft_consensus.cc:482] T 00000000000000000000000000000000 P e497c56f189a42c1ab0c96bdd301f3fe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:44:10.265285 32523 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e497c56f189a42c1ab0c96bdd301f3fe [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:44:10.266148 32523 raft_consensus.cc:504] T 00000000000000000000000000000000 P e497c56f189a42c1ab0c96bdd301f3fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e497c56f189a42c1ab0c96bdd301f3fe" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40275 } }
I20260807 08:44:10.266461 32523 leader_election.cc:302] T 00000000000000000000000000000000 P e497c56f189a42c1ab0c96bdd301f3fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e497c56f189a42c1ab0c96bdd301f3fe; no voters:
I20260807 08:44:10.266764 32523 leader_election.cc:288] T 00000000000000000000000000000000 P e497c56f189a42c1ab0c96bdd301f3fe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:44:10.266852 32533 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e497c56f189a42c1ab0c96bdd301f3fe [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:44:10.267072 32533 raft_consensus.cc:686] T 00000000000000000000000000000000 P e497c56f189a42c1ab0c96bdd301f3fe [term 1 LEADER]: Becoming Leader. State: Replica: e497c56f189a42c1ab0c96bdd301f3fe, State: Running, Role: LEADER
I20260807 08:44:10.267360 32533 consensus_queue.cc:237] T 00000000000000000000000000000000 P e497c56f189a42c1ab0c96bdd301f3fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e497c56f189a42c1ab0c96bdd301f3fe" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40275 } }
I20260807 08:44:10.267853 32523 sys_catalog.cc:564] T 00000000000000000000000000000000 P e497c56f189a42c1ab0c96bdd301f3fe [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:44:10.269044 32536 sys_catalog.cc:455] T 00000000000000000000000000000000 P e497c56f189a42c1ab0c96bdd301f3fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader e497c56f189a42c1ab0c96bdd301f3fe. Latest consensus state: current_term: 1 leader_uuid: "e497c56f189a42c1ab0c96bdd301f3fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e497c56f189a42c1ab0c96bdd301f3fe" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40275 } } }
I20260807 08:44:10.269192 32536 sys_catalog.cc:458] T 00000000000000000000000000000000 P e497c56f189a42c1ab0c96bdd301f3fe [sys.catalog]: This master's current role is: LEADER
I20260807 08:44:10.269039 32535 sys_catalog.cc:455] T 00000000000000000000000000000000 P e497c56f189a42c1ab0c96bdd301f3fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e497c56f189a42c1ab0c96bdd301f3fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e497c56f189a42c1ab0c96bdd301f3fe" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40275 } } }
I20260807 08:44:10.269315 32535 sys_catalog.cc:458] T 00000000000000000000000000000000 P e497c56f189a42c1ab0c96bdd301f3fe [sys.catalog]: This master's current role is: LEADER
I20260807 08:44:10.269845 32543 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:44:10.272320 32543 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:44:10.280450 32543 catalog_manager.cc:1347] Generated new cluster ID: f1f8614dd63f40b4b81aae2c2abcbcae
I20260807 08:44:10.280526 32543 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:44:10.297899 32543 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:44:10.298449 32543 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:44:10.306684 32543 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e497c56f189a42c1ab0c96bdd301f3fe: Generated new TSK 0
I20260807 08:44:10.307468 32543 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:44:10.314482 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 32450
2026-08-07T08:44:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1381 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:44:10 dist-test-slave-6nmv krb5kdc[32555](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:44:10 dist-test-slave-6nmv krb5kdc[32555](info): set up 2 sockets
Aug 07 08:44:10 dist-test-slave-6nmv krb5kdc[32555](info): commencing operation
krb5kdc: starting...
W20260807 08:44:11.317273 9027 mini_kdc.cc:121] Time spent starting KDC: real 0.981s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:44:11 dist-test-slave-6nmv krb5kdc[32555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:44:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:44:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:44:11.429941 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:44357
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:46097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:44357
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:44:11.531997 32568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:44:11.532243 32568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:44:11.532348 32568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:44:11.536404 32568 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:44:11.536453 32568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:44:11.536470 32568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:44:11.536484 32568 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:44:11.536496 32568 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:44:11.541229 32568 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:46097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:44357
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:44357
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32568
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:44:11.542114 32568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:44:11.543008 32568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:44:11.550678 32574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:44:11.550792 32568 server_base.cc:1034] running on GCE node
W20260807 08:44:11.550752 32573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:11.550937 32576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:44:11.551460 32568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:44:11.552380 32568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:44:11.553587 32568 hybrid_clock.cc:648] HybridClock initialized: now 1786092251553570 us; error 30 us; skew 500 ppm
Aug 07 08:44:11 dist-test-slave-6nmv krb5kdc[32555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092251, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:44:11.559744 32568 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:44:11.560505 32568 webserver.cc:460] Webserver started at http://127.8.208.254:34961/ using document root <none> and password file <none>
I20260807 08:44:11.561024 32568 fs_manager.cc:359] Metadata directory not provided
I20260807 08:44:11.561106 32568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:44:11.561311 32568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:44:11.563091 32568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "a96a5e315d8841da87468c450ba3b1ae"
format_stamp: "Formatted at 2026-08-07 08:44:11 on dist-test-slave-6nmv"
server_key: "c53ea0b6d3e905260deb41d2e55aac26"
server_key_iv: "7a653cee686be886ab4f442fb85d80e0"
server_key_version: "encryptionkey@0"
I20260807 08:44:11.563618 32568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "a96a5e315d8841da87468c450ba3b1ae"
format_stamp: "Formatted at 2026-08-07 08:44:11 on dist-test-slave-6nmv"
server_key: "c53ea0b6d3e905260deb41d2e55aac26"
server_key_iv: "7a653cee686be886ab4f442fb85d80e0"
server_key_version: "encryptionkey@0"
I20260807 08:44:11.566804 32568 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 08:44:11.568856 32584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:44:11.569985 32568 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 08:44:11.570142 32568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "a96a5e315d8841da87468c450ba3b1ae"
format_stamp: "Formatted at 2026-08-07 08:44:11 on dist-test-slave-6nmv"
server_key: "c53ea0b6d3e905260deb41d2e55aac26"
server_key_iv: "7a653cee686be886ab4f442fb85d80e0"
server_key_version: "encryptionkey@0"
I20260807 08:44:11.570253 32568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:44:11.590691 32568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:44:11.592996 32568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:44:11.593161 32568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:44:11.599536 32568 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:44357
I20260807 08:44:11.599556 32641 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:44357 every 8 connection(s)
I20260807 08:44:11.600366 32568 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:44:11.602909 32642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:44:11.605438 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 32568
I20260807 08:44:11.605583 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:44:11.605927 9027 external_mini_cluster.cc:1428] Setting key ef148a9cf9c32f0c27c16bf8cf70860c
I20260807 08:44:11.608173 32642 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a96a5e315d8841da87468c450ba3b1ae: Bootstrap starting.
I20260807 08:44:11.610598 32642 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a96a5e315d8841da87468c450ba3b1ae: Neither blocks nor log segments found. Creating new log.
I20260807 08:44:11.611406 32642 log.cc:824] T 00000000000000000000000000000000 P a96a5e315d8841da87468c450ba3b1ae: Log is configured to *not* fsync() on all Append() calls
I20260807 08:44:11.613169 32642 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a96a5e315d8841da87468c450ba3b1ae: No bootstrap required, opened a new log
Aug 07 08:44:11 dist-test-slave-6nmv krb5kdc[32555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:44:11.615717 32642 raft_consensus.cc:348] T 00000000000000000000000000000000 P a96a5e315d8841da87468c450ba3b1ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a96a5e315d8841da87468c450ba3b1ae" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 44357 } }
I20260807 08:44:11.615957 32642 raft_consensus.cc:374] T 00000000000000000000000000000000 P a96a5e315d8841da87468c450ba3b1ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:44:11.616056 32642 raft_consensus.cc:729] T 00000000000000000000000000000000 P a96a5e315d8841da87468c450ba3b1ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96a5e315d8841da87468c450ba3b1ae, State: Initialized, Role: FOLLOWER
I20260807 08:44:11.616460 32642 consensus_queue.cc:260] T 00000000000000000000000000000000 P a96a5e315d8841da87468c450ba3b1ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a96a5e315d8841da87468c450ba3b1ae" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 44357 } }
I20260807 08:44:11.616604 32642 raft_consensus.cc:388] T 00000000000000000000000000000000 P a96a5e315d8841da87468c450ba3b1ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:44:11.616691 32642 raft_consensus.cc:482] T 00000000000000000000000000000000 P a96a5e315d8841da87468c450ba3b1ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:44:11.616799 32642 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a96a5e315d8841da87468c450ba3b1ae [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:44:11.617551 32642 raft_consensus.cc:504] T 00000000000000000000000000000000 P a96a5e315d8841da87468c450ba3b1ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a96a5e315d8841da87468c450ba3b1ae" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 44357 } }
I20260807 08:44:11.617949 32642 leader_election.cc:302] T 00000000000000000000000000000000 P a96a5e315d8841da87468c450ba3b1ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a96a5e315d8841da87468c450ba3b1ae; no voters:
I20260807 08:44:11.618317 32642 leader_election.cc:288] T 00000000000000000000000000000000 P a96a5e315d8841da87468c450ba3b1ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:44:11.618396 32647 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a96a5e315d8841da87468c450ba3b1ae [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:44:11.618654 32647 raft_consensus.cc:686] T 00000000000000000000000000000000 P a96a5e315d8841da87468c450ba3b1ae [term 1 LEADER]: Becoming Leader. State: Replica: a96a5e315d8841da87468c450ba3b1ae, State: Running, Role: LEADER
I20260807 08:44:11.619012 32647 consensus_queue.cc:237] T 00000000000000000000000000000000 P a96a5e315d8841da87468c450ba3b1ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a96a5e315d8841da87468c450ba3b1ae" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 44357 } }
I20260807 08:44:11.619518 32645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:11.607049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34177 (local address 127.8.208.254:44357)
0807 08:44:11.607390 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:11.607404 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:11.607442 (+ 38us) server_negotiation.cc:407] Connection header received
0807 08:44:11.607995 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:11.608009 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:11.608345 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:11.608614 (+ 269us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:11.609578 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:11.610448 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:11.611528 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:11.611967 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:11.612129 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:11.614446 (+ 2317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:11.614450 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:11.614460 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:11.614482 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:11.616616 (+ 2134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:11.617057 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:11.617062 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:11.617067 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:11.617171 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:11.617434 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:11.617437 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:11.617439 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:11.617885 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:11.618090 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:11.618345 (+ 255us) server_negotiation.cc:299] Negotiation successful
0807 08:44:11.618769 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":119,"threads_started":1}
I20260807 08:44:11.619537 32642 sys_catalog.cc:564] T 00000000000000000000000000000000 P a96a5e315d8841da87468c450ba3b1ae [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:44:11.621838 32649 sys_catalog.cc:455] T 00000000000000000000000000000000 P a96a5e315d8841da87468c450ba3b1ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader a96a5e315d8841da87468c450ba3b1ae. Latest consensus state: current_term: 1 leader_uuid: "a96a5e315d8841da87468c450ba3b1ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a96a5e315d8841da87468c450ba3b1ae" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 44357 } } }
I20260807 08:44:11.621898 32648 sys_catalog.cc:455] T 00000000000000000000000000000000 P a96a5e315d8841da87468c450ba3b1ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a96a5e315d8841da87468c450ba3b1ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a96a5e315d8841da87468c450ba3b1ae" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 44357 } } }
I20260807 08:44:11.622267 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 08:44:11.622267 32649 sys_catalog.cc:458] T 00000000000000000000000000000000 P a96a5e315d8841da87468c450ba3b1ae [sys.catalog]: This master's current role is: LEADER
I20260807 08:44:11.622270 32648 sys_catalog.cc:458] T 00000000000000000000000000000000 P a96a5e315d8841da87468c450ba3b1ae [sys.catalog]: This master's current role is: LEADER
W20260807 08:44:11.624152 32662 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a96a5e315d8841da87468c450ba3b1ae: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:44:11.624281 32662 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:44:11.624399 32663 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:44:11.625106 32663 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:44:11.630277 32663 catalog_manager.cc:1347] Generated new cluster ID: a999266f6a8c4e8e8d2bec50b951dc49
I20260807 08:44:11.630338 32663 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:44:11.634383 32645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:11.624293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35041 (local address 127.8.208.254:44357)
0807 08:44:11.624383 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:11.624387 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:11.626172 (+ 1785us) server_negotiation.cc:407] Connection header received
0807 08:44:11.626276 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:11.626279 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:11.626320 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:11.626412 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:11.627146 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:11.627859 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:11.629067 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:11.629362 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:11.629467 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:11.631011 (+ 1544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:11.631015 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:11.631017 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:11.631040 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:11.632647 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:11.633105 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:11.633108 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:11.633115 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:11.633213 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:11.633506 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:11.633509 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:11.633511 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:11.633696 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:11.633842 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:11.634105 (+ 263us) server_negotiation.cc:299] Negotiation successful
0807 08:44:11.634212 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 08:44:11.639833 32663 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:44:11.640859 32663 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:44:11.647334 32663 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a96a5e315d8841da87468c450ba3b1ae: Generated new TSK 0
I20260807 08:44:11.648011 32663 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:44:11.652110 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 32568
2026-08-07T08:44:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1337 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:44:11 dist-test-slave-6nmv krb5kdc[32674](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:44:11 dist-test-slave-6nmv krb5kdc[32674](info): set up 2 sockets
Aug 07 08:44:11 dist-test-slave-6nmv krb5kdc[32674](info): commencing operation
krb5kdc: starting...
W20260807 08:44:12.676712 9027 mini_kdc.cc:121] Time spent starting KDC: real 1.003s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:44:12 dist-test-slave-6nmv krb5kdc[32674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:44:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:44:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:44:12.788939 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:38605
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:36675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:38605
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:44:12.891724 32687 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:44:12.891981 32687 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:44:12.892064 32687 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:44:12.895627 32687 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:44:12.895704 32687 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:44:12.895740 32687 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:44:12.895792 32687 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:44:12.895828 32687 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:44:12.900732 32687 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:36675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:38605
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:38605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32687
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:44:12.901607 32687 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:44:12.902559 32687 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:44:12.910472 32695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:12.910514 32693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:12.910513 32692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:44:12.910833 32687 server_base.cc:1034] running on GCE node
I20260807 08:44:12.911307 32687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:44:12.912302 32687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:44:12.913488 32687 hybrid_clock.cc:648] HybridClock initialized: now 1786092252913463 us; error 39 us; skew 500 ppm
Aug 07 08:44:12 dist-test-slave-6nmv krb5kdc[32674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092252, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:44:12.916114 32687 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:44:12.916851 32687 webserver.cc:460] Webserver started at http://127.8.208.254:46047/ using document root <none> and password file <none>
I20260807 08:44:12.917320 32687 fs_manager.cc:359] Metadata directory not provided
I20260807 08:44:12.917375 32687 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:44:12.917521 32687 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:44:12.919566 32687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "8d6d938e02a54645a93dd29a795777b0"
format_stamp: "Formatted at 2026-08-07 08:44:12 on dist-test-slave-6nmv"
server_key: "828b39435bdef886b9178dd9d4243557"
server_key_iv: "6387b60629ec82dc85bf9ad75b617ae8"
server_key_version: "encryptionkey@0"
I20260807 08:44:12.920109 32687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "8d6d938e02a54645a93dd29a795777b0"
format_stamp: "Formatted at 2026-08-07 08:44:12 on dist-test-slave-6nmv"
server_key: "828b39435bdef886b9178dd9d4243557"
server_key_iv: "6387b60629ec82dc85bf9ad75b617ae8"
server_key_version: "encryptionkey@0"
I20260807 08:44:12.923592 32687 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 08:44:12.925895 32703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:44:12.927042 32687 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 08:44:12.927173 32687 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "8d6d938e02a54645a93dd29a795777b0"
format_stamp: "Formatted at 2026-08-07 08:44:12 on dist-test-slave-6nmv"
server_key: "828b39435bdef886b9178dd9d4243557"
server_key_iv: "6387b60629ec82dc85bf9ad75b617ae8"
server_key_version: "encryptionkey@0"
I20260807 08:44:12.927270 32687 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:44:12.940131 32687 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:44:12.942677 32687 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:44:12.942875 32687 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:44:12.950188 32687 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:38605
I20260807 08:44:12.950203 32757 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:38605 every 8 connection(s)
I20260807 08:44:12.951107 32687 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:44:12.953650 32758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:44:12.954411 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 32687
I20260807 08:44:12.954561 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:44:12.954888 9027 external_mini_cluster.cc:1428] Setting key a8a1136971f4d2ac933da7f3fe0e1f7d
I20260807 08:44:12.959334 32758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d6d938e02a54645a93dd29a795777b0: Bootstrap starting.
I20260807 08:44:12.961726 32758 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d6d938e02a54645a93dd29a795777b0: Neither blocks nor log segments found. Creating new log.
I20260807 08:44:12.962546 32758 log.cc:824] T 00000000000000000000000000000000 P 8d6d938e02a54645a93dd29a795777b0: Log is configured to *not* fsync() on all Append() calls
I20260807 08:44:12.963439 32761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:12.956120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34461 (local address 127.8.208.254:38605)
0807 08:44:12.956504 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:12.956537 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:12.956571 (+ 34us) server_negotiation.cc:407] Connection header received
0807 08:44:12.957161 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:12.957175 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:12.957484 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:12.957741 (+ 257us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:12.958150 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:12.959116 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:12.960210 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:12.960634 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:12.960760 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:12.961578 (+ 818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:12.961583 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:12.961594 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:44:12.962041 (+ 447us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:12.962093 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:44:12.962116 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:12.962193 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:12.962338 (+ 145us) server_negotiation.cc:299] Negotiation successful
0807 08:44:12.962532 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":125,"threads_started":1}
I20260807 08:44:12.964637 32758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d6d938e02a54645a93dd29a795777b0: No bootstrap required, opened a new log
I20260807 08:44:12.966223 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 08:44:12.968933 32758 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d6d938e02a54645a93dd29a795777b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d6d938e02a54645a93dd29a795777b0" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 38605 } }
I20260807 08:44:12.969187 32758 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8d6d938e02a54645a93dd29a795777b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:44:12.969251 32758 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d6d938e02a54645a93dd29a795777b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d6d938e02a54645a93dd29a795777b0, State: Initialized, Role: FOLLOWER
I20260807 08:44:12.969718 32758 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d6d938e02a54645a93dd29a795777b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d6d938e02a54645a93dd29a795777b0" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 38605 } }
I20260807 08:44:12.969897 32758 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8d6d938e02a54645a93dd29a795777b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:44:12.969965 32758 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d6d938e02a54645a93dd29a795777b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:44:12.970090 32758 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d6d938e02a54645a93dd29a795777b0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:44:12.971068 32758 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d6d938e02a54645a93dd29a795777b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d6d938e02a54645a93dd29a795777b0" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 38605 } }
I20260807 08:44:12.971459 32758 leader_election.cc:302] T 00000000000000000000000000000000 P 8d6d938e02a54645a93dd29a795777b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d6d938e02a54645a93dd29a795777b0; no voters:
I20260807 08:44:12.971815 32758 leader_election.cc:288] T 00000000000000000000000000000000 P 8d6d938e02a54645a93dd29a795777b0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:44:12.972203 301 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d6d938e02a54645a93dd29a795777b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:44:12.972452 301 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8d6d938e02a54645a93dd29a795777b0 [term 1 LEADER]: Becoming Leader. State: Replica: 8d6d938e02a54645a93dd29a795777b0, State: Running, Role: LEADER
I20260807 08:44:12.972779 32761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:12.968490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47099 (local address 127.8.208.254:38605)
0807 08:44:12.968626 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:12.968630 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:12.968773 (+ 143us) server_negotiation.cc:407] Connection header received
0807 08:44:12.968859 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:12.968861 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:12.968901 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:12.968994 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:12.969363 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:12.969928 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:12.970979 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:12.971332 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:12.971440 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:12.972264 (+ 824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:12.972270 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:12.972276 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:44:12.972290 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:12.972319 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:44:12.972334 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:12.972461 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:12.972613 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 08:44:12.972664 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 08:44:12.972808 301 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d6d938e02a54645a93dd29a795777b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d6d938e02a54645a93dd29a795777b0" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 38605 } }
I20260807 08:44:12.973155 32758 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d6d938e02a54645a93dd29a795777b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:44:12.974843 302 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d6d938e02a54645a93dd29a795777b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d6d938e02a54645a93dd29a795777b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d6d938e02a54645a93dd29a795777b0" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 38605 } } }
I20260807 08:44:12.974972 302 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d6d938e02a54645a93dd29a795777b0 [sys.catalog]: This master's current role is: LEADER
I20260807 08:44:12.975387 312 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:44:12.975361 303 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d6d938e02a54645a93dd29a795777b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d6d938e02a54645a93dd29a795777b0. Latest consensus state: current_term: 1 leader_uuid: "8d6d938e02a54645a93dd29a795777b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d6d938e02a54645a93dd29a795777b0" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 38605 } } }
I20260807 08:44:12.975530 303 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d6d938e02a54645a93dd29a795777b0 [sys.catalog]: This master's current role is: LEADER
I20260807 08:44:12.978353 312 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:44:12.983304 312 catalog_manager.cc:1347] Generated new cluster ID: ee45a35d2a4d47a88dbc468c543343c8
I20260807 08:44:12.983366 312 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:44:12.997522 312 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:44:12.998459 312 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:44:13.005985 312 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8d6d938e02a54645a93dd29a795777b0: Generated new TSK 0
I20260807 08:44:13.006523 312 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:44:13.016865 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 32687
2026-08-07T08:44:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1365 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:44:13 dist-test-slave-6nmv krb5kdc[322](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:44:13 dist-test-slave-6nmv krb5kdc[322](info): set up 2 sockets
Aug 07 08:44:13 dist-test-slave-6nmv krb5kdc[322](info): commencing operation
krb5kdc: starting...
W20260807 08:44:14.042486 9027 mini_kdc.cc:121] Time spent starting KDC: real 1.003s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:44:14 dist-test-slave-6nmv krb5kdc[322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092254, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:44:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:44:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:44:14.158844 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:39499
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:33575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:39499
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:44:14.260102 337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:44:14.260350 337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:44:14.260426 337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:44:14.263767 337 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:44:14.263839 337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:44:14.263872 337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:44:14.263921 337 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:44:14.263953 337 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:44:14.268261 337 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:33575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:39499
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:39499
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.337
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:44:14.269140 337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:44:14.269972 337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:44:14.277434 343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:14.277478 342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:14.277531 345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:44:14.277546 337 server_base.cc:1034] running on GCE node
I20260807 08:44:14.278252 337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:44:14.279153 337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:44:14.280309 337 hybrid_clock.cc:648] HybridClock initialized: now 1786092254280293 us; error 28 us; skew 500 ppm
Aug 07 08:44:14 dist-test-slave-6nmv krb5kdc[322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092254, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:44:14.282955 337 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:44:14.283759 337 webserver.cc:460] Webserver started at http://127.8.208.254:39073/ using document root <none> and password file <none>
I20260807 08:44:14.284243 337 fs_manager.cc:359] Metadata directory not provided
I20260807 08:44:14.284317 337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:44:14.284511 337 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:44:14.286270 337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "fbfbf0391985400398fc200dda1adb8d"
format_stamp: "Formatted at 2026-08-07 08:44:14 on dist-test-slave-6nmv"
server_key: "2a05da5415caf18d9424ceeed45f504b"
server_key_iv: "8c811d1e86454e343ae133e48cd80ee7"
server_key_version: "encryptionkey@0"
I20260807 08:44:14.286778 337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "fbfbf0391985400398fc200dda1adb8d"
format_stamp: "Formatted at 2026-08-07 08:44:14 on dist-test-slave-6nmv"
server_key: "2a05da5415caf18d9424ceeed45f504b"
server_key_iv: "8c811d1e86454e343ae133e48cd80ee7"
server_key_version: "encryptionkey@0"
I20260807 08:44:14.290068 337 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 08:44:14.292127 352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:44:14.293223 337 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:44:14.293344 337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "fbfbf0391985400398fc200dda1adb8d"
format_stamp: "Formatted at 2026-08-07 08:44:14 on dist-test-slave-6nmv"
server_key: "2a05da5415caf18d9424ceeed45f504b"
server_key_iv: "8c811d1e86454e343ae133e48cd80ee7"
server_key_version: "encryptionkey@0"
I20260807 08:44:14.293484 337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:44:14.297403 337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:44:14.299943 337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:44:14.300122 337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:44:14.306444 337 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:39499
I20260807 08:44:14.306465 407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:39499 every 8 connection(s)
I20260807 08:44:14.307188 337 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:44:14.309666 408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:44:14.313951 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 337
I20260807 08:44:14.314088 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:44:14.314357 9027 external_mini_cluster.cc:1428] Setting key 002ff07e3fe0dba7be0ee4c4fe757a61
I20260807 08:44:14.314983 408 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbfbf0391985400398fc200dda1adb8d: Bootstrap starting.
I20260807 08:44:14.317167 408 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbfbf0391985400398fc200dda1adb8d: Neither blocks nor log segments found. Creating new log.
I20260807 08:44:14.318223 408 log.cc:824] T 00000000000000000000000000000000 P fbfbf0391985400398fc200dda1adb8d: Log is configured to *not* fsync() on all Append() calls
I20260807 08:44:14.319123 411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:14.315517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40195 (local address 127.8.208.254:39499)
0807 08:44:14.315928 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:14.315940 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:14.315970 (+ 30us) server_negotiation.cc:407] Connection header received
0807 08:44:14.316538 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:14.316552 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:14.316791 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:14.317097 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:14.317743 (+ 646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:14.317747 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:14.317757 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:44:14.317765 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:14.317805 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:44:14.317867 (+ 62us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:14.318020 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:14.318176 (+ 156us) server_negotiation.cc:299] Negotiation successful
0807 08:44:14.318324 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":133,"threads_started":1}
I20260807 08:44:14.320040 408 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbfbf0391985400398fc200dda1adb8d: No bootstrap required, opened a new log
I20260807 08:44:14.321557 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 08:44:14.323578 408 raft_consensus.cc:348] T 00000000000000000000000000000000 P fbfbf0391985400398fc200dda1adb8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbfbf0391985400398fc200dda1adb8d" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39499 } }
I20260807 08:44:14.323840 408 raft_consensus.cc:374] T 00000000000000000000000000000000 P fbfbf0391985400398fc200dda1adb8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 08:44:14.323911 408 raft_consensus.cc:729] T 00000000000000000000000000000000 P fbfbf0391985400398fc200dda1adb8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbfbf0391985400398fc200dda1adb8d, State: Initialized, Role: FOLLOWER
I20260807 08:44:14.324312 408 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbfbf0391985400398fc200dda1adb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbfbf0391985400398fc200dda1adb8d" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39499 } }
I20260807 08:44:14.324467 408 raft_consensus.cc:388] T 00000000000000000000000000000000 P fbfbf0391985400398fc200dda1adb8d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 08:44:14.324553 408 raft_consensus.cc:482] T 00000000000000000000000000000000 P fbfbf0391985400398fc200dda1adb8d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 08:44:14.324669 408 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fbfbf0391985400398fc200dda1adb8d [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:44:14.325088 411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:14.323532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55821 (local address 127.8.208.254:39499)
0807 08:44:14.323642 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:14.323646 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:14.323802 (+ 156us) server_negotiation.cc:407] Connection header received
0807 08:44:14.323929 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:14.323934 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:14.323965 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:14.324044 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:14.324728 (+ 684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:14.324731 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:14.324733 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 08:44:14.324742 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:14.324783 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 08:44:14.324795 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:14.324869 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:14.324939 (+ 70us) server_negotiation.cc:299] Negotiation successful
0807 08:44:14.324973 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 08:44:14.325697 408 raft_consensus.cc:504] T 00000000000000000000000000000000 P fbfbf0391985400398fc200dda1adb8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbfbf0391985400398fc200dda1adb8d" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39499 } }
I20260807 08:44:14.326084 408 leader_election.cc:302] T 00000000000000000000000000000000 P fbfbf0391985400398fc200dda1adb8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fbfbf0391985400398fc200dda1adb8d; no voters:
I20260807 08:44:14.326414 408 leader_election.cc:288] T 00000000000000000000000000000000 P fbfbf0391985400398fc200dda1adb8d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 08:44:14.326485 419 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fbfbf0391985400398fc200dda1adb8d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:44:14.326745 419 raft_consensus.cc:686] T 00000000000000000000000000000000 P fbfbf0391985400398fc200dda1adb8d [term 1 LEADER]: Becoming Leader. State: Replica: fbfbf0391985400398fc200dda1adb8d, State: Running, Role: LEADER
I20260807 08:44:14.327086 419 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbfbf0391985400398fc200dda1adb8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbfbf0391985400398fc200dda1adb8d" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39499 } }
I20260807 08:44:14.327526 408 sys_catalog.cc:564] T 00000000000000000000000000000000 P fbfbf0391985400398fc200dda1adb8d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:44:14.328679 421 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbfbf0391985400398fc200dda1adb8d [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbfbf0391985400398fc200dda1adb8d. Latest consensus state: current_term: 1 leader_uuid: "fbfbf0391985400398fc200dda1adb8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbfbf0391985400398fc200dda1adb8d" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39499 } } }
I20260807 08:44:14.328681 420 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbfbf0391985400398fc200dda1adb8d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fbfbf0391985400398fc200dda1adb8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbfbf0391985400398fc200dda1adb8d" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39499 } } }
I20260807 08:44:14.328855 421 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbfbf0391985400398fc200dda1adb8d [sys.catalog]: This master's current role is: LEADER
I20260807 08:44:14.328866 420 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbfbf0391985400398fc200dda1adb8d [sys.catalog]: This master's current role is: LEADER
I20260807 08:44:14.329296 428 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:44:14.332053 428 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:44:14.337179 428 catalog_manager.cc:1347] Generated new cluster ID: 521b761201a3496181beeda950928605
I20260807 08:44:14.337239 428 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:44:14.361038 428 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:44:14.361289 428 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:44:14.368471 428 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fbfbf0391985400398fc200dda1adb8d: Generated new TSK 0
I20260807 08:44:14.369135 428 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 08:44:14.381989 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 337
2026-08-07T08:44:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1365 ms)
[----------] 18 tests from AuthTokenIssuingTest (24743 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:44:14 dist-test-slave-6nmv krb5kdc[441](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:44:14 dist-test-slave-6nmv krb5kdc[441](info): set up 2 sockets
Aug 07 08:44:14 dist-test-slave-6nmv krb5kdc[441](info): commencing operation
krb5kdc: starting...
W20260807 08:44:15.423884 9027 mini_kdc.cc:121] Time spent starting KDC: real 1.019s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:44:15 dist-test-slave-6nmv krb5kdc[441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092255, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:44:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:44:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:44:15.541152 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:39563
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:38247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:39563,127.8.208.253:46091,127.8.208.252:38381
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:44:15.644902 455 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 08:44:15.645205 455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:44:15.645279 455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:44:15.645382 455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:44:15.649372 455 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:44:15.649461 455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:44:15.649505 455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:44:15.649566 455 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:44:15.649612 455 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:44:15.654706 455 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:38247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:39563,127.8.208.253:46091,127.8.208.252:38381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:39563
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:44:15.655673 455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:44:15.656606 455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:44:15.664656 460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:15.664705 463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:44:15.664808 455 server_base.cc:1034] running on GCE node
W20260807 08:44:15.664691 461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:44:15.665561 455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:44:15.666653 455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:44:15.667855 455 hybrid_clock.cc:648] HybridClock initialized: now 1786092255667836 us; error 32 us; skew 500 ppm
Aug 07 08:44:15 dist-test-slave-6nmv krb5kdc[441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092255, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:44:15.670639 455 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:44:15.671530 455 webserver.cc:460] Webserver started at http://127.8.208.254:40367/ using document root <none> and password file <none>
I20260807 08:44:15.672073 455 fs_manager.cc:359] Metadata directory not provided
I20260807 08:44:15.672137 455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:44:15.672292 455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:44:15.674309 455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "45b9ccf4635b4c9ab703e9702b53a68b"
format_stamp: "Formatted at 2026-08-07 08:44:15 on dist-test-slave-6nmv"
server_key: "c51fe735e0dc128b5ea8dd169670023a"
server_key_iv: "9e8f8f756f58c4c533c7216e8cead079"
server_key_version: "encryptionkey@0"
I20260807 08:44:15.674872 455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "45b9ccf4635b4c9ab703e9702b53a68b"
format_stamp: "Formatted at 2026-08-07 08:44:15 on dist-test-slave-6nmv"
server_key: "c51fe735e0dc128b5ea8dd169670023a"
server_key_iv: "9e8f8f756f58c4c533c7216e8cead079"
server_key_version: "encryptionkey@0"
I20260807 08:44:15.678546 455 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 08:44:15.680887 471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:44:15.682331 455 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 08:44:15.682461 455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "45b9ccf4635b4c9ab703e9702b53a68b"
format_stamp: "Formatted at 2026-08-07 08:44:15 on dist-test-slave-6nmv"
server_key: "c51fe735e0dc128b5ea8dd169670023a"
server_key_iv: "9e8f8f756f58c4c533c7216e8cead079"
server_key_version: "encryptionkey@0"
I20260807 08:44:15.682555 455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:44:15.698362 455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:44:15.701093 455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:44:15.701256 455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:44:15.708636 455 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:39563
I20260807 08:44:15.708963 526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:39563 every 8 connection(s)
I20260807 08:44:15.709702 455 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:44:15.712321 527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:44:15.715706 527 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39563 } has no permanent_uuid. Determining permanent_uuid...
I20260807 08:44:15.716676 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 455
I20260807 08:44:15.716812 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:44:15.717092 9027 external_mini_cluster.cc:1428] Setting key ef35cd1fcaf638a17482f73cbc5a2810
Aug 07 08:44:15 dist-test-slave-6nmv krb5kdc[441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092255, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.208.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.253@KRBTEST.COM" created.
I20260807 08:44:15.730567 529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:15.717741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:39563 (local address 127.0.0.1:56892)
0807 08:44:15.718261 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:15.718321 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 08:44:15.719383 (+ 1062us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:44:15.720122 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:44:15.720126 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:44:15.720583 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:44:15.720925 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:15.720946 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:15.722077 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:15.722080 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:15.723297 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:15.723311 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:15.723899 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:15.723903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:15.724005 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:15.724536 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:44:15.724557 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:44:15.726129 (+ 1572us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:44:15.727895 (+ 1766us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:15.727905 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:15.727912 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:15.728151 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:15.728473 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:15.728477 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:15.728479 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:15.728594 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:15.729148 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:44:15.729154 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:44:15.729304 (+ 150us) client_negotiation.cc:769] Sending connection context
0807 08:44:15.729474 (+ 170us) client_negotiation.cc:240] Negotiation successful
0807 08:44:15.729962 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"mutex_wait_us":165,"thread_start_us":108,"threads_started":1}
I20260807 08:44:15.730583 530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:15.718466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56892 (local address 127.8.208.254:39563)
0807 08:44:15.718741 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:15.718750 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:15.718785 (+ 35us) server_negotiation.cc:407] Connection header received
0807 08:44:15.719698 (+ 913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:15.719703 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:15.719921 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:15.720120 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:15.721082 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:15.721961 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:15.723442 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:15.723751 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:15.723850 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:15.726269 (+ 2419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:15.726274 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:15.726282 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:15.726300 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:15.727775 (+ 1475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:15.728265 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:15.728270 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:15.728272 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:15.728376 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:15.728693 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:15.728696 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:15.728698 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:15.729031 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:15.729174 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:15.729539 (+ 365us) server_negotiation.cc:299] Negotiation successful
0807 08:44:15.729801 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":178,"thread_start_us":107,"threads_started":1}
I20260807 08:44:15.732710 527 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46091 } has no permanent_uuid. Determining permanent_uuid...
I20260807 08:44:15.733424 529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:15.733200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:46091 (local address 127.0.0.1:59046)
0807 08:44:15.733312 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:15.733376 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.253:46091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 08:44:15.733671 474 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.208.253:46091: connect: Connection refused (error 111)
I20260807 08:44:15.734496 529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:15.734298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:46091 (local address 127.0.0.1:59060)
0807 08:44:15.734402 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:15.734451 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.253:46091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 08:44:15.734659 527 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.253:46091: Network error: Client connection negotiation failed: client connection to 127.8.208.253:46091: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.253.keytab.
Entry for principal kudu/127.8.208.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.253.keytab.
I20260807 08:44:15.744027 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.253:46091
--webserver_interface=127.8.208.253
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.253.keytab
--principal=kudu/127.8.208.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:38247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:39563,127.8.208.253:46091,127.8.208.252:38381
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 08:44:15.783957 527 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46091 } attempt: 1
I20260807 08:44:15.784808 529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:15.784530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:46091 (local address 127.0.0.1:59068)
0807 08:44:15.784679 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:15.784737 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.253:46091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260807 08:44:15.785676 529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:15.785418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:46091 (local address 127.0.0.1:59074)
0807 08:44:15.785578 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:15.785624 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.253:46091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260807 08:44:15.785904 527 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.253:46091: Network error: Client connection negotiation failed: client connection to 127.8.208.253:46091: connect: Connection refused (error 111)
I20260807 08:44:15.854059 527 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46091 } attempt: 2
I20260807 08:44:15.854962 529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:15.854650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:46091 (local address 127.0.0.1:59084)
0807 08:44:15.854821 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:15.854884 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.253:46091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260807 08:44:15.855350 535 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 08:44:15.855648 535 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:44:15.855715 535 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
I20260807 08:44:15.855757 529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:15.855468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:46091 (local address 127.0.0.1:59096)
0807 08:44:15.855590 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:15.855665 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.253:46091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 08:44:15.855814 535 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:44:15.855891 527 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.253:46091: Network error: Client connection negotiation failed: client connection to 127.8.208.253:46091: connect: Connection refused (error 111)
W20260807 08:44:15.859797 535 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:44:15.859880 535 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:44:15.859929 535 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:44:15.859968 535 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:44:15.860008 535 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:44:15.864975 535 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:38247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:39563,127.8.208.253:46091,127.8.208.252:38381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.253.keytab
--principal=kudu/127.8.208.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.253:46091
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.208.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.535
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:44:15.866000 535 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:44:15.866930 535 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:44:15.874997 543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:15.875056 541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:15.875152 540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:44:15.875322 535 server_base.cc:1034] running on GCE node
I20260807 08:44:15.875844 535 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:44:15.876932 535 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:44:15.878125 535 hybrid_clock.cc:648] HybridClock initialized: now 1786092255878094 us; error 45 us; skew 500 ppm
Aug 07 08:44:15 dist-test-slave-6nmv krb5kdc[441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092255, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:44:15.880846 535 init.cc:377] Logged in from keytab as kudu/127.8.208.253@KRBTEST.COM (short username kudu)
I20260807 08:44:15.881631 535 webserver.cc:460] Webserver started at http://127.8.208.253:41857/ using document root <none> and password file <none>
I20260807 08:44:15.882198 535 fs_manager.cc:359] Metadata directory not provided
I20260807 08:44:15.882258 535 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:44:15.882416 535 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:44:15.884392 535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-1/data/instance:
uuid: "874cae1100c647a3bf0ec6c6f852b038"
format_stamp: "Formatted at 2026-08-07 08:44:15 on dist-test-slave-6nmv"
server_key: "365bc65ad9fde3863be9494ff55a6947"
server_key_iv: "e282da300ed518122313ae57347dc10f"
server_key_version: "encryptionkey@0"
I20260807 08:44:15.884891 535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-1/wal/instance:
uuid: "874cae1100c647a3bf0ec6c6f852b038"
format_stamp: "Formatted at 2026-08-07 08:44:15 on dist-test-slave-6nmv"
server_key: "365bc65ad9fde3863be9494ff55a6947"
server_key_iv: "e282da300ed518122313ae57347dc10f"
server_key_version: "encryptionkey@0"
I20260807 08:44:15.888646 535 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 08:44:15.891031 550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:44:15.892243 535 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 08:44:15.892349 535 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-1/wal
uuid: "874cae1100c647a3bf0ec6c6f852b038"
format_stamp: "Formatted at 2026-08-07 08:44:15 on dist-test-slave-6nmv"
server_key: "365bc65ad9fde3863be9494ff55a6947"
server_key_iv: "e282da300ed518122313ae57347dc10f"
server_key_version: "encryptionkey@0"
I20260807 08:44:15.892437 535 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:44:15.908998 535 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:44:15.911957 535 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:44:15.912104 535 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:44:15.918782 535 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.253:46091
I20260807 08:44:15.919061 605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.253:46091 every 8 connection(s)
I20260807 08:44:15.919726 535 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-1/data/info.pb
I20260807 08:44:15.922406 606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:44:15.925911 606 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39563 } has no permanent_uuid. Determining permanent_uuid...
I20260807 08:44:15.930063 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 535
I20260807 08:44:15.930191 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-1/wal/instance
I20260807 08:44:15.930464 9027 external_mini_cluster.cc:1428] Setting key 1c71ec70f3d7c9ac11c36365df70436d
Aug 07 08:44:15 dist-test-slave-6nmv krb5kdc[441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092255, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.253@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.208.252@KRBTEST.COM; defaulting to no policy
I20260807 08:44:15.940053 530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:15.927703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56902 (local address 127.8.208.254:39563)
0807 08:44:15.927839 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:15.927843 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:15.928696 (+ 853us) server_negotiation.cc:407] Connection header received
0807 08:44:15.929665 (+ 969us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:15.929669 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:15.929733 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:15.929875 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:15.931171 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:15.931744 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:15.932923 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:15.933171 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:15.933300 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:15.935971 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:15.935975 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:15.935977 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:15.936003 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:15.937679 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:15.938287 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:15.938292 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:15.938295 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:15.938433 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:15.938824 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:15.938828 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:15.938830 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:15.939045 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:15.939170 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:15.939721 (+ 551us) server_negotiation.cc:299] Negotiation successful
0807 08:44:15.939856 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 08:44:15.940891 608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:15.928025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:39563 (local address 127.0.0.1:56902)
0807 08:44:15.928522 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:15.928566 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 08:44:15.929436 (+ 870us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:44:15.930058 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:44:15.930065 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:44:15.930505 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:44:15.931014 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:15.931028 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:15.931898 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:15.931904 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:15.932766 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:15.932776 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:15.933341 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:15.933345 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:15.933525 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:15.934236 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:44:15.934253 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:44:15.935751 (+ 1498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:44:15.937858 (+ 2107us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:15.937865 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:15.937879 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:15.938167 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:15.938540 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:15.938545 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:15.938547 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:15.938706 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:15.939168 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:44:15.939175 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:44:15.939441 (+ 266us) client_negotiation.cc:769] Sending connection context
0807 08:44:15.939639 (+ 198us) client_negotiation.cc:240] Negotiation successful
0807 08:44:15.940005 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":141,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.252@KRBTEST.COM" created.
I20260807 08:44:15.942461 606 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46091 } has no permanent_uuid. Determining permanent_uuid...
I20260807 08:44:15.947050 527 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46091 } attempt: 3
Aug 07 08:44:15 dist-test-slave-6nmv krb5kdc[441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092255, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.253@KRBTEST.COM for kudu/127.8.208.253@KRBTEST.COM
I20260807 08:44:15.952911 608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:15.943027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:46091 (local address 127.0.0.1:59106)
0807 08:44:15.943251 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:15.943268 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 08:44:15.943373 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:44:15.943875 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:44:15.943878 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:44:15.944061 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:44:15.944143 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:15.944149 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:15.945126 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:15.945130 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:15.945670 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:15.945678 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:15.946363 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:15.946367 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:15.946498 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:15.947026 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:44:15.947039 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:44:15.948690 (+ 1651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:44:15.950950 (+ 2260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:15.950953 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:15.950956 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:15.951158 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:15.951514 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:15.951515 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:15.951517 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:15.951633 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:15.952269 (+ 636us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:44:15.952275 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:44:15.952405 (+ 130us) client_negotiation.cc:769] Sending connection context
0807 08:44:15.952538 (+ 133us) client_negotiation.cc:240] Negotiation successful
0807 08:44:15.952693 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152}
Aug 07 08:44:15 dist-test-slave-6nmv krb5kdc[441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092255, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for kudu/127.8.208.253@KRBTEST.COM
I20260807 08:44:15.953297 611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:15.943167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59106 (local address 127.8.208.253:46091)
0807 08:44:15.943523 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:15.943533 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:15.943551 (+ 18us) server_negotiation.cc:407] Connection header received
0807 08:44:15.943583 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:15.943587 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:15.943728 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:15.943886 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:15.944258 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:15.944996 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:15.945794 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:15.946198 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:15.946343 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:15.948850 (+ 2507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:15.948861 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:15.948871 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:15.948893 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:15.950767 (+ 1874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:15.951279 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:15.951288 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:15.951295 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:15.951383 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:15.951780 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:15.951787 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:15.951791 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:15.952112 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:15.952250 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:15.952636 (+ 386us) server_negotiation.cc:299] Negotiation successful
0807 08:44:15.952757 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":136,"threads_started":1}
I20260807 08:44:15.955291 606 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.252.keytab.
Entry for principal kudu/127.8.208.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.252.keytab.
I20260807 08:44:15.956077 608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:15.955798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:38381 (local address 127.0.0.1:35906)
0807 08:44:15.955911 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:15.956000 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:38381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260807 08:44:15.956272 554 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.208.252:38381: connect: Connection refused (error 111)
I20260807 08:44:15.956993 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.252:38381
--webserver_interface=127.8.208.252
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.252.keytab
--principal=kudu/127.8.208.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:38247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:39563,127.8.208.253:46091,127.8.208.252:38381
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 08:44:15.957209 608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:15.956953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:38381 (local address 127.0.0.1:35914)
0807 08:44:15.957056 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:15.957113 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:38381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260807 08:44:15.957347 606 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.252:38381: Network error: Client connection negotiation failed: client connection to 127.8.208.252:38381: connect: Connection refused (error 111)
I20260807 08:44:15.958216 529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:15.947533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:46091 (local address 127.0.0.1:59114)
0807 08:44:15.947759 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:15.947778 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 08:44:15.947861 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:44:15.948164 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:44:15.948167 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:44:15.948370 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:44:15.948510 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:15.948519 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:15.949699 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:15.949704 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:15.950761 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:15.950770 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:15.951294 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:15.951298 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:15.951406 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:15.951897 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:44:15.951911 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:44:15.953518 (+ 1607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:44:15.956603 (+ 3085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:15.956607 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:15.956609 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:15.956851 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:15.957131 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:15.957134 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:15.957154 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:15.957260 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:15.957682 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:44:15.957685 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:44:15.957784 (+ 99us) client_negotiation.cc:769] Sending connection context
0807 08:44:15.957930 (+ 146us) client_negotiation.cc:240] Negotiation successful
0807 08:44:15.958087 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130}
I20260807 08:44:15.958724 612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:15.947609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59114 (local address 127.8.208.253:46091)
0807 08:44:15.947898 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:15.947908 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:15.947925 (+ 17us) server_negotiation.cc:407] Connection header received
0807 08:44:15.947963 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:15.947967 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:15.948015 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:15.948122 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:15.948652 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:15.949562 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:15.950912 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:15.951173 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:15.951291 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:15.953700 (+ 2409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:15.953704 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:15.953707 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:15.953729 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:15.956471 (+ 2742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:15.956939 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:15.956945 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:15.956947 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:15.957027 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:15.957381 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:15.957385 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:15.957386 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:15.957581 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:15.957689 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:15.958442 (+ 753us) server_negotiation.cc:299] Negotiation successful
0807 08:44:15.958562 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":106,"threads_started":1}
I20260807 08:44:15.959487 527 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } has no permanent_uuid. Determining permanent_uuid...
I20260807 08:44:15.960126 529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:15.959903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:38381 (local address 127.0.0.1:35918)
0807 08:44:15.960011 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:15.960058 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:38381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260807 08:44:15.960760 529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:15.960531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:38381 (local address 127.0.0.1:35920)
0807 08:44:15.960661 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:15.960703 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:38381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260807 08:44:15.960907 527 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.252:38381: Network error: Client connection negotiation failed: client connection to 127.8.208.252:38381: connect: Connection refused (error 111)
I20260807 08:44:15.992094 527 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } attempt: 1
I20260807 08:44:15.992913 529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:15.992597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:38381 (local address 127.0.0.1:35926)
0807 08:44:15.992744 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:15.992818 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:38381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260807 08:44:15.993621 529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:15.993428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:38381 (local address 127.0.0.1:35940)
0807 08:44:15.993530 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:15.993576 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:38381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260807 08:44:15.993767 527 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.252:38381: Network error: Client connection negotiation failed: client connection to 127.8.208.252:38381: connect: Connection refused (error 111)
I20260807 08:44:16.006563 606 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } attempt: 1
I20260807 08:44:16.007184 608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:16.006941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:38381 (local address 127.0.0.1:35942)
0807 08:44:16.007074 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:16.007127 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:38381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 08:44:16.007851 608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:16.007681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:38381 (local address 127.0.0.1:35954)
0807 08:44:16.007765 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:16.007805 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:38381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260807 08:44:16.007979 606 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.252:38381: Network error: Client connection negotiation failed: client connection to 127.8.208.252:38381: connect: Connection refused (error 111)
W20260807 08:44:16.061774 614 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 08:44:16.062052 614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:44:16.062100 614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:44:16.062165 614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:44:16.065588 614 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:44:16.065656 614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:44:16.065706 614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:44:16.065771 614 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:44:16.065804 614 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:44:16.068946 527 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } attempt: 2
I20260807 08:44:16.069702 529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:16.069437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:38381 (local address 127.0.0.1:35966)
0807 08:44:16.069580 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:16.069636 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:38381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 08:44:16.070341 529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:16.070156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:38381 (local address 127.0.0.1:35978)
0807 08:44:16.070242 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:16.070284 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:38381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260807 08:44:16.070464 527 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.252:38381: Network error: Client connection negotiation failed: client connection to 127.8.208.252:38381: connect: Connection refused (error 111)
I20260807 08:44:16.070693 614 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:38247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:39563,127.8.208.253:46091,127.8.208.252:38381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.252.keytab
--principal=kudu/127.8.208.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.252:38381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.208.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:44:16.071532 614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:44:16.072444 614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 08:44:16.076109 606 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } attempt: 2
I20260807 08:44:16.076793 608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:16.076579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:38381 (local address 127.0.0.1:35980)
0807 08:44:16.076679 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:16.076734 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:38381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260807 08:44:16.077402 608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:16.077203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:38381 (local address 127.0.0.1:35994)
0807 08:44:16.077300 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:16.077346 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:38381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 08:44:16.077507 606 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.252:38381: Network error: Client connection negotiation failed: client connection to 127.8.208.252:38381: connect: Connection refused (error 111)
W20260807 08:44:16.080403 622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:16.080461 620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:16.080413 619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:44:16.080646 614 server_base.cc:1034] running on GCE node
I20260807 08:44:16.081151 614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:44:16.082168 614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:44:16.083318 614 hybrid_clock.cc:648] HybridClock initialized: now 1786092256083285 us; error 43 us; skew 500 ppm
Aug 07 08:44:16 dist-test-slave-6nmv krb5kdc[441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092256, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:44:16.086012 614 init.cc:377] Logged in from keytab as kudu/127.8.208.252@KRBTEST.COM (short username kudu)
I20260807 08:44:16.086781 614 webserver.cc:460] Webserver started at http://127.8.208.252:38749/ using document root <none> and password file <none>
I20260807 08:44:16.087302 614 fs_manager.cc:359] Metadata directory not provided
I20260807 08:44:16.087363 614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:44:16.087587 614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:44:16.089502 614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-2/data/instance:
uuid: "e5df158028b04e31a3ac93df86a6c1d8"
format_stamp: "Formatted at 2026-08-07 08:44:16 on dist-test-slave-6nmv"
server_key: "40a39b374e3aee8aedc0e8bd67e2426f"
server_key_iv: "169a8ac6181d84fedae545f1070895fa"
server_key_version: "encryptionkey@0"
I20260807 08:44:16.090063 614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-2/wal/instance:
uuid: "e5df158028b04e31a3ac93df86a6c1d8"
format_stamp: "Formatted at 2026-08-07 08:44:16 on dist-test-slave-6nmv"
server_key: "40a39b374e3aee8aedc0e8bd67e2426f"
server_key_iv: "169a8ac6181d84fedae545f1070895fa"
server_key_version: "encryptionkey@0"
I20260807 08:44:16.093532 614 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 08:44:16.095870 630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:44:16.097035 614 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:44:16.097162 614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-2/wal
uuid: "e5df158028b04e31a3ac93df86a6c1d8"
format_stamp: "Formatted at 2026-08-07 08:44:16 on dist-test-slave-6nmv"
server_key: "40a39b374e3aee8aedc0e8bd67e2426f"
server_key_iv: "169a8ac6181d84fedae545f1070895fa"
server_key_version: "encryptionkey@0"
I20260807 08:44:16.097261 614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:44:16.122614 614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:44:16.125767 614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:44:16.125977 614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:44:16.132714 614 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.252:38381
I20260807 08:44:16.133011 683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.252:38381 every 8 connection(s)
I20260807 08:44:16.133658 614 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-2/data/info.pb
I20260807 08:44:16.136392 684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:44:16.140051 684 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39563 } has no permanent_uuid. Determining permanent_uuid...
I20260807 08:44:16.143442 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 614
I20260807 08:44:16.143575 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786091987266300-9027-0/minicluster-data/master-2/wal/instance
I20260807 08:44:16.143854 9027 external_mini_cluster.cc:1428] Setting key 6a89b11d6410c4a0c7eac2974dc86845
Aug 07 08:44:16 dist-test-slave-6nmv krb5kdc[441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092256, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.252@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
Aug 07 08:44:16 dist-test-slave-6nmv krb5kdc[441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092255, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.252@KRBTEST.COM
I20260807 08:44:16.153518 530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:16.141945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56908 (local address 127.8.208.254:39563)
0807 08:44:16.142090 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:16.142094 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:16.142684 (+ 590us) server_negotiation.cc:407] Connection header received
0807 08:44:16.143504 (+ 820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:16.143507 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:16.143579 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:16.143676 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:16.144900 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.145546 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.146755 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.147063 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.147145 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:16.149728 (+ 2583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:16.149731 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:16.149733 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:16.149757 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:16.151376 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:16.151975 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:16.151980 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:16.151982 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:16.152072 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:16.152427 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:16.152430 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:16.152432 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:16.152635 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:16.152750 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:16.153214 (+ 464us) server_negotiation.cc:299] Negotiation successful
0807 08:44:16.153325 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 08:44:16.154368 686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:16.142122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:39563 (local address 127.0.0.1:56908)
0807 08:44:16.142526 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:16.142564 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 08:44:16.143313 (+ 749us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:44:16.143827 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:44:16.143833 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:44:16.144178 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:44:16.144708 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:16.144725 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.145673 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.145678 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:16.146620 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:16.146629 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.147198 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.147201 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:16.147381 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:16.147910 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:44:16.147927 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:44:16.149579 (+ 1652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:44:16.151491 (+ 1912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:16.151502 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:16.151510 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:16.151866 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:16.152175 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:16.152178 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:16.152180 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:16.152316 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:16.152748 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:44:16.152754 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:44:16.152982 (+ 228us) client_negotiation.cc:769] Sending connection context
0807 08:44:16.153155 (+ 173us) client_negotiation.cc:240] Negotiation successful
0807 08:44:16.153409 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":114,"threads_started":1}
I20260807 08:44:16.154497 688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:16.144486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35998 (local address 127.8.208.252:38381)
0807 08:44:16.144907 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:16.144920 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:16.144945 (+ 25us) server_negotiation.cc:407] Connection header received
0807 08:44:16.144988 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:16.144993 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:16.145161 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:16.145317 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:16.146139 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.146869 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.147902 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.148246 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.148345 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:16.151044 (+ 2699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:16.151048 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:16.151056 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:16.151075 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:16.152667 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:16.153091 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:16.153094 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:16.153095 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:16.153161 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:16.153404 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:16.153408 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:16.153410 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:16.153716 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:16.153960 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:16.154161 (+ 201us) server_negotiation.cc:299] Negotiation successful
0807 08:44:16.154262 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":130,"threads_started":1}
I20260807 08:44:16.155552 684 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46091 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 08:44:16 dist-test-slave-6nmv krb5kdc[441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092256, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.252@KRBTEST.COM for kudu/127.8.208.253@KRBTEST.COM
Aug 07 08:44:16 dist-test-slave-6nmv krb5kdc[441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092255, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:44:16.163668 686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:16.156078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:46091 (local address 127.0.0.1:59120)
0807 08:44:16.156446 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:16.156458 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:44:16.156585 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:44:16.156803 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:44:16.156806 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:44:16.156953 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:44:16.157031 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:16.157036 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.157700 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.157705 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:16.158248 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:16.158256 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.158736 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.158739 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:16.158830 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:16.159259 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:44:16.159270 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:44:16.160343 (+ 1073us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:44:16.162326 (+ 1983us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:16.162330 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:16.162332 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:16.162518 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:16.162800 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:16.162805 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:16.162807 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:16.162889 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:16.163238 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:44:16.163241 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:44:16.163327 (+ 86us) client_negotiation.cc:769] Sending connection context
0807 08:44:16.163443 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 08:44:16.163565 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312}
I20260807 08:44:16.163858 612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:16.156235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59120 (local address 127.8.208.253:46091)
0807 08:44:16.156395 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:16.156400 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:16.156560 (+ 160us) server_negotiation.cc:407] Connection header received
0807 08:44:16.156662 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:16.156665 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:16.156714 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:16.156793 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:16.157145 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.157601 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.158364 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.158623 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.158736 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:16.160489 (+ 1753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:16.160491 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:16.160493 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:16.160516 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:16.162224 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:16.162623 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:16.162627 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:16.162629 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:16.162711 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:16.162976 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:16.162981 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:16.162982 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:16.163146 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:16.163246 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:16.163521 (+ 275us) server_negotiation.cc:299] Negotiation successful
0807 08:44:16.163644 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 08:44:16.164487 684 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } has no permanent_uuid. Determining permanent_uuid...
I20260807 08:44:16.164769 530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:16.156356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56912 (local address 127.8.208.254:39563)
0807 08:44:16.156503 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:16.156507 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:16.156519 (+ 12us) server_negotiation.cc:407] Connection header received
0807 08:44:16.156625 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:16.156629 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:16.156671 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:16.156751 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:16.157313 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.157739 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.158520 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.158736 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.158851 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:16.161311 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:16.161314 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:16.161317 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:16.161340 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:16.162784 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:16.163354 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:16.163358 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:16.163360 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:16.163456 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:16.163887 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:16.163890 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:16.163892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:16.164073 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:16.164279 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:16.164473 (+ 194us) server_negotiation.cc:299] Negotiation successful
0807 08:44:16.164608 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
Aug 07 08:44:16 dist-test-slave-6nmv krb5kdc[441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092256, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.252@KRBTEST.COM for kudu/127.8.208.252@KRBTEST.COM
I20260807 08:44:16.168635 606 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } attempt: 3
I20260807 08:44:16.169615 527 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } attempt: 3
Aug 07 08:44:16 dist-test-slave-6nmv krb5kdc[441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092255, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.253@KRBTEST.COM
I20260807 08:44:16.172390 686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:16.164937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:38381 (local address 127.0.0.1:36014)
0807 08:44:16.165036 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:16.165050 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:44:16.165114 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:44:16.165357 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:44:16.165359 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:44:16.165510 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:44:16.165563 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:16.165568 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.166361 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.166366 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:16.166821 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:16.166827 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.167267 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.167270 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:16.167333 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:16.167732 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:44:16.167742 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:44:16.168851 (+ 1109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:44:16.170999 (+ 2148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:16.171001 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:16.171003 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:16.171253 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:16.171530 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:16.171533 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:16.171534 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:16.171617 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:16.171981 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:44:16.171983 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:44:16.172049 (+ 66us) client_negotiation.cc:769] Sending connection context
0807 08:44:16.172127 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 08:44:16.172222 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260807 08:44:16.172873 688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:16.165073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36014 (local address 127.8.208.252:38381)
0807 08:44:16.165194 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:16.165198 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:16.165208 (+ 10us) server_negotiation.cc:407] Connection header received
0807 08:44:16.165232 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:16.165235 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:16.165270 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:16.165348 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:16.165671 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.166262 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.166919 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.167170 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.167268 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:16.168975 (+ 1707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:16.168982 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:16.168987 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:16.169018 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:16.170901 (+ 1883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:16.171359 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:16.171362 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:16.171364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:16.171433 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:16.171724 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:16.171727 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:16.171728 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:16.171881 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:16.171954 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:16.172593 (+ 639us) server_negotiation.cc:299] Negotiation successful
0807 08:44:16.172700 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
Aug 07 08:44:16 dist-test-slave-6nmv krb5kdc[441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092255, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for kudu/127.8.208.252@KRBTEST.COM
I20260807 08:44:16.175443 612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:16.165886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59126 (local address 127.8.208.253:46091)
0807 08:44:16.166001 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:16.166005 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:16.166019 (+ 14us) server_negotiation.cc:407] Connection header received
0807 08:44:16.166116 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:16.166119 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:16.166156 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:16.166250 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:16.166834 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.167295 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.168223 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.168465 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.168579 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:16.171977 (+ 3398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:16.171983 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:16.171988 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:16.172017 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:16.173683 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:16.174157 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:16.174161 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:16.174162 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:16.174242 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:16.174558 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:16.174561 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:16.174563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:16.174736 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:16.174879 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:16.175192 (+ 313us) server_negotiation.cc:299] Negotiation successful
0807 08:44:16.175321 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 08:44:16.176196 684 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5df158028b04e31a3ac93df86a6c1d8: Bootstrap starting.
Aug 07 08:44:16 dist-test-slave-6nmv krb5kdc[441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092255, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.253@KRBTEST.COM for kudu/127.8.208.252@KRBTEST.COM
I20260807 08:44:16.178792 684 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e5df158028b04e31a3ac93df86a6c1d8: Neither blocks nor log segments found. Creating new log.
I20260807 08:44:16.179980 684 log.cc:824] T 00000000000000000000000000000000 P e5df158028b04e31a3ac93df86a6c1d8: Log is configured to *not* fsync() on all Append() calls
I20260807 08:44:16.180945 608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:16.168968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:38381 (local address 127.0.0.1:36030)
0807 08:44:16.169090 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:16.169107 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 08:44:16.169176 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:44:16.170482 (+ 1306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:44:16.170487 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:44:16.170667 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:44:16.170786 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:16.170795 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.172027 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.172030 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:16.173803 (+ 1773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:16.173864 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.174722 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.174726 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:16.174825 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:16.175275 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:44:16.175291 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:44:16.176768 (+ 1477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:44:16.179349 (+ 2581us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:16.179364 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:16.179366 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:16.179608 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:16.180012 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:16.180015 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:16.180017 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:16.180107 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:16.180534 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:44:16.180539 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:44:16.180631 (+ 92us) client_negotiation.cc:769] Sending connection context
0807 08:44:16.180722 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 08:44:16.180835 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260807 08:44:16.181133 529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:16.169956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:38381 (local address 127.0.0.1:36042)
0807 08:44:16.170040 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:16.170053 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:44:16.170135 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:44:16.170549 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:44:16.170552 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:44:16.170721 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:44:16.170817 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:16.170827 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.172356 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.172362 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:16.173212 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:16.173225 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.173805 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.173809 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:16.173958 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:16.174389 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:44:16.174404 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:44:16.175760 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:44:16.178621 (+ 2861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:16.178624 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:16.178626 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:16.178909 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:16.179293 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:16.179296 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:16.179298 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:16.179420 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:16.180639 (+ 1219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:44:16.180642 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:44:16.180743 (+ 101us) client_negotiation.cc:769] Sending connection context
0807 08:44:16.180838 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 08:44:16.180972 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260807 08:44:16.181483 689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:16.169520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36030 (local address 127.8.208.252:38381)
0807 08:44:16.170171 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:16.170183 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:16.170201 (+ 18us) server_negotiation.cc:407] Connection header received
0807 08:44:16.170242 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:16.170245 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:16.170294 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:16.170918 (+ 624us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:16.171015 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.171909 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.173995 (+ 2086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.174574 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.176054 (+ 1480us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:16.177190 (+ 1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:16.177195 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:16.177200 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:16.177228 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:16.179210 (+ 1982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:16.179703 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:16.179706 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:16.179707 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:16.179892 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:16.180231 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:16.180235 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:16.180236 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:16.180437 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:16.180529 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:16.181248 (+ 719us) server_negotiation.cc:299] Negotiation successful
0807 08:44:16.181348 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":101,"threads_started":1}
I20260807 08:44:16.181874 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 08:44:16.182250 684 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5df158028b04e31a3ac93df86a6c1d8: No bootstrap required, opened a new log
I20260807 08:44:16.182252 690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:16.170007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36042 (local address 127.8.208.252:38381)
0807 08:44:16.170304 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:16.170313 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:16.170328 (+ 15us) server_negotiation.cc:407] Connection header received
0807 08:44:16.170365 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:16.170371 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:16.170411 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:16.170928 (+ 517us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:16.171448 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.172222 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.173351 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.173678 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.174159 (+ 481us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:16.176581 (+ 2422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:16.176585 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:16.176588 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:16.176612 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:16.178466 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:16.179055 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:16.179061 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:16.179063 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:16.179157 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:16.179544 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:16.179548 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:16.179550 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:16.180328 (+ 778us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:16.181909 (+ 1581us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:16.181980 (+ 71us) server_negotiation.cc:299] Negotiation successful
0807 08:44:16.182083 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":119,"threads_started":1}
I20260807 08:44:16.184435 527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b: Bootstrap starting.
I20260807 08:44:16.185146 606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 874cae1100c647a3bf0ec6c6f852b038: Bootstrap starting.
I20260807 08:44:16.186471 527 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b: Neither blocks nor log segments found. Creating new log.
I20260807 08:44:16.186889 684 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5df158028b04e31a3ac93df86a6c1d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39563 } } peers { permanent_uuid: "874cae1100c647a3bf0ec6c6f852b038" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46091 } } peers { permanent_uuid: "e5df158028b04e31a3ac93df86a6c1d8" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } }
I20260807 08:44:16.187111 684 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5df158028b04e31a3ac93df86a6c1d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5df158028b04e31a3ac93df86a6c1d8, State: Initialized, Role: FOLLOWER
I20260807 08:44:16.187147 527 log.cc:824] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b: Log is configured to *not* fsync() on all Append() calls
I20260807 08:44:16.187417 684 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5df158028b04e31a3ac93df86a6c1d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39563 } } peers { permanent_uuid: "874cae1100c647a3bf0ec6c6f852b038" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46091 } } peers { permanent_uuid: "e5df158028b04e31a3ac93df86a6c1d8" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } }
I20260807 08:44:16.187501 606 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 874cae1100c647a3bf0ec6c6f852b038: Neither blocks nor log segments found. Creating new log.
I20260807 08:44:16.188256 606 log.cc:824] T 00000000000000000000000000000000 P 874cae1100c647a3bf0ec6c6f852b038: Log is configured to *not* fsync() on all Append() calls
I20260807 08:44:16.187587 500 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "45b9ccf4635b4c9ab703e9702b53a68b"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56912
I20260807 08:44:16.188740 684 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5df158028b04e31a3ac93df86a6c1d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:44:16.190097 527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b: No bootstrap required, opened a new log
I20260807 08:44:16.190382 606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 874cae1100c647a3bf0ec6c6f852b038: No bootstrap required, opened a new log
I20260807 08:44:16.191148 693 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5df158028b04e31a3ac93df86a6c1d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39563 } } peers { permanent_uuid: "874cae1100c647a3bf0ec6c6f852b038" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46091 } } peers { permanent_uuid: "e5df158028b04e31a3ac93df86a6c1d8" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } } }
I20260807 08:44:16.191277 693 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5df158028b04e31a3ac93df86a6c1d8 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:44:16.193351 527 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39563 } } peers { permanent_uuid: "874cae1100c647a3bf0ec6c6f852b038" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46091 } } peers { permanent_uuid: "e5df158028b04e31a3ac93df86a6c1d8" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } }
I20260807 08:44:16.193547 527 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45b9ccf4635b4c9ab703e9702b53a68b, State: Initialized, Role: FOLLOWER
W20260807 08:44:16.193766 706 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e5df158028b04e31a3ac93df86a6c1d8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:44:16.193876 706 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:44:16.193847 527 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39563 } } peers { permanent_uuid: "874cae1100c647a3bf0ec6c6f852b038" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46091 } } peers { permanent_uuid: "e5df158028b04e31a3ac93df86a6c1d8" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } }
I20260807 08:44:16.194332 708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39563 } } peers { permanent_uuid: "874cae1100c647a3bf0ec6c6f852b038" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46091 } } peers { permanent_uuid: "e5df158028b04e31a3ac93df86a6c1d8" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } } }
I20260807 08:44:16.194506 708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:44:16.194392 606 raft_consensus.cc:348] T 00000000000000000000000000000000 P 874cae1100c647a3bf0ec6c6f852b038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39563 } } peers { permanent_uuid: "874cae1100c647a3bf0ec6c6f852b038" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46091 } } peers { permanent_uuid: "e5df158028b04e31a3ac93df86a6c1d8" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } }
I20260807 08:44:16.194581 606 raft_consensus.cc:729] T 00000000000000000000000000000000 P 874cae1100c647a3bf0ec6c6f852b038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 874cae1100c647a3bf0ec6c6f852b038, State: Initialized, Role: FOLLOWER
I20260807 08:44:16.194885 606 consensus_queue.cc:260] T 00000000000000000000000000000000 P 874cae1100c647a3bf0ec6c6f852b038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39563 } } peers { permanent_uuid: "874cae1100c647a3bf0ec6c6f852b038" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46091 } } peers { permanent_uuid: "e5df158028b04e31a3ac93df86a6c1d8" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } }
I20260807 08:44:16.195055 527 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:44:16.192219 614 master_runner.cc:186] Error getting master registration for 127.8.208.254:39563: OK, instance_id { permanent_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" instance_seqno: 1786092255706569 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 08:44:16.195482 614 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 08:44:16.195600 500 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 08:44:16.195708 500 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:44:16.196231 606 sys_catalog.cc:564] T 00000000000000000000000000000000 P 874cae1100c647a3bf0ec6c6f852b038 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:44:16.195334 710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 874cae1100c647a3bf0ec6c6f852b038 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39563 } } peers { permanent_uuid: "874cae1100c647a3bf0ec6c6f852b038" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46091 } } peers { permanent_uuid: "e5df158028b04e31a3ac93df86a6c1d8" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } } }
I20260807 08:44:16.196563 710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 874cae1100c647a3bf0ec6c6f852b038 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:44:16.197099 500 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39563 } } peers { permanent_uuid: "874cae1100c647a3bf0ec6c6f852b038" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46091 } } peers { permanent_uuid: "e5df158028b04e31a3ac93df86a6c1d8" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } }
I20260807 08:44:16.198141 500 leader_election.cc:288] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b [CANDIDATE]: Term 1 election: Requested vote from peers 874cae1100c647a3bf0ec6c6f852b038 (127.8.208.253:46091), e5df158028b04e31a3ac93df86a6c1d8 (127.8.208.252:38381)
I20260807 08:44:16.198724 657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e5df158028b04e31a3ac93df86a6c1d8"
I20260807 08:44:16.198951 657 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5df158028b04e31a3ac93df86a6c1d8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:44:16.200289 657 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e5df158028b04e31a3ac93df86a6c1d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45b9ccf4635b4c9ab703e9702b53a68b in term 1.
I20260807 08:44:16.201364 475 leader_election.cc:302] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45b9ccf4635b4c9ab703e9702b53a68b, e5df158028b04e31a3ac93df86a6c1d8; no voters:
I20260807 08:44:16.201617 708 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:44:16.201797 708 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b [term 1 LEADER]: Becoming Leader. State: Replica: 45b9ccf4635b4c9ab703e9702b53a68b, State: Running, Role: LEADER
I20260807 08:44:16.202106 708 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39563 } } peers { permanent_uuid: "874cae1100c647a3bf0ec6c6f852b038" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46091 } } peers { permanent_uuid: "e5df158028b04e31a3ac93df86a6c1d8" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } }
W20260807 08:44:16.202592 477 tablet.cc:2369] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 08:44:16.202828 728 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:44:16.202903 728 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:44:16.200502 455 master_runner.cc:186] Error getting master registration for 127.8.208.253:46091: OK, instance_id { permanent_uuid: "874cae1100c647a3bf0ec6c6f852b038" instance_seqno: 1786092255916859 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 08:44:16.203570 455 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 08:44:16.203778 708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45b9ccf4635b4c9ab703e9702b53a68b. Latest consensus state: current_term: 1 leader_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39563 } } peers { permanent_uuid: "874cae1100c647a3bf0ec6c6f852b038" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46091 } } peers { permanent_uuid: "e5df158028b04e31a3ac93df86a6c1d8" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } } }
I20260807 08:44:16.203918 708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b [sys.catalog]: This master's current role is: LEADER
I20260807 08:44:16.204321 743 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:44:16.200649 578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "874cae1100c647a3bf0ec6c6f852b038"
I20260807 08:44:16.204618 578 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 874cae1100c647a3bf0ec6c6f852b038 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:44:16.205185 743 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:44:16.205776 578 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 874cae1100c647a3bf0ec6c6f852b038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45b9ccf4635b4c9ab703e9702b53a68b in term 1.
W20260807 08:44:16.210196 738 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 874cae1100c647a3bf0ec6c6f852b038: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:44:16.210299 738 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:44:16.212339 657 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e5df158028b04e31a3ac93df86a6c1d8 [term 1 FOLLOWER]: Refusing update from remote peer 45b9ccf4635b4c9ab703e9702b53a68b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:44:16.212975 708 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5df158028b04e31a3ac93df86a6c1d8" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:44:16.215961 612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:16.200456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59128 (local address 127.8.208.253:46091)
0807 08:44:16.203879 (+ 3423us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:16.203883 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:16.203898 (+ 15us) server_negotiation.cc:407] Connection header received
0807 08:44:16.203936 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:16.203939 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:16.203983 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:16.204061 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:16.205084 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.205750 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.207017 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.207378 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.207456 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:16.212291 (+ 4835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:16.212295 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:16.212298 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:16.212323 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:16.214135 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:16.214644 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:16.214648 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:16.214650 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:16.214740 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:16.215028 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:16.215031 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:16.215033 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:16.215258 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:16.215366 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:16.215704 (+ 338us) server_negotiation.cc:299] Negotiation successful
0807 08:44:16.215807 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3325}
I20260807 08:44:16.216293 693 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5df158028b04e31a3ac93df86a6c1d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45b9ccf4635b4c9ab703e9702b53a68b. Latest consensus state: current_term: 1 leader_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39563 } } peers { permanent_uuid: "874cae1100c647a3bf0ec6c6f852b038" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46091 } } peers { permanent_uuid: "e5df158028b04e31a3ac93df86a6c1d8" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } } }
I20260807 08:44:16.216401 693 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5df158028b04e31a3ac93df86a6c1d8 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:44:16.217159 578 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 874cae1100c647a3bf0ec6c6f852b038 [term 1 FOLLOWER]: Refusing update from remote peer 45b9ccf4635b4c9ab703e9702b53a68b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:44:16.217660 708 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b [LEADER]: Connected to new peer: Peer: permanent_uuid: "874cae1100c647a3bf0ec6c6f852b038" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:44:16.220813 710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 874cae1100c647a3bf0ec6c6f852b038 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45b9ccf4635b4c9ab703e9702b53a68b. Latest consensus state: current_term: 1 leader_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39563 } } peers { permanent_uuid: "874cae1100c647a3bf0ec6c6f852b038" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46091 } } peers { permanent_uuid: "e5df158028b04e31a3ac93df86a6c1d8" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } } }
I20260807 08:44:16.220937 710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 874cae1100c647a3bf0ec6c6f852b038 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:44:16.225541 741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39563 } } peers { permanent_uuid: "874cae1100c647a3bf0ec6c6f852b038" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46091 } } peers { permanent_uuid: "e5df158028b04e31a3ac93df86a6c1d8" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } } }
I20260807 08:44:16.225651 741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b [sys.catalog]: This master's current role is: LEADER
I20260807 08:44:16.226692 710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 874cae1100c647a3bf0ec6c6f852b038 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39563 } } peers { permanent_uuid: "874cae1100c647a3bf0ec6c6f852b038" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46091 } } peers { permanent_uuid: "e5df158028b04e31a3ac93df86a6c1d8" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } } }
I20260807 08:44:16.226789 710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 874cae1100c647a3bf0ec6c6f852b038 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:44:16.226805 690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:16.218545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36050 (local address 127.8.208.252:38381)
0807 08:44:16.218647 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:16.218651 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:16.218950 (+ 299us) server_negotiation.cc:407] Connection header received
0807 08:44:16.219131 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:16.219134 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:16.219190 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:16.219240 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:16.220160 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.220817 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.221786 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.222120 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.222192 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:16.223600 (+ 1408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:16.223603 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:16.223606 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:16.223628 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:16.225106 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:16.225561 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:16.225564 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:16.225566 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:16.225641 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:16.225960 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:16.225963 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:16.225965 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:16.226150 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:16.226255 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:16.226570 (+ 315us) server_negotiation.cc:299] Negotiation successful
0807 08:44:16.226670 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 08:44:16.227133 745 mvcc.cc:205] Tried to move back new op lower bound from 7315833881439543296 to 7315833881407156224. Current Snapshot: MvccSnapshot[applied={T|T < 7315833881439543296}]
I20260807 08:44:16.228840 748 mvcc.cc:205] Tried to move back new op lower bound from 7315833881439543296 to 7315833881407156224. Current Snapshot: MvccSnapshot[applied={T|T < 7315833881439543296}]
I20260807 08:44:16.229497 708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39563 } } peers { permanent_uuid: "874cae1100c647a3bf0ec6c6f852b038" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46091 } } peers { permanent_uuid: "e5df158028b04e31a3ac93df86a6c1d8" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } } }
I20260807 08:44:16.229588 708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b [sys.catalog]: This master's current role is: LEADER
I20260807 08:44:16.230371 693 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5df158028b04e31a3ac93df86a6c1d8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45b9ccf4635b4c9ab703e9702b53a68b" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 39563 } } peers { permanent_uuid: "874cae1100c647a3bf0ec6c6f852b038" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46091 } } peers { permanent_uuid: "e5df158028b04e31a3ac93df86a6c1d8" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 38381 } } }
I20260807 08:44:16.230476 693 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5df158028b04e31a3ac93df86a6c1d8 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:44:16.230724 746 mvcc.cc:205] Tried to move back new op lower bound from 7315833881439543296 to 7315833881407156224. Current Snapshot: MvccSnapshot[applied={T|T < 7315833881439543296}]
I20260807 08:44:16.232370 743 catalog_manager.cc:1347] Generated new cluster ID: 4cd15773697844f89da5f0bcff60fc51
I20260807 08:44:16.232432 743 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:44:16.235270 530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:16.218090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56928 (local address 127.8.208.254:39563)
0807 08:44:16.218202 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:16.218207 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:16.227292 (+ 9085us) server_negotiation.cc:407] Connection header received
0807 08:44:16.227526 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:16.227530 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:16.227570 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:16.227615 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:16.228433 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.229173 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.230236 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:16.230525 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:16.230590 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:16.232035 (+ 1445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:16.232038 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:16.232041 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:16.232065 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:16.233601 (+ 1536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:16.234069 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:16.234072 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:16.234074 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:16.234167 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:16.234431 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:16.234434 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:16.234435 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:16.234614 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:16.234718 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:16.235040 (+ 322us) server_negotiation.cc:299] Negotiation successful
0807 08:44:16.235140 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 08:44:16.261082 743 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:44:16.262679 743 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:44:16.272524 743 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 45b9ccf4635b4c9ab703e9702b53a68b: Generated new TSK 0
I20260807 08:44:16.273240 743 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 08:44:16.316612 690 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:16.313799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36052 (local address 127.8.208.252:38381)
0807 08:44:16.313959 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:16.313963 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:16.315680 (+ 1717us) server_negotiation.cc:407] Connection header received
0807 08:44:16.315794 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:16.315797 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:16.315846 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:16.315935 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:16.316496 (+ 561us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36052: BlockingRecv error: recv got EOF from 127.0.0.1:36052 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260807 08:44:16.316774 612 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:16.314430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59134 (local address 127.8.208.253:46091)
0807 08:44:16.314548 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:16.314552 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:16.315933 (+ 1381us) server_negotiation.cc:407] Connection header received
0807 08:44:16.316094 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:16.316097 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:16.316138 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:16.316182 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:16.316662 (+ 480us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59134: BlockingRecv error: recv got EOF from 127.0.0.1:59134 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260807 08:44:16.317813 530 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:16.315061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56930 (local address 127.8.208.254:39563)
0807 08:44:16.315162 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:16.315166 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:16.317052 (+ 1886us) server_negotiation.cc:407] Connection header received
0807 08:44:16.317200 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:16.317203 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:16.317243 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:16.317296 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:16.317717 (+ 421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56930: BlockingRecv error: recv got EOF from 127.0.0.1:56930 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260807 08:44:16.321648 612 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:16.320343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59140 (local address 127.8.208.253:46091)
0807 08:44:16.320424 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:16.320428 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:16.320841 (+ 413us) server_negotiation.cc:407] Connection header received
0807 08:44:16.321032 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:16.321035 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:16.321094 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:16.321154 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:16.321569 (+ 415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59140: BlockingRecv error: recv got EOF from 127.0.0.1:59140 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
W20260807 08:44:16.326148 612 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:16.324803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59142 (local address 127.8.208.253:46091)
0807 08:44:16.324902 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:16.324905 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:16.325357 (+ 452us) server_negotiation.cc:407] Connection header received
0807 08:44:16.325529 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:16.325532 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:16.325585 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:16.325636 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:16.326074 (+ 438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59142: BlockingRecv error: recv got EOF from 127.0.0.1:59142 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260807 08:44:16.331161 612 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:16.329889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59150 (local address 127.8.208.253:46091)
0807 08:44:16.329973 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:16.329977 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:16.330423 (+ 446us) server_negotiation.cc:407] Connection header received
0807 08:44:16.330584 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:16.330587 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:16.330624 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:16.330666 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:16.331087 (+ 421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59150: BlockingRecv error: recv got EOF from 127.0.0.1:59150 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260807 08:44:16.338603 612 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:16.336978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59166 (local address 127.8.208.253:46091)
0807 08:44:16.337102 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:16.337106 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:16.337672 (+ 566us) server_negotiation.cc:407] Connection header received
0807 08:44:16.337873 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:16.337877 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:16.337919 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:16.337968 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:16.338508 (+ 540us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59166: BlockingRecv error: recv got EOF from 127.0.0.1:59166 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260807 08:44:16.350258 612 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:16.348564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59176 (local address 127.8.208.253:46091)
0807 08:44:16.348680 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:16.348686 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:16.349294 (+ 608us) server_negotiation.cc:407] Connection header received
0807 08:44:16.349535 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:16.349538 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:16.349587 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:16.349637 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:16.350167 (+ 530us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59176: BlockingRecv error: recv got EOF from 127.0.0.1:59176 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260807 08:44:16.370039 612 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:16.368338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59180 (local address 127.8.208.253:46091)
0807 08:44:16.368461 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:16.368466 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:16.369058 (+ 592us) server_negotiation.cc:407] Connection header received
0807 08:44:16.369270 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:16.369274 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:16.369324 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:16.369395 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:16.369953 (+ 558us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59180: BlockingRecv error: recv got EOF from 127.0.0.1:59180 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260807 08:44:16.405464 612 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:16.404172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59194 (local address 127.8.208.253:46091)
0807 08:44:16.404291 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:16.404295 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:16.404532 (+ 237us) server_negotiation.cc:407] Connection header received
0807 08:44:16.404691 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:16.404694 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:16.404746 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:16.404834 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:16.405311 (+ 477us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59194: BlockingRecv error: recv got EOF from 127.0.0.1:59194 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260807 08:44:16.472710 612 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:16.471632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59200 (local address 127.8.208.253:46091)
0807 08:44:16.471785 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:16.471788 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:16.471949 (+ 161us) server_negotiation.cc:407] Connection header received
0807 08:44:16.472070 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:16.472073 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:16.472122 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:16.472238 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:16.472616 (+ 378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59200: BlockingRecv error: recv got EOF from 127.0.0.1:59200 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260807 08:44:16.605926 612 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:16.603528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59206 (local address 127.8.208.253:46091)
0807 08:44:16.603704 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:16.603709 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:16.603883 (+ 174us) server_negotiation.cc:407] Connection header received
0807 08:44:16.604054 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:16.604060 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:16.604123 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:16.604213 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:16.605751 (+ 1538us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59206: BlockingRecv error: recv got EOF from 127.0.0.1:59206 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260807 08:44:16.864193 612 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:16.863221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59216 (local address 127.8.208.253:46091)
0807 08:44:16.863364 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:16.863367 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:16.863388 (+ 21us) server_negotiation.cc:407] Connection header received
0807 08:44:16.863537 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:16.863540 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:16.863589 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:16.863672 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:16.864097 (+ 425us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59216: BlockingRecv error: recv got EOF from 127.0.0.1:59216 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 08:44:17.195261 706 catalog_manager.cc:1259] Loaded cluster ID: 4cd15773697844f89da5f0bcff60fc51
I20260807 08:44:17.195405 706 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e5df158028b04e31a3ac93df86a6c1d8: loading cluster ID for follower catalog manager: success
I20260807 08:44:17.197307 706 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e5df158028b04e31a3ac93df86a6c1d8: acquiring CA information for follower catalog manager: success
I20260807 08:44:17.198501 706 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e5df158028b04e31a3ac93df86a6c1d8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 08:44:17.211362 738 catalog_manager.cc:1259] Loaded cluster ID: 4cd15773697844f89da5f0bcff60fc51
I20260807 08:44:17.211424 738 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 874cae1100c647a3bf0ec6c6f852b038: loading cluster ID for follower catalog manager: success
I20260807 08:44:17.212934 738 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 874cae1100c647a3bf0ec6c6f852b038: acquiring CA information for follower catalog manager: success
I20260807 08:44:17.214042 738 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 874cae1100c647a3bf0ec6c6f852b038: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 08:44:17.382061 821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:17.378471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59218 (local address 127.8.208.253:46091)
0807 08:44:17.378722 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:17.378726 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:17.378742 (+ 16us) server_negotiation.cc:407] Connection header received
0807 08:44:17.378823 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:17.378825 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:17.378949 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:17.379047 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:44:17.379362 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:17.379883 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:17.380660 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:17.380883 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:17.380954 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:17.381244 (+ 290us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:44:17.381662 (+ 418us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:44:17.381748 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:17.381894 (+ 146us) server_negotiation.cc:299] Negotiation successful
0807 08:44:17.381943 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":72,"threads_started":1}
I20260807 08:44:17.388201 828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:17.384888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36060 (local address 127.8.208.252:38381)
0807 08:44:17.385120 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:17.385125 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:17.385140 (+ 15us) server_negotiation.cc:407] Connection header received
0807 08:44:17.385230 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:17.385232 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:17.385328 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:17.385442 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:44:17.385625 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:17.386162 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:17.386934 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:17.387138 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:17.387239 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:17.387525 (+ 286us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:44:17.387836 (+ 311us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:44:17.387970 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:17.388020 (+ 50us) server_negotiation.cc:299] Negotiation successful
0807 08:44:17.388067 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":63,"threads_started":1}
I20260807 08:44:17.394424 828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:17.391263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36074 (local address 127.8.208.252:38381)
0807 08:44:17.391420 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:17.391423 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:17.391431 (+ 8us) server_negotiation.cc:407] Connection header received
0807 08:44:17.391461 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:17.391462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:17.391492 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:17.391573 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:44:17.391828 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:17.392463 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:17.393486 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:17.393699 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:17.393802 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:17.394074 (+ 272us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:44:17.394149 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:44:17.394217 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:17.394285 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 08:44:17.394325 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260807 08:44:17.395300 821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:17.391227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59234 (local address 127.8.208.253:46091)
0807 08:44:17.391339 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:17.391343 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:17.391661 (+ 318us) server_negotiation.cc:407] Connection header received
0807 08:44:17.391841 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:17.391844 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:17.391887 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:17.391931 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:44:17.392330 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:17.392935 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:17.394186 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:17.394501 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:17.394612 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:17.394854 (+ 242us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:44:17.394937 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:44:17.394983 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:17.395137 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 08:44:17.395194 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 08:44:17.396034 835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:17.390934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56934 (local address 127.8.208.254:39563)
0807 08:44:17.391675 (+ 741us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:17.391681 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:17.391695 (+ 14us) server_negotiation.cc:407] Connection header received
0807 08:44:17.391778 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:17.391781 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:17.391919 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:17.392046 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:44:17.392271 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:17.393043 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:17.394213 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:17.394755 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:17.394844 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:17.395265 (+ 421us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:44:17.395674 (+ 409us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:44:17.395750 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:17.395879 (+ 129us) server_negotiation.cc:299] Negotiation successful
0807 08:44:17.395927 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":626,"thread_start_us":107,"threads_started":1}
I20260807 08:44:17.405786 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 455
I20260807 08:44:17.414381 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 535
I20260807 08:44:17.421705 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 614
2026-08-07T08:44:17Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3038 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 08:44:17 dist-test-slave-6nmv krb5kdc[839](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 08:44:17 dist-test-slave-6nmv krb5kdc[839](info): set up 2 sockets
Aug 07 08:44:17 dist-test-slave-6nmv krb5kdc[839](info): commencing operation
krb5kdc: starting...
W20260807 08:44:18.432521 9027 mini_kdc.cc:121] Time spent starting KDC: real 0.989s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/krb5kdc/test-user.keytab.
Aug 07 08:44:18 dist-test-slave-6nmv krb5kdc[839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T08:44:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T08:44:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.208.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
Entry for principal kudu/127.8.208.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab.
I20260807 08:44:18.548245 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:40319
--webserver_interface=127.8.208.254
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:42009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:40319,127.8.208.253:46141,127.8.208.252:34849
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 08:44:18.660436 854 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 08:44:18.660660 854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:44:18.660681 854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:44:18.660713 854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:44:18.664299 854 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:44:18.664353 854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:44:18.664376 854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:44:18.664392 854 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:44:18.664408 854 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:44:18.668985 854 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:42009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:40319,127.8.208.253:46141,127.8.208.252:34849
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.254.keytab
--principal=kudu/127.8.208.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.254:40319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.208.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:44:18.669898 854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:44:18.670708 854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:44:18.678769 861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:18.678835 860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:18.678771 863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:44:18.678980 854 server_base.cc:1034] running on GCE node
I20260807 08:44:18.679714 854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:44:18.680612 854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:44:18.681838 854 hybrid_clock.cc:648] HybridClock initialized: now 1786092258681790 us; error 30 us; skew 500 ppm
Aug 07 08:44:18 dist-test-slave-6nmv krb5kdc[839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092258, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:44:18.684341 854 init.cc:377] Logged in from keytab as kudu/127.8.208.254@KRBTEST.COM (short username kudu)
I20260807 08:44:18.685063 854 webserver.cc:460] Webserver started at http://127.8.208.254:46697/ using document root <none> and password file <none>
I20260807 08:44:18.685555 854 fs_manager.cc:359] Metadata directory not provided
I20260807 08:44:18.685640 854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:44:18.685901 854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:44:18.687677 854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-0/data/instance:
uuid: "fde3cc85731b4271a6d05a5784c02ec0"
format_stamp: "Formatted at 2026-08-07 08:44:18 on dist-test-slave-6nmv"
server_key: "5171ff52f2b0b39a0f3e9b2cfc84d745"
server_key_iv: "089be2501bdf919cf139144f9cce3ab2"
server_key_version: "encryptionkey@0"
I20260807 08:44:18.688200 854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-0/wal/instance:
uuid: "fde3cc85731b4271a6d05a5784c02ec0"
format_stamp: "Formatted at 2026-08-07 08:44:18 on dist-test-slave-6nmv"
server_key: "5171ff52f2b0b39a0f3e9b2cfc84d745"
server_key_iv: "089be2501bdf919cf139144f9cce3ab2"
server_key_version: "encryptionkey@0"
I20260807 08:44:18.691567 854 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 08:44:18.693682 871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:44:18.694756 854 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:44:18.694895 854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-0/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-0/wal
uuid: "fde3cc85731b4271a6d05a5784c02ec0"
format_stamp: "Formatted at 2026-08-07 08:44:18 on dist-test-slave-6nmv"
server_key: "5171ff52f2b0b39a0f3e9b2cfc84d745"
server_key_iv: "089be2501bdf919cf139144f9cce3ab2"
server_key_version: "encryptionkey@0"
I20260807 08:44:18.695008 854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:44:18.717792 854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:44:18.720479 854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:44:18.720669 854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:44:18.727309 854 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.254:40319
I20260807 08:44:18.727607 924 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.254:40319 every 8 connection(s)
I20260807 08:44:18.728284 854 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-0/data/info.pb
I20260807 08:44:18.730906 925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:44:18.734454 925 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40319 } has no permanent_uuid. Determining permanent_uuid...
I20260807 08:44:18.736315 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 854
I20260807 08:44:18.736444 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-0/wal/instance
I20260807 08:44:18.736783 9027 external_mini_cluster.cc:1428] Setting key 7b5bd578d89a99b02514b106d6aefd6f
Aug 07 08:44:18 dist-test-slave-6nmv krb5kdc[839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092258, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.208.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.253@KRBTEST.COM" created.
I20260807 08:44:18.748174 928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:18.736463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:40319 (local address 127.0.0.1:52846)
0807 08:44:18.737027 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:18.737060 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 08:44:18.737874 (+ 814us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:44:18.738551 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:44:18.738556 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:44:18.738975 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:44:18.739191 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:18.739203 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:18.740313 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:18.740316 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:18.740994 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:18.741002 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:18.741597 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:18.741601 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:18.741705 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:18.742304 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:44:18.742319 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:44:18.743676 (+ 1357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:44:18.745485 (+ 1809us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:18.745493 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:18.745501 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:18.745705 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:18.746050 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:18.746053 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:18.746054 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:18.746158 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:18.746674 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:44:18.746679 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:44:18.746828 (+ 149us) client_negotiation.cc:769] Sending connection context
0807 08:44:18.746998 (+ 170us) client_negotiation.cc:240] Negotiation successful
0807 08:44:18.747339 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":396,"mutex_wait_us":97,"thread_start_us":153,"threads_started":1}
I20260807 08:44:18.748174 927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:18.736462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52846 (local address 127.8.208.254:40319)
0807 08:44:18.736918 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:18.736935 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:18.737158 (+ 223us) server_negotiation.cc:407] Connection header received
0807 08:44:18.738174 (+ 1016us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:18.738178 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:18.738364 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:18.738545 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:18.739352 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:18.740182 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:18.741110 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:18.741452 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:18.741614 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:18.743803 (+ 2189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:18.743816 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:18.743824 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:18.743842 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:18.745375 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:18.745807 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:18.745841 (+ 34us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:18.745845 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:18.745944 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:18.746249 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:18.746252 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:18.746253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:18.746561 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:18.746698 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:18.747060 (+ 362us) server_negotiation.cc:299] Negotiation successful
0807 08:44:18.747294 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":252,"thread_start_us":120,"threads_started":1}
I20260807 08:44:18.750303 925 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46141 } has no permanent_uuid. Determining permanent_uuid...
I20260807 08:44:18.750991 928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:18.750765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:46141 (local address 127.0.0.1:42220)
0807 08:44:18.750875 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:18.750937 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.253:46141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 08:44:18.751219 872 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.208.253:46141: connect: Connection refused (error 111)
I20260807 08:44:18.752059 928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:18.751863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:46141 (local address 127.0.0.1:42222)
0807 08:44:18.751967 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:18.752008 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.253:46141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 08:44:18.752298 925 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.253:46141: Network error: Client connection negotiation failed: client connection to 127.8.208.253:46141: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.253.keytab.
Entry for principal kudu/127.8.208.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.253.keytab.
I20260807 08:44:18.763052 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.253:46141
--webserver_interface=127.8.208.253
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.253.keytab
--principal=kudu/127.8.208.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:42009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:40319,127.8.208.253:46141,127.8.208.252:34849
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 08:44:18.801527 925 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46141 } attempt: 1
I20260807 08:44:18.802320 928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:18.802045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:46141 (local address 127.0.0.1:42234)
0807 08:44:18.802200 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:18.802252 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.253:46141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260807 08:44:18.802961 928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:18.802793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:46141 (local address 127.0.0.1:42248)
0807 08:44:18.802878 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:18.802916 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.253:46141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260807 08:44:18.803133 925 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.253:46141: Network error: Client connection negotiation failed: client connection to 127.8.208.253:46141: connect: Connection refused (error 111)
W20260807 08:44:18.867313 932 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 08:44:18.867518 932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:44:18.867538 932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:44:18.867604 932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 08:44:18.871358 925 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46141 } attempt: 2
W20260807 08:44:18.871589 932 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:44:18.871685 932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:44:18.871718 932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:44:18.871747 932 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:44:18.871785 932 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:44:18.872242 928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:18.871937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:46141 (local address 127.0.0.1:42264)
0807 08:44:18.872090 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:18.872166 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.253:46141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 08:44:18.872987 928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:18.872779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:46141 (local address 127.0.0.1:42266)
0807 08:44:18.872872 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:18.872919 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.253:46141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 08:44:18.873134 925 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.253:46141: Network error: Client connection negotiation failed: client connection to 127.8.208.253:46141: connect: Connection refused (error 111)
I20260807 08:44:18.876984 932 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:42009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:40319,127.8.208.253:46141,127.8.208.252:34849
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.253.keytab
--principal=kudu/127.8.208.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.253:46141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.208.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.932
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:44:18.877898 932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:44:18.878851 932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 08:44:18.886662 938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:18.886677 941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:18.886693 939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:44:18.886965 932 server_base.cc:1034] running on GCE node
I20260807 08:44:18.887650 932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:44:18.888659 932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:44:18.889868 932 hybrid_clock.cc:648] HybridClock initialized: now 1786092258889854 us; error 22 us; skew 500 ppm
Aug 07 08:44:18 dist-test-slave-6nmv krb5kdc[839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092258, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:44:18.892441 932 init.cc:377] Logged in from keytab as kudu/127.8.208.253@KRBTEST.COM (short username kudu)
I20260807 08:44:18.893275 932 webserver.cc:460] Webserver started at http://127.8.208.253:41187/ using document root <none> and password file <none>
I20260807 08:44:18.893783 932 fs_manager.cc:359] Metadata directory not provided
I20260807 08:44:18.893915 932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:44:18.894129 932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:44:18.895915 932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-1/data/instance:
uuid: "8c16d8cedaef4705bf645f2445037273"
format_stamp: "Formatted at 2026-08-07 08:44:18 on dist-test-slave-6nmv"
server_key: "b28d375390ae96c04d26e748e168f593"
server_key_iv: "f3b0220cbd8fd7d27c07e9e6b5f69a0e"
server_key_version: "encryptionkey@0"
I20260807 08:44:18.896433 932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-1/wal/instance:
uuid: "8c16d8cedaef4705bf645f2445037273"
format_stamp: "Formatted at 2026-08-07 08:44:18 on dist-test-slave-6nmv"
server_key: "b28d375390ae96c04d26e748e168f593"
server_key_iv: "f3b0220cbd8fd7d27c07e9e6b5f69a0e"
server_key_version: "encryptionkey@0"
I20260807 08:44:18.899957 932 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260807 08:44:18.902088 948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:44:18.903191 932 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 08:44:18.903329 932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-1/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-1/wal
uuid: "8c16d8cedaef4705bf645f2445037273"
format_stamp: "Formatted at 2026-08-07 08:44:18 on dist-test-slave-6nmv"
server_key: "b28d375390ae96c04d26e748e168f593"
server_key_iv: "f3b0220cbd8fd7d27c07e9e6b5f69a0e"
server_key_version: "encryptionkey@0"
I20260807 08:44:18.903432 932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:44:18.922772 932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:44:18.925577 932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:44:18.925757 932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:44:18.932308 932 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.253:46141
I20260807 08:44:18.932587 1002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.253:46141 every 8 connection(s)
I20260807 08:44:18.933187 932 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-1/data/info.pb
I20260807 08:44:18.935761 1003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:44:18.938977 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 932
I20260807 08:44:18.939101 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-1/wal/instance
I20260807 08:44:18.939399 9027 external_mini_cluster.cc:1428] Setting key 98a71d79ba84bcea670ccd62cb42dfb9
I20260807 08:44:18.939208 1003 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40319 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.8.208.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.208.252@KRBTEST.COM" created.
Aug 07 08:44:18 dist-test-slave-6nmv krb5kdc[839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092258, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.253@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:44:18.954950 927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:18.941195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52850 (local address 127.8.208.254:40319)
0807 08:44:18.941325 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:18.941329 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:18.942103 (+ 774us) server_negotiation.cc:407] Connection header received
0807 08:44:18.942959 (+ 856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:18.942964 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:18.943034 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:18.943133 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:18.944161 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:18.945002 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:18.946092 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:18.946451 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:18.946573 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:18.951535 (+ 4962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:18.951539 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:18.951541 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:18.951572 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:18.952967 (+ 1395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:18.953467 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:18.953475 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:18.953477 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:18.953551 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:18.953911 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:18.953914 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:18.953916 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:18.954098 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:18.954203 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:18.954683 (+ 480us) server_negotiation.cc:299] Negotiation successful
0807 08:44:18.954795 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 08:44:18.955605 1006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:18.941512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:40319 (local address 127.0.0.1:52850)
0807 08:44:18.941948 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:18.941993 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 08:44:18.942769 (+ 776us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:44:18.943260 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:44:18.943266 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:44:18.943593 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:44:18.944012 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:18.944024 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:18.945150 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:18.945152 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:18.945982 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:18.945991 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:18.946625 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:18.946628 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:18.946761 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:18.947342 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:44:18.947356 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:44:18.951380 (+ 4024us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:44:18.953080 (+ 1700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:18.953085 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:18.953097 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:18.953356 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:18.953640 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:18.953644 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:18.953646 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:18.953778 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:18.954203 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:44:18.954209 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:44:18.954439 (+ 230us) client_negotiation.cc:769] Sending connection context
0807 08:44:18.954614 (+ 175us) client_negotiation.cc:240] Negotiation successful
0807 08:44:18.954885 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":118,"threads_started":1}
I20260807 08:44:18.956799 1003 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46141 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 08:44:18 dist-test-slave-6nmv krb5kdc[839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092258, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.253@KRBTEST.COM for kudu/127.8.208.253@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.208.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.252.keytab.
Entry for principal kudu/127.8.208.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.252.keytab.
I20260807 08:44:18.964294 925 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46141 } attempt: 3
I20260807 08:44:18.965296 9027 external_mini_cluster.cc:1326] Running /tmp/dist-test-task8uPgIu/build/debug/bin/kudu
/tmp/dist-test-task8uPgIu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.252:34849
--webserver_interface=127.8.208.252
--webserver_port=0
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.252.keytab
--principal=kudu/127.8.208.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.208.212:42009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.208.254:40319,127.8.208.253:46141,127.8.208.252:34849
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 08:44:18.966061 1006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:18.957295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:46141 (local address 127.0.0.1:42268)
0807 08:44:18.957455 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:18.957469 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:44:18.957559 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:44:18.958500 (+ 941us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:44:18.958502 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:44:18.958630 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:44:18.958714 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:18.958718 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:18.959741 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:18.959744 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:18.960243 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:18.960250 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:18.960816 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:18.960819 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:18.960886 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:18.961232 (+ 346us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:44:18.961242 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:44:18.962429 (+ 1187us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:44:18.964582 (+ 2153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:18.964588 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:18.964592 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:18.964817 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:18.965082 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:18.965086 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:18.965088 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:18.965155 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:18.965679 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:44:18.965681 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:44:18.965768 (+ 87us) client_negotiation.cc:769] Sending connection context
0807 08:44:18.965866 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 08:44:18.965961 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94}
I20260807 08:44:18.966645 1008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:18.957510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42268 (local address 127.8.208.253:46141)
0807 08:44:18.958083 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:18.958096 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:18.958120 (+ 24us) server_negotiation.cc:407] Connection header received
0807 08:44:18.958168 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:18.958175 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:18.958366 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:18.958499 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:18.958889 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:18.959635 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:18.960341 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:18.960722 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:18.960801 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:18.962574 (+ 1773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:18.962583 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:18.962592 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:18.962614 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:18.964456 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:18.964928 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:18.964931 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:18.964932 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:18.964991 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:18.965234 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:18.965239 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:18.965240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:18.965527 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:18.965644 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:18.966278 (+ 634us) server_negotiation.cc:299] Negotiation successful
0807 08:44:18.966404 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":141,"threads_started":1}
I20260807 08:44:18.968746 1003 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } has no permanent_uuid. Determining permanent_uuid...
I20260807 08:44:18.969731 1006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:18.969450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:34849 (local address 127.0.0.1:36588)
0807 08:44:18.969626 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:18.969683 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:34849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
W20260807 08:44:18.969978 953 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.208.252:34849: connect: Connection refused (error 111)
Aug 07 08:44:18 dist-test-slave-6nmv krb5kdc[839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092258, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for kudu/127.8.208.253@KRBTEST.COM
I20260807 08:44:18.971943 1006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:18.971679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:34849 (local address 127.0.0.1:36600)
0807 08:44:18.971820 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:18.971889 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:34849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260807 08:44:18.972126 1003 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.252:34849: Network error: Client connection negotiation failed: client connection to 127.8.208.252:34849: connect: Connection refused (error 111)
I20260807 08:44:18.975137 928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:18.964693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:46141 (local address 127.0.0.1:42280)
0807 08:44:18.964853 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:18.964867 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:44:18.964935 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:44:18.965395 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:44:18.965398 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:44:18.965563 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:44:18.965668 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:18.965674 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:18.966843 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:18.966850 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:18.968369 (+ 1519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:18.968383 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:18.968993 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:18.968997 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:18.969121 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:18.969608 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:44:18.969636 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:44:18.971120 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:44:18.973349 (+ 2229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:18.973355 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:18.973357 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:18.973653 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:18.974034 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:18.974038 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:18.974040 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:18.974155 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:18.974556 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:44:18.974560 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:44:18.974670 (+ 110us) client_negotiation.cc:769] Sending connection context
0807 08:44:18.974799 (+ 129us) client_negotiation.cc:240] Negotiation successful
0807 08:44:18.974968 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97}
I20260807 08:44:18.975172 1010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:18.964741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42280 (local address 127.8.208.253:46141)
0807 08:44:18.965160 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:18.965171 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:18.965183 (+ 12us) server_negotiation.cc:407] Connection header received
0807 08:44:18.965214 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:18.965216 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:18.965255 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:18.965363 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:18.965774 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:18.966660 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:18.968507 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:18.968871 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:18.968981 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:18.971289 (+ 2308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:18.971293 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:18.971297 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:18.971325 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:18.973235 (+ 1910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:18.973781 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:18.973786 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:18.973788 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:18.973929 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:18.974258 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:18.974264 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:18.974266 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:18.974449 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:18.974563 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:18.974854 (+ 291us) server_negotiation.cc:299] Negotiation successful
0807 08:44:18.975009 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":81,"threads_started":1}
I20260807 08:44:18.975865 925 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } has no permanent_uuid. Determining permanent_uuid...
I20260807 08:44:18.976552 928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:18.976309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:34849 (local address 127.0.0.1:36612)
0807 08:44:18.976433 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:18.976486 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:34849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260807 08:44:18.977269 928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:18.977031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:34849 (local address 127.0.0.1:36618)
0807 08:44:18.977166 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:18.977221 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:34849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260807 08:44:18.977474 925 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.252:34849: Network error: Client connection negotiation failed: client connection to 127.8.208.252:34849: connect: Connection refused (error 111)
I20260807 08:44:19.008644 925 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } attempt: 1
I20260807 08:44:19.009327 928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:19.009076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:34849 (local address 127.0.0.1:36622)
0807 08:44:19.009203 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:19.009264 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:34849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260807 08:44:19.010094 928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:19.009882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:34849 (local address 127.0.0.1:36624)
0807 08:44:19.009996 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:19.010040 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:34849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 08:44:19.010298 925 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.252:34849: Network error: Client connection negotiation failed: client connection to 127.8.208.252:34849: connect: Connection refused (error 111)
I20260807 08:44:19.021409 1003 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } attempt: 1
I20260807 08:44:19.022208 1006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:19.021924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:34849 (local address 127.0.0.1:36634)
0807 08:44:19.022070 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:19.022133 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:34849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 08:44:19.022899 1006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:19.022678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:34849 (local address 127.0.0.1:36638)
0807 08:44:19.022790 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:19.022840 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:34849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 08:44:19.023033 1003 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.252:34849: Network error: Client connection negotiation failed: client connection to 127.8.208.252:34849: connect: Connection refused (error 111)
W20260807 08:44:19.072965 1011 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 08:44:19.073235 1011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 08:44:19.073310 1011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 08:44:19.073393 1011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 08:44:19.076988 1011 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 08:44:19.077060 1011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 08:44:19.077095 1011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 08:44:19.077128 1011 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 08:44:19.077157 1011 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 08:44:19.081864 1011 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.208.212:42009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.8.208.254:40319,127.8.208.253:46141,127.8.208.252:34849
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/krb5kdc/kudu_127.8.208.252.keytab
--principal=kudu/127.8.208.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.208.252:34849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.208.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1011
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 07:56:15 UTC on ccycloud.quasar-eqkmoh.root.comops.site
build id 4572005
I20260807 08:44:19.082748 1011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 08:44:19.083813 1011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 08:44:19.085485 925 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } attempt: 2
I20260807 08:44:19.086295 928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:19.086007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:34849 (local address 127.0.0.1:36652)
0807 08:44:19.086173 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:19.086227 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:34849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260807 08:44:19.086974 928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:19.086751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:34849 (local address 127.0.0.1:36668)
0807 08:44:19.086870 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:19.086923 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:34849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 08:44:19.087085 925 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.252:34849: Network error: Client connection negotiation failed: client connection to 127.8.208.252:34849: connect: Connection refused (error 111)
I20260807 08:44:19.091199 1003 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } attempt: 2
W20260807 08:44:19.091676 1018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:19.091670 1017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 08:44:19.091670 1020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 08:44:19.092100 1006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:19.091741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:34849 (local address 127.0.0.1:36680)
0807 08:44:19.091905 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:19.091986 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:34849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 08:44:19.092106 1011 server_base.cc:1034] running on GCE node
I20260807 08:44:19.092691 1011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 08:44:19.092821 1006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:19.092595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:34849 (local address 127.0.0.1:36686)
0807 08:44:19.092691 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:19.092731 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.208.252:34849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 08:44:19.092947 1003 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.208.252:34849: Network error: Client connection negotiation failed: client connection to 127.8.208.252:34849: connect: Connection refused (error 111)
I20260807 08:44:19.093721 1011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 08:44:19.094878 1011 hybrid_clock.cc:648] HybridClock initialized: now 1786092259094865 us; error 20 us; skew 500 ppm
Aug 07 08:44:19 dist-test-slave-6nmv krb5kdc[839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092259, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 08:44:19.097517 1011 init.cc:377] Logged in from keytab as kudu/127.8.208.252@KRBTEST.COM (short username kudu)
I20260807 08:44:19.098407 1011 webserver.cc:460] Webserver started at http://127.8.208.252:33779/ using document root <none> and password file <none>
I20260807 08:44:19.098884 1011 fs_manager.cc:359] Metadata directory not provided
I20260807 08:44:19.098981 1011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 08:44:19.099239 1011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 08:44:19.101104 1011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-2/data/instance:
uuid: "1d49e1442bac407db154a373ea67304c"
format_stamp: "Formatted at 2026-08-07 08:44:19 on dist-test-slave-6nmv"
server_key: "1f7046bf6ba2e3bac97b87220b468246"
server_key_iv: "840b9c9b09608f945421c40dc15c4329"
server_key_version: "encryptionkey@0"
I20260807 08:44:19.101658 1011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-2/wal/instance:
uuid: "1d49e1442bac407db154a373ea67304c"
format_stamp: "Formatted at 2026-08-07 08:44:19 on dist-test-slave-6nmv"
server_key: "1f7046bf6ba2e3bac97b87220b468246"
server_key_iv: "840b9c9b09608f945421c40dc15c4329"
server_key_version: "encryptionkey@0"
I20260807 08:44:19.105129 1011 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 08:44:19.107434 1027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 08:44:19.108557 1011 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 08:44:19.108690 1011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-2/data,/tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-2/wal
uuid: "1d49e1442bac407db154a373ea67304c"
format_stamp: "Formatted at 2026-08-07 08:44:19 on dist-test-slave-6nmv"
server_key: "1f7046bf6ba2e3bac97b87220b468246"
server_key_iv: "840b9c9b09608f945421c40dc15c4329"
server_key_version: "encryptionkey@0"
I20260807 08:44:19.108793 1011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 08:44:19.127138 1011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 08:44:19.130139 1011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 08:44:19.130317 1011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 08:44:19.136538 1011 rpc_server.cc:307] RPC server started. Bound to: 127.8.208.252:34849
I20260807 08:44:19.136794 1081 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.208.252:34849 every 8 connection(s)
I20260807 08:44:19.137377 1011 server_base.cc:1166] Dumped server information to /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-2/data/info.pb
I20260807 08:44:19.139988 1082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 08:44:19.141958 9027 external_mini_cluster.cc:1388] Started /tmp/dist-test-task8uPgIu/build/debug/bin/kudu as pid 1011
I20260807 08:44:19.142057 9027 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task8uPgIu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786091987266300-9027-0/minicluster-data/master-2/wal/instance
I20260807 08:44:19.142385 9027 external_mini_cluster.cc:1428] Setting key 355a6c954188c990e351ad08216ca86c
I20260807 08:44:19.143927 1082 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40319 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 08:44:19 dist-test-slave-6nmv krb5kdc[839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092259, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.252@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
Aug 07 08:44:19 dist-test-slave-6nmv krb5kdc[839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.252@KRBTEST.COM
I20260807 08:44:19.155652 927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:19.145713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52864 (local address 127.8.208.254:40319)
0807 08:44:19.145859 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:19.145864 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:19.146153 (+ 289us) server_negotiation.cc:407] Connection header received
0807 08:44:19.146322 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:19.146324 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:19.146385 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:19.146461 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:19.147067 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.147723 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.148918 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.149247 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.149338 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:19.151767 (+ 2429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:19.151772 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:19.151774 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:19.151803 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:19.153378 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:19.153974 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:19.153976 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:19.153977 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:19.154072 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:19.154446 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:19.154449 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:19.154451 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:19.154702 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:19.154819 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:19.155335 (+ 516us) server_negotiation.cc:299] Negotiation successful
0807 08:44:19.155487 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 08:44:19.156412 1085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:19.143644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36688 (local address 127.8.208.252:34849)
0807 08:44:19.144008 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:19.144026 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:19.144065 (+ 39us) server_negotiation.cc:407] Connection header received
0807 08:44:19.144800 (+ 735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:19.144820 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:19.145170 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:19.145460 (+ 290us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:19.146434 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.147561 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.148668 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.149103 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.149247 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:19.152213 (+ 2966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:19.152223 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:19.152230 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:19.152250 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:19.153926 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:19.154418 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:19.154423 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:19.154425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:19.154510 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:19.154798 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:19.154801 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:19.154803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:19.155083 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:19.155254 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:19.155516 (+ 262us) server_negotiation.cc:299] Negotiation successful
0807 08:44:19.155643 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238,"spinlock_wait_cycles":896,"thread_start_us":100,"threads_started":1}
I20260807 08:44:19.156416 1087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:19.145646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.254:40319 (local address 127.0.0.1:52864)
0807 08:44:19.146043 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:19.146076 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 08:44:19.146206 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:44:19.146511 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:44:19.146515 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:44:19.146784 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:44:19.146927 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:19.146936 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.147826 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.147828 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:19.148811 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:19.148820 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.149389 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.149411 (+ 22us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:19.149561 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:19.150024 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:44:19.150043 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:44:19.151577 (+ 1534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:44:19.153476 (+ 1899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:19.153486 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:19.153495 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:19.153886 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:19.154173 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:19.154176 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:19.154178 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:19.154329 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:19.154813 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:44:19.154818 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:44:19.155074 (+ 256us) client_negotiation.cc:769] Sending connection context
0807 08:44:19.155250 (+ 176us) client_negotiation.cc:240] Negotiation successful
0807 08:44:19.155577 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"spinlock_wait_cycles":768,"thread_start_us":129,"threads_started":1}
I20260807 08:44:19.157495 1082 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46141 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 08:44:19 dist-test-slave-6nmv krb5kdc[839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092259, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.252@KRBTEST.COM for kudu/127.8.208.253@KRBTEST.COM
Aug 07 08:44:19 dist-test-slave-6nmv krb5kdc[839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.254@KRBTEST.COM
I20260807 08:44:19.165985 1087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:19.157941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.253:46141 (local address 127.0.0.1:42296)
0807 08:44:19.158229 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:19.158243 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 08:44:19.158311 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:44:19.158603 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:44:19.158606 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:44:19.158774 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:44:19.158856 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:19.158861 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.159692 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.159694 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:19.160154 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:19.160161 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.160628 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.160631 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:19.160716 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:19.161163 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:44:19.161176 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:44:19.162453 (+ 1277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:44:19.164357 (+ 1904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:19.164360 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:19.164362 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:19.164585 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:19.164922 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:19.164927 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:19.164932 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:19.165031 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:19.165475 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:44:19.165478 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:44:19.165574 (+ 96us) client_negotiation.cc:769] Sending connection context
0807 08:44:19.165674 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 08:44:19.165778 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227}
I20260807 08:44:19.166075 1010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:19.158103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42296 (local address 127.8.208.253:46141)
0807 08:44:19.158251 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:19.158255 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:19.158279 (+ 24us) server_negotiation.cc:407] Connection header received
0807 08:44:19.158396 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:19.158401 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:19.158483 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:19.158573 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:19.158958 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.159559 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.160265 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.160520 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.160626 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:19.162586 (+ 1960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:19.162591 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:19.162598 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:19.162619 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:19.164223 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:19.164745 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:19.164747 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:19.164749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:19.164823 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:19.165140 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:19.165144 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:19.165146 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:19.165367 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:19.165476 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:19.165742 (+ 266us) server_negotiation.cc:299] Negotiation successful
0807 08:44:19.165917 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 08:44:19.166836 1082 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } has no permanent_uuid. Determining permanent_uuid...
I20260807 08:44:19.166990 927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:19.158639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52866 (local address 127.8.208.254:40319)
0807 08:44:19.158745 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:19.158751 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:19.158791 (+ 40us) server_negotiation.cc:407] Connection header received
0807 08:44:19.158899 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:19.158902 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:19.158943 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:19.159016 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:19.159549 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.160052 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.160735 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.161067 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.161165 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:19.163555 (+ 2390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:19.163560 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:19.163562 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:19.163587 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:19.165000 (+ 1413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:19.165475 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:19.165478 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:19.165479 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:19.165578 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:19.165930 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:19.165934 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:19.165935 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:19.166165 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:19.166379 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:19.166661 (+ 282us) server_negotiation.cc:299] Negotiation successful
0807 08:44:19.166809 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
Aug 07 08:44:19 dist-test-slave-6nmv krb5kdc[839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092259, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.252@KRBTEST.COM for kudu/127.8.208.252@KRBTEST.COM
Aug 07 08:44:19 dist-test-slave-6nmv krb5kdc[839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.208.253@KRBTEST.COM
I20260807 08:44:19.175642 1087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:19.167494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:34849 (local address 127.0.0.1:36690)
0807 08:44:19.167624 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:19.167636 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 08:44:19.167699 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:44:19.167873 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:44:19.167875 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:44:19.168066 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:44:19.168151 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:19.168158 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.169169 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.169172 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:19.169977 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:19.169988 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.170530 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.170532 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:19.170589 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:19.171010 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:44:19.171021 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:44:19.172339 (+ 1318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:44:19.174226 (+ 1887us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:19.174228 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:19.174229 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:19.174489 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:19.174748 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:19.174751 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:19.174752 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:19.174846 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:19.175203 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:44:19.175206 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:44:19.175281 (+ 75us) client_negotiation.cc:769] Sending connection context
0807 08:44:19.175377 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 08:44:19.175501 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260807 08:44:19.175665 1085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:19.167560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36690 (local address 127.8.208.252:34849)
0807 08:44:19.167711 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:19.167715 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:19.167730 (+ 15us) server_negotiation.cc:407] Connection header received
0807 08:44:19.167760 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:19.167762 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:19.167792 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:19.167858 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:19.168267 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.169073 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.170075 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.170419 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.170522 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:19.172484 (+ 1962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:19.172487 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:19.172489 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:19.172508 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:19.174119 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:19.174586 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:19.174588 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:19.174589 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:19.174658 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:19.174948 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:19.174950 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:19.174951 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:19.175090 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:19.175203 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:19.175427 (+ 224us) server_negotiation.cc:299] Negotiation successful
0807 08:44:19.175551 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":99}
I20260807 08:44:19.176939 1010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:19.168028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42304 (local address 127.8.208.253:46141)
0807 08:44:19.168131 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:19.168135 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:19.168164 (+ 29us) server_negotiation.cc:407] Connection header received
0807 08:44:19.168283 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:19.168285 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:19.168320 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:19.168404 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:19.169077 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.169897 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.170810 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.171036 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.171137 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:19.173451 (+ 2314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:19.173454 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:19.173457 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:19.173480 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:19.175082 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:19.175452 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:19.175455 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:19.175457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:19.175537 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:19.176007 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:19.176026 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:19.176028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:19.176213 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:19.176439 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:19.176577 (+ 138us) server_negotiation.cc:299] Negotiation successful
0807 08:44:19.176691 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 08:44:19.179194 1082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d49e1442bac407db154a373ea67304c: Bootstrap starting.
I20260807 08:44:19.180042 9027 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 08:44:19.181790 1082 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d49e1442bac407db154a373ea67304c: Neither blocks nor log segments found. Creating new log.
I20260807 08:44:19.181301 899 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "fde3cc85731b4271a6d05a5784c02ec0"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52866
I20260807 08:44:19.182663 1082 log.cc:824] T 00000000000000000000000000000000 P 1d49e1442bac407db154a373ea67304c: Log is configured to *not* fsync() on all Append() calls
I20260807 08:44:19.184049 1003 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } attempt: 3
I20260807 08:44:19.184689 1082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d49e1442bac407db154a373ea67304c: No bootstrap required, opened a new log
I20260807 08:44:19.186210 925 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } attempt: 3
Aug 07 08:44:19 dist-test-slave-6nmv krb5kdc[839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092258, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.253@KRBTEST.COM for kudu/127.8.208.252@KRBTEST.COM
I20260807 08:44:19.189862 1082 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d49e1442bac407db154a373ea67304c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde3cc85731b4271a6d05a5784c02ec0" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40319 } } peers { permanent_uuid: "8c16d8cedaef4705bf645f2445037273" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46141 } } peers { permanent_uuid: "1d49e1442bac407db154a373ea67304c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } }
I20260807 08:44:19.190130 1082 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d49e1442bac407db154a373ea67304c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d49e1442bac407db154a373ea67304c, State: Initialized, Role: FOLLOWER
I20260807 08:44:19.190482 1082 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d49e1442bac407db154a373ea67304c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde3cc85731b4271a6d05a5784c02ec0" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40319 } } peers { permanent_uuid: "8c16d8cedaef4705bf645f2445037273" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46141 } } peers { permanent_uuid: "1d49e1442bac407db154a373ea67304c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } }
I20260807 08:44:19.191329 1091 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d49e1442bac407db154a373ea67304c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde3cc85731b4271a6d05a5784c02ec0" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40319 } } peers { permanent_uuid: "8c16d8cedaef4705bf645f2445037273" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46141 } } peers { permanent_uuid: "1d49e1442bac407db154a373ea67304c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } } }
I20260807 08:44:19.191469 1091 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d49e1442bac407db154a373ea67304c [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:44:19.191807 1082 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d49e1442bac407db154a373ea67304c [sys.catalog]: configured and running, proceeding with master startup.
Aug 07 08:44:19 dist-test-slave-6nmv krb5kdc[839](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786092258, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.208.254@KRBTEST.COM for kudu/127.8.208.252@KRBTEST.COM
I20260807 08:44:19.193619 1006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:19.184403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:34849 (local address 127.0.0.1:36692)
0807 08:44:19.184579 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:19.184590 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 08:44:19.184697 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:44:19.184983 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:44:19.184986 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:44:19.185166 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:44:19.185270 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:19.185278 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.186178 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.186182 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:19.186743 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:19.186751 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.187969 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.187972 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:19.188095 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:19.188608 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:44:19.188622 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:44:19.189904 (+ 1282us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:44:19.192037 (+ 2133us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:19.192040 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:19.192041 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:19.192293 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:19.192629 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:19.192632 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:19.192634 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:19.192727 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:19.193140 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:44:19.193144 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:44:19.193240 (+ 96us) client_negotiation.cc:769] Sending connection context
0807 08:44:19.193336 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 08:44:19.193458 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109}
I20260807 08:44:19.193621 1085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:19.184488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36692 (local address 127.8.208.252:34849)
0807 08:44:19.184631 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:19.184635 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:19.184649 (+ 14us) server_negotiation.cc:407] Connection header received
0807 08:44:19.184818 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:19.184821 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:19.184863 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:19.184949 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:19.185398 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.186081 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.186854 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.187819 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.187946 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:19.190035 (+ 2089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:19.190038 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:19.190040 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:19.190062 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:19.191919 (+ 1857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:19.192405 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:19.192408 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:19.192428 (+ 20us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:19.192511 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:19.192823 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:19.192828 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:19.192830 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:19.193054 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:19.193138 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:19.193420 (+ 282us) server_negotiation.cc:299] Negotiation successful
0807 08:44:19.193509 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 08:44:19.196698 928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:19.186996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.208.252:34849 (local address 127.0.0.1:36700)
0807 08:44:19.187153 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 08:44:19.187166 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 08:44:19.187291 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 08:44:19.187601 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 08:44:19.187603 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 08:44:19.187850 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0807 08:44:19.187955 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:19.187961 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.189000 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.189004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:19.189784 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 08:44:19.189794 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.190523 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.190527 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 08:44:19.190611 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:19.191028 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 08:44:19.191048 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 08:44:19.192472 (+ 1424us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 08:44:19.195101 (+ 2629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:19.195103 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:19.195105 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:19.195320 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:19.195658 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 08:44:19.195661 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 08:44:19.195663 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 08:44:19.195760 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 08:44:19.196224 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 08:44:19.196227 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 08:44:19.196324 (+ 97us) client_negotiation.cc:769] Sending connection context
0807 08:44:19.196449 (+ 125us) client_negotiation.cc:240] Negotiation successful
0807 08:44:19.196566 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260807 08:44:19.196731 1003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c16d8cedaef4705bf645f2445037273: Bootstrap starting.
W20260807 08:44:19.196900 1102 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1d49e1442bac407db154a373ea67304c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:44:19.196973 1102 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:44:19.197475 1090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:19.187048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36700 (local address 127.8.208.252:34849)
0807 08:44:19.187353 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:19.187372 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:19.187384 (+ 12us) server_negotiation.cc:407] Connection header received
0807 08:44:19.187414 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:19.187416 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:19.187462 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:19.187532 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:19.188073 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.188890 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.189953 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.190416 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.190514 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:19.192671 (+ 2157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:19.192677 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:19.192683 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:19.192713 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:19.195007 (+ 2294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:19.195441 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:19.195444 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:19.195446 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:19.195545 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:19.195876 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:19.195878 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:19.195880 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:19.196084 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:19.196168 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:19.197225 (+ 1057us) server_negotiation.cc:299] Negotiation successful
0807 08:44:19.197326 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":124,"threads_started":1}
I20260807 08:44:19.200146 925 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0: Bootstrap starting.
I20260807 08:44:19.198571 1011 master_runner.cc:186] Error getting master registration for 127.8.208.254:40319: OK, instance_id { permanent_uuid: "fde3cc85731b4271a6d05a5784c02ec0" instance_seqno: 1786092258725411 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 08:44:19.201794 1011 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 08:44:19.202153 925 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0: Neither blocks nor log segments found. Creating new log.
I20260807 08:44:19.202916 925 log.cc:824] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0: Log is configured to *not* fsync() on all Append() calls
I20260807 08:44:19.203361 1003 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c16d8cedaef4705bf645f2445037273: Neither blocks nor log segments found. Creating new log.
I20260807 08:44:19.204137 1003 log.cc:824] T 00000000000000000000000000000000 P 8c16d8cedaef4705bf645f2445037273: Log is configured to *not* fsync() on all Append() calls
I20260807 08:44:19.204875 925 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0: No bootstrap required, opened a new log
I20260807 08:44:19.206952 1003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c16d8cedaef4705bf645f2445037273: No bootstrap required, opened a new log
I20260807 08:44:19.207235 925 raft_consensus.cc:348] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde3cc85731b4271a6d05a5784c02ec0" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40319 } } peers { permanent_uuid: "8c16d8cedaef4705bf645f2445037273" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46141 } } peers { permanent_uuid: "1d49e1442bac407db154a373ea67304c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } }
I20260807 08:44:19.207415 925 raft_consensus.cc:729] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fde3cc85731b4271a6d05a5784c02ec0, State: Initialized, Role: FOLLOWER
I20260807 08:44:19.207731 925 consensus_queue.cc:260] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde3cc85731b4271a6d05a5784c02ec0" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40319 } } peers { permanent_uuid: "8c16d8cedaef4705bf645f2445037273" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46141 } } peers { permanent_uuid: "1d49e1442bac407db154a373ea67304c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } }
I20260807 08:44:19.208168 1106 sys_catalog.cc:455] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde3cc85731b4271a6d05a5784c02ec0" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40319 } } peers { permanent_uuid: "8c16d8cedaef4705bf645f2445037273" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46141 } } peers { permanent_uuid: "1d49e1442bac407db154a373ea67304c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } } }
I20260807 08:44:19.208323 1106 sys_catalog.cc:458] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:44:19.208904 925 sys_catalog.cc:564] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:44:19.208974 899 raft_consensus.cc:482] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 08:44:19.209105 899 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:44:19.210276 899 raft_consensus.cc:504] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde3cc85731b4271a6d05a5784c02ec0" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40319 } } peers { permanent_uuid: "8c16d8cedaef4705bf645f2445037273" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46141 } } peers { permanent_uuid: "1d49e1442bac407db154a373ea67304c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } }
I20260807 08:44:19.211154 899 leader_election.cc:288] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0 [CANDIDATE]: Term 1 election: Requested vote from peers 8c16d8cedaef4705bf645f2445037273 (127.8.208.253:46141), 1d49e1442bac407db154a373ea67304c (127.8.208.252:34849)
I20260807 08:44:19.211889 1056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fde3cc85731b4271a6d05a5784c02ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "1d49e1442bac407db154a373ea67304c"
I20260807 08:44:19.212126 1056 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d49e1442bac407db154a373ea67304c [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:44:19.213905 1056 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1d49e1442bac407db154a373ea67304c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fde3cc85731b4271a6d05a5784c02ec0 in term 1.
I20260807 08:44:19.214334 1003 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8c16d8cedaef4705bf645f2445037273 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde3cc85731b4271a6d05a5784c02ec0" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40319 } } peers { permanent_uuid: "8c16d8cedaef4705bf645f2445037273" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46141 } } peers { permanent_uuid: "1d49e1442bac407db154a373ea67304c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } }
I20260807 08:44:19.214576 1003 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8c16d8cedaef4705bf645f2445037273 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c16d8cedaef4705bf645f2445037273, State: Initialized, Role: FOLLOWER
I20260807 08:44:19.214807 875 leader_election.cc:302] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d49e1442bac407db154a373ea67304c, fde3cc85731b4271a6d05a5784c02ec0; no voters:
I20260807 08:44:19.214857 1003 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c16d8cedaef4705bf645f2445037273 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde3cc85731b4271a6d05a5784c02ec0" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40319 } } peers { permanent_uuid: "8c16d8cedaef4705bf645f2445037273" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46141 } } peers { permanent_uuid: "1d49e1442bac407db154a373ea67304c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } }
I20260807 08:44:19.215083 1106 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 08:44:19.215303 1106 raft_consensus.cc:686] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0 [term 1 LEADER]: Becoming Leader. State: Replica: fde3cc85731b4271a6d05a5784c02ec0, State: Running, Role: LEADER
I20260807 08:44:19.215626 1106 consensus_queue.cc:237] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde3cc85731b4271a6d05a5784c02ec0" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40319 } } peers { permanent_uuid: "8c16d8cedaef4705bf645f2445037273" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46141 } } peers { permanent_uuid: "1d49e1442bac407db154a373ea67304c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } }
I20260807 08:44:19.216532 1003 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8c16d8cedaef4705bf645f2445037273 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 08:44:19.217201 1123 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c16d8cedaef4705bf645f2445037273 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde3cc85731b4271a6d05a5784c02ec0" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40319 } } peers { permanent_uuid: "8c16d8cedaef4705bf645f2445037273" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46141 } } peers { permanent_uuid: "1d49e1442bac407db154a373ea67304c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } } }
I20260807 08:44:19.217322 1123 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c16d8cedaef4705bf645f2445037273 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:44:19.217314 1106 sys_catalog.cc:455] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fde3cc85731b4271a6d05a5784c02ec0. Latest consensus state: current_term: 1 leader_uuid: "fde3cc85731b4271a6d05a5784c02ec0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde3cc85731b4271a6d05a5784c02ec0" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40319 } } peers { permanent_uuid: "8c16d8cedaef4705bf645f2445037273" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46141 } } peers { permanent_uuid: "1d49e1442bac407db154a373ea67304c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } } }
I20260807 08:44:19.217397 1106 sys_catalog.cc:458] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0 [sys.catalog]: This master's current role is: LEADER
I20260807 08:44:19.217906 976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fde3cc85731b4271a6d05a5784c02ec0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "8c16d8cedaef4705bf645f2445037273"
I20260807 08:44:19.218118 976 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c16d8cedaef4705bf645f2445037273 [term 0 FOLLOWER]: Advancing to term 1
I20260807 08:44:19.219066 976 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8c16d8cedaef4705bf645f2445037273 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fde3cc85731b4271a6d05a5784c02ec0 in term 1.
W20260807 08:44:19.222030 877 tablet.cc:2369] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 08:44:19.215103 854 master_runner.cc:186] Error getting master registration for 127.8.208.253:46141: OK, instance_id { permanent_uuid: "8c16d8cedaef4705bf645f2445037273" instance_seqno: 1786092258930457 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 08:44:19.222530 854 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 08:44:19.222847 1141 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8c16d8cedaef4705bf645f2445037273: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:44:19.222913 1141 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260807 08:44:19.225070 1118 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 08:44:19.225131 1118 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 08:44:19.226531 1135 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 08:44:19.227322 1135 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 08:44:19.232596 1056 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1d49e1442bac407db154a373ea67304c [term 1 FOLLOWER]: Refusing update from remote peer fde3cc85731b4271a6d05a5784c02ec0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:44:19.233242 976 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8c16d8cedaef4705bf645f2445037273 [term 1 FOLLOWER]: Refusing update from remote peer fde3cc85731b4271a6d05a5784c02ec0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 08:44:19.233937 1106 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c16d8cedaef4705bf645f2445037273" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:44:19.234297 1106 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d49e1442bac407db154a373ea67304c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 08:44:19.237775 1123 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c16d8cedaef4705bf645f2445037273 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fde3cc85731b4271a6d05a5784c02ec0. Latest consensus state: current_term: 1 leader_uuid: "fde3cc85731b4271a6d05a5784c02ec0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde3cc85731b4271a6d05a5784c02ec0" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40319 } } peers { permanent_uuid: "8c16d8cedaef4705bf645f2445037273" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46141 } } peers { permanent_uuid: "1d49e1442bac407db154a373ea67304c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } } }
I20260807 08:44:19.237917 1123 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c16d8cedaef4705bf645f2445037273 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:44:19.241061 1091 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d49e1442bac407db154a373ea67304c [sys.catalog]: SysCatalogTable state changed. Reason: New leader fde3cc85731b4271a6d05a5784c02ec0. Latest consensus state: current_term: 1 leader_uuid: "fde3cc85731b4271a6d05a5784c02ec0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde3cc85731b4271a6d05a5784c02ec0" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40319 } } peers { permanent_uuid: "8c16d8cedaef4705bf645f2445037273" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46141 } } peers { permanent_uuid: "1d49e1442bac407db154a373ea67304c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } } }
I20260807 08:44:19.241204 1091 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d49e1442bac407db154a373ea67304c [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:44:19.249059 1010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:19.216661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42310 (local address 127.8.208.253:46141)
0807 08:44:19.217757 (+ 1096us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:19.217761 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:19.231804 (+ 14043us) server_negotiation.cc:407] Connection header received
0807 08:44:19.231844 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:19.231847 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:19.231893 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:19.231979 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:19.241448 (+ 9469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.242237 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.243350 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.243698 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.243772 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:19.245689 (+ 1917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:19.245693 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:19.245696 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:19.245720 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:19.247295 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:19.247721 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:19.247724 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:19.247726 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:19.247803 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:19.248110 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:19.248114 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:19.248115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:19.248323 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:19.248417 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:19.248781 (+ 364us) server_negotiation.cc:299] Negotiation successful
0807 08:44:19.248897 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1028}
I20260807 08:44:19.268250 1144 mvcc.cc:205] Tried to move back new op lower bound from 7315833893808390144 to 7315833893750702080. Current Snapshot: MvccSnapshot[applied={T|T < 7315833893808390144}]
I20260807 08:44:19.268865 1106 sys_catalog.cc:455] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fde3cc85731b4271a6d05a5784c02ec0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde3cc85731b4271a6d05a5784c02ec0" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40319 } } peers { permanent_uuid: "8c16d8cedaef4705bf645f2445037273" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46141 } } peers { permanent_uuid: "1d49e1442bac407db154a373ea67304c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } } }
I20260807 08:44:19.268986 1106 sys_catalog.cc:458] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0 [sys.catalog]: This master's current role is: LEADER
I20260807 08:44:19.270072 1091 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d49e1442bac407db154a373ea67304c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fde3cc85731b4271a6d05a5784c02ec0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde3cc85731b4271a6d05a5784c02ec0" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40319 } } peers { permanent_uuid: "8c16d8cedaef4705bf645f2445037273" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46141 } } peers { permanent_uuid: "1d49e1442bac407db154a373ea67304c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } } }
I20260807 08:44:19.270187 1091 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d49e1442bac407db154a373ea67304c [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:44:19.271430 927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:19.217613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52876 (local address 127.8.208.254:40319)
0807 08:44:19.217730 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:19.217734 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:19.231022 (+ 13288us) server_negotiation.cc:407] Connection header received
0807 08:44:19.244420 (+ 13398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:19.244423 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:19.244467 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:19.244515 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:19.252785 (+ 8270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.253505 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.255575 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.255902 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.255972 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:19.263850 (+ 7878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:19.263854 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:19.263856 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:19.263880 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:19.266242 (+ 2362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:19.267008 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:19.267023 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:19.267025 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:19.267114 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:19.270554 (+ 3440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:19.270557 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:19.270560 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:19.270755 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:19.270850 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:19.271188 (+ 338us) server_negotiation.cc:299] Negotiation successful
0807 08:44:19.271290 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 08:44:19.273252 1090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:19.215474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36712 (local address 127.8.208.252:34849)
0807 08:44:19.215602 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:19.215606 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:19.229307 (+ 13701us) server_negotiation.cc:407] Connection header received
0807 08:44:19.229501 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:19.229504 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:19.229552 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:19.229605 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:19.250800 (+ 21195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.251625 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.254656 (+ 3031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:19.255038 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:19.255109 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:19.263506 (+ 8397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 08:44:19.263510 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 08:44:19.263512 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 08:44:19.263537 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 08:44:19.265440 (+ 1903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:19.271907 (+ 6467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:19.271912 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:19.271914 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:19.272006 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 08:44:19.272323 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 08:44:19.272327 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 08:44:19.272329 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 08:44:19.272548 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 08:44:19.272680 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:19.272999 (+ 319us) server_negotiation.cc:299] Negotiation successful
0807 08:44:19.273122 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 08:44:19.274464 1106 sys_catalog.cc:455] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fde3cc85731b4271a6d05a5784c02ec0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde3cc85731b4271a6d05a5784c02ec0" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40319 } } peers { permanent_uuid: "8c16d8cedaef4705bf645f2445037273" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46141 } } peers { permanent_uuid: "1d49e1442bac407db154a373ea67304c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } } }
I20260807 08:44:19.274570 1106 sys_catalog.cc:458] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0 [sys.catalog]: This master's current role is: LEADER
I20260807 08:44:19.275648 1123 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c16d8cedaef4705bf645f2445037273 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fde3cc85731b4271a6d05a5784c02ec0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde3cc85731b4271a6d05a5784c02ec0" member_type: VOTER last_known_addr { host: "127.8.208.254" port: 40319 } } peers { permanent_uuid: "8c16d8cedaef4705bf645f2445037273" member_type: VOTER last_known_addr { host: "127.8.208.253" port: 46141 } } peers { permanent_uuid: "1d49e1442bac407db154a373ea67304c" member_type: VOTER last_known_addr { host: "127.8.208.252" port: 34849 } } }
I20260807 08:44:19.275763 1123 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c16d8cedaef4705bf645f2445037273 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 08:44:19.276429 1147 mvcc.cc:205] Tried to move back new op lower bound from 7315833893808390144 to 7315833893750702080. Current Snapshot: MvccSnapshot[applied={T|T < 7315833893808390144}]
I20260807 08:44:19.276587 1145 mvcc.cc:205] Tried to move back new op lower bound from 7315833893808390144 to 7315833893750702080. Current Snapshot: MvccSnapshot[applied={T|T < 7315833893808390144}]
I20260807 08:44:19.279886 1135 catalog_manager.cc:1347] Generated new cluster ID: 1b6015f0b9f542ac8e2f2bb089b740d3
I20260807 08:44:19.279961 1135 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 08:44:19.295627 1135 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 08:44:19.296718 1135 catalog_manager.cc:1504] Loading token signing keys...
I20260807 08:44:19.314262 1135 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fde3cc85731b4271a6d05a5784c02ec0: Generated new TSK 0
I20260807 08:44:19.317018 1135 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 08:44:19.348448 1090 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:19.346072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36714 (local address 127.8.208.252:34849)
0807 08:44:19.346193 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:19.346197 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:19.347430 (+ 1233us) server_negotiation.cc:407] Connection header received
0807 08:44:19.347625 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:19.347628 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:19.347676 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:19.347727 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:19.348324 (+ 597us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36714: BlockingRecv error: recv got EOF from 127.0.0.1:36714 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260807 08:44:19.349797 927 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:19.346838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52890 (local address 127.8.208.254:40319)
0807 08:44:19.346956 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:19.346961 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:19.348932 (+ 1971us) server_negotiation.cc:407] Connection header received
0807 08:44:19.349108 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:19.349111 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:19.349155 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:19.349206 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:19.349680 (+ 474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52890: BlockingRecv error: recv got EOF from 127.0.0.1:52890 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260807 08:44:19.351658 1010 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:19.350400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42320 (local address 127.8.208.253:46141)
0807 08:44:19.350504 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:19.350508 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:19.350769 (+ 261us) server_negotiation.cc:407] Connection header received
0807 08:44:19.350947 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:19.350950 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:19.350994 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:19.351054 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:19.351533 (+ 479us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42320: BlockingRecv error: recv got EOF from 127.0.0.1:42320 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260807 08:44:19.355549 1010 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:19.354221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42326 (local address 127.8.208.253:46141)
0807 08:44:19.354311 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:19.354315 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:19.354706 (+ 391us) server_negotiation.cc:407] Connection header received
0807 08:44:19.354891 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:19.354894 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:19.354956 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:19.355003 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:19.355458 (+ 455us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42326: BlockingRecv error: recv got EOF from 127.0.0.1:42326 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260807 08:44:19.359964 1010 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:19.358687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42340 (local address 127.8.208.253:46141)
0807 08:44:19.358774 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:19.358778 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:19.359190 (+ 412us) server_negotiation.cc:407] Connection header received
0807 08:44:19.359346 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:19.359349 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:19.359388 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:19.359432 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:19.359891 (+ 459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42340: BlockingRecv error: recv got EOF from 127.0.0.1:42340 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260807 08:44:19.364871 1010 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:19.363700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42350 (local address 127.8.208.253:46141)
0807 08:44:19.363772 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:19.363775 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:19.364192 (+ 417us) server_negotiation.cc:407] Connection header received
0807 08:44:19.364336 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:19.364338 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:19.364375 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:19.364414 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:19.364803 (+ 389us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42350: BlockingRecv error: recv got EOF from 127.0.0.1:42350 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260807 08:44:19.372066 1010 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:19.370727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42352 (local address 127.8.208.253:46141)
0807 08:44:19.370832 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:19.370835 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:19.371245 (+ 410us) server_negotiation.cc:407] Connection header received
0807 08:44:19.371399 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:19.371402 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:19.371443 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:19.371485 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:19.371975 (+ 490us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42352: BlockingRecv error: recv got EOF from 127.0.0.1:42352 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260807 08:44:19.384385 1010 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:19.382975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42364 (local address 127.8.208.253:46141)
0807 08:44:19.383082 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:19.383086 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:19.383536 (+ 450us) server_negotiation.cc:407] Connection header received
0807 08:44:19.383720 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:19.383723 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:19.383771 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:19.383819 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:19.384297 (+ 478us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42364: BlockingRecv error: recv got EOF from 127.0.0.1:42364 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260807 08:44:19.403491 1010 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:19.402439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42376 (local address 127.8.208.253:46141)
0807 08:44:19.402543 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:19.402547 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:19.402674 (+ 127us) server_negotiation.cc:407] Connection header received
0807 08:44:19.402766 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:19.402769 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:19.402820 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:19.402935 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:19.403395 (+ 460us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42376: BlockingRecv error: recv got EOF from 127.0.0.1:42376 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260807 08:44:19.438606 1010 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:19.437574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42392 (local address 127.8.208.253:46141)
0807 08:44:19.437696 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:19.437700 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:19.437880 (+ 180us) server_negotiation.cc:407] Connection header received
0807 08:44:19.437978 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:19.437980 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:19.438024 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:19.438099 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:19.438499 (+ 400us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42392: BlockingRecv error: recv got EOF from 127.0.0.1:42392 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260807 08:44:19.505926 1010 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:19.504808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42398 (local address 127.8.208.253:46141)
0807 08:44:19.504985 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:19.504990 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:19.505094 (+ 104us) server_negotiation.cc:407] Connection header received
0807 08:44:19.505212 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:19.505215 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:19.505264 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:19.505336 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:19.505771 (+ 435us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42398: BlockingRecv error: recv got EOF from 127.0.0.1:42398 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260807 08:44:19.637274 1010 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:19.636018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42402 (local address 127.8.208.253:46141)
0807 08:44:19.636192 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:19.636197 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:19.636351 (+ 154us) server_negotiation.cc:407] Connection header received
0807 08:44:19.636528 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:19.636530 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:19.636576 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:19.636667 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:19.637113 (+ 446us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42402: BlockingRecv error: recv got EOF from 127.0.0.1:42402 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260807 08:44:19.896693 1010 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 08:44:19.895573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42418 (local address 127.8.208.253:46141)
0807 08:44:19.895726 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:19.895733 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:19.895772 (+ 39us) server_negotiation.cc:407] Connection header received
0807 08:44:19.895966 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:19.895969 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:19.896026 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:19.896115 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 08:44:19.896566 (+ 451us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42418: BlockingRecv error: recv got EOF from 127.0.0.1:42418 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 08:44:20.198175 1102 catalog_manager.cc:1259] Loaded cluster ID: 1b6015f0b9f542ac8e2f2bb089b740d3
I20260807 08:44:20.198251 1102 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1d49e1442bac407db154a373ea67304c: loading cluster ID for follower catalog manager: success
I20260807 08:44:20.199950 1102 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1d49e1442bac407db154a373ea67304c: acquiring CA information for follower catalog manager: success
I20260807 08:44:20.200943 1102 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1d49e1442bac407db154a373ea67304c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 08:44:20.224086 1141 catalog_manager.cc:1259] Loaded cluster ID: 1b6015f0b9f542ac8e2f2bb089b740d3
I20260807 08:44:20.224171 1141 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8c16d8cedaef4705bf645f2445037273: loading cluster ID for follower catalog manager: success
I20260807 08:44:20.225713 1141 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8c16d8cedaef4705bf645f2445037273: acquiring CA information for follower catalog manager: success
I20260807 08:44:20.226683 1141 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8c16d8cedaef4705bf645f2445037273: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 08:44:20.414563 1220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:20.410802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42430 (local address 127.8.208.253:46141)
0807 08:44:20.411125 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:20.411128 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:20.411145 (+ 17us) server_negotiation.cc:407] Connection header received
0807 08:44:20.411245 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:20.411247 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:20.411365 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:20.411506 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:44:20.411762 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:20.412311 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:20.413153 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:20.413342 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:20.413421 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:20.413650 (+ 229us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:44:20.414187 (+ 537us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:44:20.414275 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:20.414332 (+ 57us) server_negotiation.cc:299] Negotiation successful
0807 08:44:20.414374 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":124,"threads_started":1}
I20260807 08:44:20.420672 1226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:20.417294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36720 (local address 127.8.208.252:34849)
0807 08:44:20.417526 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:20.417531 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:20.417543 (+ 12us) server_negotiation.cc:407] Connection header received
0807 08:44:20.417661 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:20.417663 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:20.417753 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:20.417882 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:44:20.418130 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:20.418566 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:20.419400 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:20.419627 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:20.419739 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:20.420027 (+ 288us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:44:20.420307 (+ 280us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:44:20.420426 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:20.420487 (+ 61us) server_negotiation.cc:299] Negotiation successful
0807 08:44:20.420535 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":60,"threads_started":1}
I20260807 08:44:20.426191 1220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:20.423352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42446 (local address 127.8.208.253:46141)
0807 08:44:20.423456 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:20.423460 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:20.423474 (+ 14us) server_negotiation.cc:407] Connection header received
0807 08:44:20.423540 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:20.423543 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:20.423586 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:20.423660 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:44:20.423892 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:20.424527 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:20.425232 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:20.425415 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:20.425508 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:20.425761 (+ 253us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:44:20.425851 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:44:20.425925 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:20.426027 (+ 102us) server_negotiation.cc:299] Negotiation successful
0807 08:44:20.426069 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 08:44:20.427731 1226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:20.423223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36732 (local address 127.8.208.252:34849)
0807 08:44:20.423484 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:20.423489 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:20.423881 (+ 392us) server_negotiation.cc:407] Connection header received
0807 08:44:20.424074 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:20.424077 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:20.424127 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:20.424163 (+ 36us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:44:20.424568 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:20.425201 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:20.426385 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:20.426674 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:20.426756 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:20.427287 (+ 531us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:44:20.427354 (+ 67us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:44:20.427433 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:20.427551 (+ 118us) server_negotiation.cc:299] Negotiation successful
0807 08:44:20.427598 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201}
I20260807 08:44:20.428112 1234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 08:44:20.423164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52906 (local address 127.8.208.254:40319)
0807 08:44:20.423631 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0807 08:44:20.423637 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 08:44:20.423652 (+ 15us) server_negotiation.cc:407] Connection header received
0807 08:44:20.423847 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 08:44:20.423852 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 08:44:20.424036 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 08:44:20.424144 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 08:44:20.424418 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:20.425177 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:20.426385 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 08:44:20.426679 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 08:44:20.426756 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 08:44:20.427325 (+ 569us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 08:44:20.427590 (+ 265us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 08:44:20.427671 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 08:44:20.427855 (+ 184us) server_negotiation.cc:299] Negotiation successful
0807 08:44:20.427953 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":69,"threads_started":1}
I20260807 08:44:20.430902 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 854
I20260807 08:44:20.438289 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 932
I20260807 08:44:20.445294 9027 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task8uPgIu/build/debug/bin/kudu with pid 1011
2026-08-07T08:44:20Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3023 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6062 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (273169 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST